May 28 10:25:32.170579 ip-10-0-141-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 10:25:32.170595 ip-10-0-141-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 10:25:32.170605 ip-10-0-141-178 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 10:25:32.170966 ip-10-0-141-178 systemd[1]: Failed to start Kubernetes Kubelet. May 28 10:25:43.401336 ip-10-0-141-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 10:25:43.401352 ip-10-0-141-178 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 88768a4a40d748e59a74b333d793827c -- May 28 10:27:56.577736 ip-10-0-141-178 systemd[1]: Starting Kubernetes Kubelet... May 28 10:27:57.081718 ip-10-0-141-178 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:27:57.081718 ip-10-0-141-178 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 10:27:57.081718 ip-10-0-141-178 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:27:57.081718 ip-10-0-141-178 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 10:27:57.081718 ip-10-0-141-178 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:27:57.083846 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.083706 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 10:27:57.088851 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088827 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:27:57.088851 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088846 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:27:57.088851 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088851 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:27:57.088851 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088855 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088859 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088863 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088867 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088871 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088874 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088878 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088882 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088885 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088889 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088892 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088896 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088900 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088904 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088907 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088911 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088914 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088918 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088922 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088926 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:27:57.089099 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088930 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088934 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088940 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088946 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088960 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088965 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088969 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088974 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088978 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088982 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088987 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088991 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088995 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.088999 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089006 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089011 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089015 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089019 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089023 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:27:57.089906 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089027 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089032 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089036 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089040 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089044 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089048 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089053 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089056 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089060 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089065 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089069 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089073 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089078 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089083 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089087 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089091 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089095 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089099 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089103 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089107 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:27:57.090636 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089111 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089115 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089120 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089127 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089134 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089139 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089143 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089148 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089152 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089157 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089161 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089165 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089169 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089174 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089178 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089182 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089188 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089192 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089196 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089200 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:27:57.091116 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089204 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089217 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089222 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089226 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089909 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089919 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089923 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089928 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089932 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089936 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089941 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089945 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089949 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089958 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089962 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089967 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089971 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089975 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:27:57.091832 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089980 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089984 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089989 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.089996 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090001 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090006 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090011 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090015 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090021 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090027 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090032 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090036 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090040 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090044 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090049 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090053 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090057 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090062 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090067 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090071 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:27:57.092637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090075 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090079 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090083 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090088 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090101 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090105 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090109 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090113 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090119 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090123 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090127 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090131 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090136 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090140 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090144 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090148 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090152 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090157 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090161 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090166 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:27:57.093254 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090171 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090175 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090180 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090185 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090189 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090193 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090197 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090201 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090205 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090209 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090214 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090218 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090222 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090226 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090231 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090235 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090239 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090243 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090248 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090252 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:27:57.093877 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090256 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090260 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090264 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090268 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090273 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090277 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090282 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090286 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090291 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090295 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.090300 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091333 2575 flags.go:64] FLAG: --address="0.0.0.0" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091348 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091360 2575 flags.go:64] FLAG: --anonymous-auth="true" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091367 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091375 2575 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091380 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091387 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091394 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091399 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091404 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 10:27:57.094523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091409 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091414 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091420 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091425 2575 flags.go:64] FLAG: --cgroup-root="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091429 2575 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091434 2575 flags.go:64] FLAG: --client-ca-file="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091452 2575 flags.go:64] FLAG: --cloud-config="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091457 2575 flags.go:64] FLAG: --cloud-provider="external" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091462 2575 flags.go:64] FLAG: --cluster-dns="[]" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091468 2575 flags.go:64] FLAG: --cluster-domain="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091472 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091477 2575 flags.go:64] FLAG: --config-dir="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091483 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091488 2575 flags.go:64] FLAG: --container-log-max-files="5" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091494 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091500 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091505 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091510 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091516 2575 flags.go:64] FLAG: --contention-profiling="false" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091521 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091526 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091531 2575 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091536 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091543 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091548 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 10:27:57.095035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091553 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091558 2575 flags.go:64] FLAG: --enable-load-reader="false" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091564 2575 flags.go:64] FLAG: --enable-server="true" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091570 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091577 2575 flags.go:64] FLAG: --event-burst="100" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091583 2575 flags.go:64] FLAG: --event-qps="50" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091588 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091593 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091597 2575 flags.go:64] FLAG: --eviction-hard="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091604 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091609 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091613 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091618 2575 flags.go:64] FLAG: --eviction-soft="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091624 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091629 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091633 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091638 2575 flags.go:64] FLAG: --experimental-mounter-path="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091643 2575 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091648 2575 flags.go:64] FLAG: --fail-swap-on="true" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091653 2575 flags.go:64] FLAG: --feature-gates="" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091659 2575 flags.go:64] FLAG: --file-check-frequency="20s" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091664 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091670 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091676 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091681 2575 flags.go:64] FLAG: --healthz-port="10248" May 28 10:27:57.095826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091686 2575 flags.go:64] FLAG: --help="false" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091691 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-178.ec2.internal" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091697 2575 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091701 2575 flags.go:64] FLAG: --http-check-frequency="20s" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091706 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091712 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091718 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091723 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091728 2575 flags.go:64] FLAG: --image-service-endpoint="" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091732 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091738 2575 flags.go:64] FLAG: --kube-api-burst="100" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091743 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091748 2575 flags.go:64] FLAG: --kube-api-qps="50" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091753 2575 flags.go:64] FLAG: --kube-reserved="" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091758 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091763 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091769 2575 flags.go:64] FLAG: --kubelet-cgroups="" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091774 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091779 2575 flags.go:64] FLAG: --lock-file="" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091783 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091789 2575 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091793 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091802 2575 flags.go:64] FLAG: --log-json-split-stream="false" May 28 10:27:57.096468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091807 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091812 2575 flags.go:64] FLAG: --log-text-split-stream="false" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091817 2575 flags.go:64] FLAG: --logging-format="text" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091822 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091828 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091832 2575 flags.go:64] FLAG: --manifest-url="" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091840 2575 flags.go:64] FLAG: --manifest-url-header="" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091847 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091852 2575 flags.go:64] FLAG: --max-open-files="1000000" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091859 2575 flags.go:64] FLAG: --max-pods="110" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091864 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091869 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091874 2575 flags.go:64] FLAG: --memory-manager-policy="None" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091879 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091884 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091889 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091894 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091906 2575 flags.go:64] FLAG: --node-status-max-images="50" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091911 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091916 2575 flags.go:64] FLAG: --oom-score-adj="-999" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091922 2575 flags.go:64] FLAG: --pod-cidr="" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091927 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091935 2575 flags.go:64] FLAG: --pod-manifest-path="" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091940 2575 flags.go:64] FLAG: --pod-max-pids="-1" May 28 10:27:57.097034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091946 2575 flags.go:64] FLAG: --pods-per-core="0" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091951 2575 flags.go:64] FLAG: --port="10250" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091956 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091960 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d3a93d7f44d0295b" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091966 2575 flags.go:64] FLAG: --qos-reserved="" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091971 2575 flags.go:64] FLAG: --read-only-port="10255" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091976 2575 flags.go:64] FLAG: --register-node="true" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091981 2575 flags.go:64] FLAG: --register-schedulable="true" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091986 2575 flags.go:64] FLAG: --register-with-taints="" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091992 2575 flags.go:64] FLAG: --registry-burst="10" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.091997 2575 flags.go:64] FLAG: --registry-qps="5" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092001 2575 flags.go:64] FLAG: --reserved-cpus="" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092006 2575 flags.go:64] FLAG: --reserved-memory="" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092011 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092018 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092027 2575 flags.go:64] FLAG: --rotate-certificates="false" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092032 2575 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092037 2575 flags.go:64] FLAG: --runonce="false" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092042 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092047 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092052 2575 flags.go:64] FLAG: --seccomp-default="false" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092056 2575 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092061 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092067 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092072 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092077 2575 flags.go:64] FLAG: --storage-driver-password="root" May 28 10:27:57.097658 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092082 2575 flags.go:64] FLAG: --storage-driver-secure="false" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092086 2575 flags.go:64] FLAG: --storage-driver-table="stats" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092091 2575 flags.go:64] FLAG: --storage-driver-user="root" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092097 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092103 2575 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092107 2575 flags.go:64] FLAG: --system-cgroups="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092112 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092121 2575 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092126 2575 flags.go:64] FLAG: --tls-cert-file="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092131 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092137 2575 flags.go:64] FLAG: --tls-min-version="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092141 2575 flags.go:64] FLAG: --tls-private-key-file="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092146 2575 flags.go:64] FLAG: --topology-manager-policy="none" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092151 2575 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092156 2575 flags.go:64] FLAG: --topology-manager-scope="container" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092161 2575 flags.go:64] FLAG: --v="2" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092167 2575 flags.go:64] FLAG: --version="false" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092173 2575 flags.go:64] FLAG: --vmodule="" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092179 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092184 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092345 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092353 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092358 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092363 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:27:57.098281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092367 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092371 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092375 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092379 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092383 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092388 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092393 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092397 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092402 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092406 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092410 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092414 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092420 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092424 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092428 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092432 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092454 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092458 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092463 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092467 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:27:57.098933 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092471 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092475 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092479 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092483 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092487 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092492 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092496 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092500 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092506 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092512 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092516 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092521 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092525 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092530 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092534 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092541 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092547 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092552 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092557 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:27:57.099431 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092561 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092566 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092570 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092574 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092580 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092587 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092593 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092597 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092601 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092606 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092610 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092614 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092618 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092622 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092627 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092631 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092634 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092639 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092643 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092646 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:27:57.099925 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092650 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092656 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092662 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092666 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092671 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092675 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092680 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092684 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092688 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092692 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092696 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092700 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092705 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092709 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092713 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092717 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092721 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092726 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092729 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092735 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:27:57.100417 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092740 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092744 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.092749 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.092757 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.099693 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.099709 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099754 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099759 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099763 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099766 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099769 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099772 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099775 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099777 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099780 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099783 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:27:57.100960 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099785 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099788 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099791 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099793 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099796 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099798 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099801 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099804 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099807 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099809 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099812 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099814 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099817 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099819 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099822 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099825 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099828 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099830 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099833 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:27:57.101359 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099835 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099838 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099842 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099845 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099847 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099850 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099853 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099855 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099858 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099861 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099863 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099867 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099871 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099875 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099877 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099880 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099883 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099885 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099888 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:27:57.101844 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099891 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099894 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099897 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099899 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099902 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099904 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099907 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099910 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099912 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099915 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099918 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099920 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099923 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099926 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099928 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099931 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099934 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099939 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099943 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099947 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:27:57.102323 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099950 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099952 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099955 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099958 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099960 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099963 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099965 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099968 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099970 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099973 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099976 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099978 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099981 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099983 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099986 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099989 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099991 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:27:57.102831 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.099994 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.100000 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100092 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100097 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100100 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100102 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100105 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100108 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100110 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100113 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100115 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100118 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100121 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100125 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100129 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:27:57.103245 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100132 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100134 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100136 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100139 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100142 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100144 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100147 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100150 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100152 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100155 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100158 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100160 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100163 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100166 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100168 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100171 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100174 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100177 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100179 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100182 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:27:57.103637 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100184 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100187 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100189 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100192 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100194 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100197 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100199 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100202 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100204 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100207 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100210 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100213 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100215 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100217 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100220 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100223 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100225 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100228 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100230 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100232 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:27:57.104120 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100235 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100238 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100241 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100243 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100245 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100248 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100250 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100253 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100255 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100258 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100260 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100263 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100265 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100268 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100270 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100273 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100275 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100278 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100280 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100283 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:27:57.104628 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100286 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100288 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100291 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100294 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100296 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100299 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100302 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100306 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100310 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100312 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100315 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100318 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:57.100321 2575 feature_gate.go:328] unrecognized feature gate: Example May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.100326 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.101281 2575 server.go:962] "Client rotation is on, will bootstrap in background" May 28 10:27:57.105107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.104480 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 10:27:57.105623 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.105610 2575 server.go:1019] "Starting client certificate rotation" May 28 10:27:57.105720 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.105706 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 10:27:57.105749 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.105743 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 10:27:57.132652 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.132630 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 10:27:57.134620 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.134600 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 10:27:57.154925 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.154908 2575 log.go:25] "Validated CRI v1 runtime API" May 28 10:27:57.161546 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.161528 2575 log.go:25] "Validated CRI v1 image API" May 28 10:27:57.163187 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.163171 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 10:27:57.165799 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.165779 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 10:27:57.168211 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.168189 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b556f03-e828-42c2-b257-93ea4c447cf1:/dev/nvme0n1p3 9f2619ed-b888-4d58-aa54-91b216c4420b:/dev/nvme0n1p4] May 28 10:27:57.168286 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.168209 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 10:27:57.172998 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.172896 2575 manager.go:217] Machine: {Timestamp:2026-05-28 10:27:57.172366413 +0000 UTC m=+0.462810142 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099817 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea7a9d0b230b1186d3ce0e1b7d34a SystemUUID:ec2ea7a9-d0b2-30b1-186d-3ce0e1b7d34a BootID:88768a4a-40d7-48e5-9a74-b333d793827c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:1d:45:a8:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:1d:45:a8:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:5e:d5:56:65:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 10:27:57.173758 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.173748 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 10:27:57.173848 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.173836 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 10:27:57.176045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.176019 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 10:27:57.176184 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.176050 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 10:27:57.176232 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.176195 2575 topology_manager.go:138] "Creating topology manager with none policy" May 28 10:27:57.176232 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.176204 2575 container_manager_linux.go:306] "Creating device plugin manager" May 28 10:27:57.176232 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.176211 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 10:27:57.177197 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.177187 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 10:27:57.179690 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.179679 2575 state_mem.go:36] "Initialized new in-memory state store" May 28 10:27:57.179809 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.179800 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 10:27:57.182514 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.182505 2575 kubelet.go:491] "Attempting to sync node with API server" May 28 10:27:57.182554 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.182518 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 10:27:57.182554 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.182530 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 10:27:57.182554 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.182539 2575 kubelet.go:397] "Adding apiserver pod source" May 28 10:27:57.182554 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.182548 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 10:27:57.183830 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.183818 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 10:27:57.183868 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.183838 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 10:27:57.187269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.187252 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 10:27:57.189706 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.189689 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 10:27:57.190618 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190604 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190621 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190628 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190634 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190642 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190648 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190654 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190660 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190668 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 10:27:57.190696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190676 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 10:27:57.191014 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.190702 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 10:27:57.191194 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.191184 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 10:27:57.192092 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.192082 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 10:27:57.192092 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.192092 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 10:27:57.195482 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.195468 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 10:27:57.195539 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.195516 2575 server.go:1295] "Started kubelet" May 28 10:27:57.195688 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.195660 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 10:27:57.196098 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.196045 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 10:27:57.196206 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.196111 2575 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 10:27:57.196206 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.196120 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 10:27:57.196312 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.196293 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 10:27:57.196489 ip-10-0-141-178 systemd[1]: Started Kubernetes Kubelet. May 28 10:27:57.197002 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.196850 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 10:27:57.197659 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.197639 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 10:27:57.198909 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.198891 2575 server.go:317] "Adding debug handlers to kubelet server" May 28 10:27:57.204717 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.203522 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-178.ec2.internal.18b3b3e5c6314ddc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-178.ec2.internal,UID:ip-10-0-141-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-178.ec2.internal,},FirstTimestamp:2026-05-28 10:27:57.19548054 +0000 UTC m=+0.485924265,LastTimestamp:2026-05-28 10:27:57.19548054 +0000 UTC m=+0.485924265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-178.ec2.internal,}" May 28 10:27:57.207250 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.207231 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 10:27:57.208137 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.208118 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 10:27:57.208875 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.208801 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 10:27:57.209420 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209025 2575 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 10:27:57.209420 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209042 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 10:27:57.209420 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209140 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 10:27:57.209420 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209187 2575 reconstruct.go:97] "Volume reconstruction finished" May 28 10:27:57.209420 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209195 2575 reconciler.go:26] "Reconciler: start to sync state" May 28 10:27:57.209642 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209541 2575 factory.go:55] Registering systemd factory May 28 10:27:57.209642 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209553 2575 factory.go:223] Registration of the systemd container factory successfully May 28 10:27:57.209749 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209732 2575 factory.go:153] Registering CRI-O factory May 28 10:27:57.209749 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209751 2575 factory.go:223] Registration of the crio container factory successfully May 28 10:27:57.209867 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209804 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 10:27:57.209867 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209822 2575 factory.go:103] Registering Raw factory May 28 10:27:57.209867 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.209835 2575 manager.go:1196] Started watching for new ooms in manager May 28 10:27:57.209990 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.209963 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.210554 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.210539 2575 manager.go:319] Starting recovery of all containers May 28 10:27:57.210787 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.210764 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 28 10:27:57.210899 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.210880 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 10:27:57.216541 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.216515 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lsxdm" May 28 10:27:57.218904 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.218788 2575 manager.go:324] Recovery completed May 28 10:27:57.220337 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.220305 2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 28 10:27:57.222760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.222743 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lsxdm" May 28 10:27:57.223397 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.223385 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.225489 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.225474 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.225553 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.225502 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.225553 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.225512 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.226057 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.226039 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 10:27:57.226057 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.226056 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 10:27:57.226159 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.226075 2575 state_mem.go:36] "Initialized new in-memory state store" May 28 10:27:57.230166 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.230153 2575 policy_none.go:49] "None policy: Start" May 28 10:27:57.230221 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.230170 2575 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 10:27:57.230221 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.230181 2575 state_mem.go:35] "Initializing new in-memory state store" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275044 2575 manager.go:341] "Starting Device Plugin manager" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.275073 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275083 2575 server.go:85] "Starting device plugin registration server" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275315 2575 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275324 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275468 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275543 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.275550 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.276207 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 10:27:57.283501 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.276249 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.299191 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.299151 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 10:27:57.300363 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.300349 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 10:27:57.300411 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.300380 2575 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 10:27:57.300411 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.300398 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 10:27:57.300411 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.300404 2575 kubelet.go:2451] "Starting kubelet main sync loop" May 28 10:27:57.300546 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.300455 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 10:27:57.303002 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.302984 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:27:57.375741 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.375644 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.376629 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.376612 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.376736 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.376642 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.376736 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.376652 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.376736 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.376675 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-178.ec2.internal" May 28 10:27:57.385950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.385931 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-178.ec2.internal" May 28 10:27:57.385950 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.385953 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-178.ec2.internal\": node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.401214 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.401173 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal"] May 28 10:27:57.401308 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.401248 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.402547 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.402533 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.402611 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.402559 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.402611 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.402574 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.403667 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.403656 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.403752 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.403734 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.403815 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.403801 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.403851 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.403832 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.404320 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404304 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.404367 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404333 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.404367 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404344 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.404456 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404304 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.404456 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404401 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.404456 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.404416 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.405408 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.405395 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:57.405466 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.405423 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:27:57.406063 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.406050 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientMemory" May 28 10:27:57.406116 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.406077 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:27:57.406116 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.406098 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeHasSufficientPID" May 28 10:27:57.422975 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.422954 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-178.ec2.internal\" not found" node="ip-10-0-141-178.ec2.internal" May 28 10:27:57.426560 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.426546 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-178.ec2.internal\" not found" node="ip-10-0-141-178.ec2.internal" May 28 10:27:57.504163 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.504135 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.510400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.510377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.510475 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.510406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.510518 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.510429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9378f2db33647a17188b12c706cbe771-config\") pod \"kube-apiserver-proxy-ip-10-0-141-178.ec2.internal\" (UID: \"9378f2db33647a17188b12c706cbe771\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:57.604898 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.604865 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.611165 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611142 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.611225 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611206 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.611269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611258 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.611302 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611283 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9378f2db33647a17188b12c706cbe771-config\") pod \"kube-apiserver-proxy-ip-10-0-141-178.ec2.internal\" (UID: \"9378f2db33647a17188b12c706cbe771\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:57.611337 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611311 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9378f2db33647a17188b12c706cbe771-config\") pod \"kube-apiserver-proxy-ip-10-0-141-178.ec2.internal\" (UID: \"9378f2db33647a17188b12c706cbe771\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:57.611369 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.611353 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20a162883e61fed67ce6c61168757c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal\" (UID: \"bc20a162883e61fed67ce6c61168757c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.705626 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.705555 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.726007 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.725978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:57.728741 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:57.728723 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:57.806366 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.806332 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:57.906841 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:57.906813 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.007346 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.007317 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.104951 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.104915 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 10:27:58.105400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.105062 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 10:27:58.108070 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.108051 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.208369 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.208334 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 10:27:58.208369 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.208355 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.218591 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.218568 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 10:27:58.224738 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.224713 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 10:22:57 +0000 UTC" deadline="2028-01-15 22:39:46.84307563 +0000 UTC" May 28 10:27:58.224738 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.224735 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14340h11m48.618342623s" May 28 10:27:58.242589 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.242569 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v26kk" May 28 10:27:58.248816 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.248794 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v26kk" May 28 10:27:58.304740 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:58.304705 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc20a162883e61fed67ce6c61168757c.slice/crio-963eb98ba843e14b169344d87987146c457e17ca0005d829e5053e00781294f8 WatchSource:0}: Error finding container 963eb98ba843e14b169344d87987146c457e17ca0005d829e5053e00781294f8: Status 404 returned error can't find the container with id 963eb98ba843e14b169344d87987146c457e17ca0005d829e5053e00781294f8 May 28 10:27:58.304946 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:58.304931 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9378f2db33647a17188b12c706cbe771.slice/crio-a0ac1b11c8eee0d889d51a74a093a762f7fb0494d11e1245af941fc7ddba4721 WatchSource:0}: Error finding container a0ac1b11c8eee0d889d51a74a093a762f7fb0494d11e1245af941fc7ddba4721: Status 404 returned error can't find the container with id a0ac1b11c8eee0d889d51a74a093a762f7fb0494d11e1245af941fc7ddba4721 May 28 10:27:58.307389 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.307371 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 10:27:58.309076 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.309060 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.409986 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.409949 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.510330 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.510301 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.523581 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.523558 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:27:58.610963 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.610887 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.627789 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.627764 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:27:58.711376 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:58.711351 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-178.ec2.internal\" not found" May 28 10:27:58.797760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.797730 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:27:58.810235 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.810050 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" May 28 10:27:58.825450 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.825420 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 10:27:58.826748 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.826726 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" May 28 10:27:58.836309 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:58.836241 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 10:27:59.184457 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.184408 2575 apiserver.go:52] "Watching apiserver" May 28 10:27:59.190751 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.190730 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 10:27:59.191143 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.191114 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-q6k6z","openshift-ovn-kubernetes/ovnkube-node-25trz","kube-system/konnectivity-agent-7ltqz","kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh","openshift-cluster-node-tuning-operator/tuned-7qhcd","openshift-image-registry/node-ca-q9cds","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-h9m72","openshift-network-diagnostics/network-check-target-tsc9d","openshift-multus/multus-5vnv2","openshift-multus/network-metrics-daemon-tb2q6"] May 28 10:27:59.193882 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.193861 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.196004 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.195986 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.196698 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.196676 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 10:27:59.196792 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.196676 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 10:27:59.196792 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.196750 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 10:27:59.197054 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.197039 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xn8hs\"" May 28 10:27:59.198115 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.198095 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.199671 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.199921 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200240 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nncd5\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200731 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200825 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200925 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200931 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 10:27:59.201306 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.200979 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 10:27:59.201806 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.201452 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 10:27:59.201806 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.201496 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.202260 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.202238 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tkzm4\"" May 28 10:27:59.204651 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.204632 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 10:27:59.204829 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.204815 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8lwt7\"" May 28 10:27:59.205058 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.205046 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 10:27:59.205203 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.205191 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 10:27:59.206789 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.206771 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.209049 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.208980 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ns2bt\"" May 28 10:27:59.209049 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.209035 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 10:27:59.209293 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.209130 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 10:27:59.210700 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.210684 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.210812 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.210794 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.213123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213106 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 10:27:59.213414 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213397 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 10:27:59.213550 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213535 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j2thq\"" May 28 10:27:59.213814 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213793 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 10:27:59.213927 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213910 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wbq9p\"" May 28 10:27:59.214083 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213919 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 10:27:59.214164 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.214095 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 10:27:59.214164 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.213986 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 10:27:59.214164 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.214026 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 10:27:59.214316 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.214034 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 10:27:59.214316 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.214050 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:27:59.214407 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.214306 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:27:59.219331 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.219424 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-systemd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.219424 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-env-overrides\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.219424 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysconfig\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-tmp\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219488 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjjvg\" (UniqueName: \"kubernetes.io/projected/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-kube-api-access-mjjvg\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219516 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vnv2" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-script-lib\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.219550 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-var-lib-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.219617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-tuned\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7s7\" (UniqueName: \"kubernetes.io/projected/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kube-api-access-df7s7\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggl9\" (UniqueName: \"kubernetes.io/projected/d291a890-2702-49cf-aaf5-f9b5a809f4f6-kube-api-access-hggl9\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-conf\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-run\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-node-log\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-netd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-lib-modules\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-host-slash\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db5eab28-bc03-4a6d-9581-2a60eb5535f2-konnectivity-ca\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.219983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-bin\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-modprobe-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-host\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.220171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-serviceca\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-etc-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-ovn\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220184 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqmrs\" (UniqueName: \"kubernetes.io/projected/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-kube-api-access-nqmrs\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-kubernetes\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-sys\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-var-lib-kubelet\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-host\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-slash\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-log-socket\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2rrp\" (UniqueName: \"kubernetes.io/projected/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-kube-api-access-l2rrp\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db5eab28-bc03-4a6d-9581-2a60eb5535f2-agent-certs\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.220917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cnibin\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-os-release\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-netns\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-config\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-device-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9zn4\" (UniqueName: \"kubernetes.io/projected/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-kube-api-access-f9zn4\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-iptables-alerter-script\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovn-node-metrics-cert\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-kubelet\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-systemd-units\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.221695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.220949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-systemd\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.222403 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.222119 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 10:27:59.222403 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.222153 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fj7hg\"" May 28 10:27:59.249711 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.249679 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:22:58 +0000 UTC" deadline="2028-02-14 14:28:28.250705662 +0000 UTC" May 28 10:27:59.249817 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.249782 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15052h0m29.000930227s" May 28 10:27:59.304950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.304895 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" event={"ID":"9378f2db33647a17188b12c706cbe771","Type":"ContainerStarted","Data":"a0ac1b11c8eee0d889d51a74a093a762f7fb0494d11e1245af941fc7ddba4721"} May 28 10:27:59.305987 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.305964 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" event={"ID":"bc20a162883e61fed67ce6c61168757c","Type":"ContainerStarted","Data":"963eb98ba843e14b169344d87987146c457e17ca0005d829e5053e00781294f8"} May 28 10:27:59.310986 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.310964 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 10:27:59.321157 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtv4p\" (UniqueName: \"kubernetes.io/projected/f78e8d15-bb0c-4ade-9152-cd547c8e9731-kube-api-access-dtv4p\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.321269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321175 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321201 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-lib-modules\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.321269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cnibin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.321395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.321395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321385 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-host-slash\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-lib-modules\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321402 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db5eab28-bc03-4a6d-9581-2a60eb5535f2-konnectivity-ca\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321428 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-host-slash\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-bin\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321479 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-modprobe-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-host\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.321527 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321511 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-serviceca\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-system-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-host\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-modprobe-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321659 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-etc-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-bin\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-ovn\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321704 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-etc-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321744 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-ovn\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321707 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqmrs\" (UniqueName: \"kubernetes.io/projected/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-kube-api-access-nqmrs\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.321781 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-conf-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-multus-certs\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2qr\" (UniqueName: \"kubernetes.io/projected/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-kube-api-access-xz2qr\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321883 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-kubernetes\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321906 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321929 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-sys\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-var-lib-kubelet\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-kubernetes\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.321976 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-host\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db5eab28-bc03-4a6d-9581-2a60eb5535f2-konnectivity-ca\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-serviceca\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322017 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-slash\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-host\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322048 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-sys\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-slash\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-var-lib-kubelet\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322129 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322154 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322196 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322172 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-d\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322205 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-registration-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322214 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322251 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-log-socket\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-socket-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-hostroot\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-log-socket\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322311 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2rrp\" (UniqueName: \"kubernetes.io/projected/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-kube-api-access-l2rrp\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-sys-fs\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322330 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db5eab28-bc03-4a6d-9581-2a60eb5535f2-agent-certs\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cnibin\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-os-release\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322389 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-netns\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322414 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-config\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322423 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cnibin\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322451 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-device-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322489 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9zn4\" (UniqueName: \"kubernetes.io/projected/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-kube-api-access-f9zn4\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.322994 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322488 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-os-release\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-socket-dir-parent\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322539 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-iptables-alerter-script\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-device-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322565 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322591 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322616 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovn-node-metrics-cert\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-os-release\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322663 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-kubelet\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322738 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322764 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-kubelet\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322789 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-systemd-units\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322814 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-systemd\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-etc-kubernetes\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322931 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-systemd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.323793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-config\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322955 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-env-overrides\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.322985 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysconfig\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-tmp\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-systemd-units\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cni-binary-copy\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-daemon-config\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323113 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-iptables-alerter-script\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323120 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjjvg\" (UniqueName: \"kubernetes.io/projected/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-kube-api-access-mjjvg\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323145 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-run-netns\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-script-lib\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-netns\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-systemd\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.324585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-etc-selinux\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-kubelet\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323425 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-systemd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-system-cni-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-bin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323518 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323543 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-var-lib-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323570 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-tuned\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323599 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df7s7\" (UniqueName: \"kubernetes.io/projected/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kube-api-access-df7s7\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323628 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hggl9\" (UniqueName: \"kubernetes.io/projected/d291a890-2702-49cf-aaf5-f9b5a809f4f6-kube-api-access-hggl9\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323719 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-env-overrides\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323712 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323717 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323774 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysconfig\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.323997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovnkube-script-lib\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324059 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-conf\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-var-lib-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324100 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-run\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-run\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-k8s-cni-cncf-io\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324182 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-node-log\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324189 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-sysctl-conf\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-multus\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324247 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324273 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-netd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-run-openvswitch\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-node-log\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.325908 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.324354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d291a890-2702-49cf-aaf5-f9b5a809f4f6-host-cni-netd\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.326794 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.326773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-tmp\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.326951 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.326925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d291a890-2702-49cf-aaf5-f9b5a809f4f6-ovn-node-metrics-cert\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.327055 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.327038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db5eab28-bc03-4a6d-9581-2a60eb5535f2-agent-certs\") pod \"konnectivity-agent-7ltqz\" (UID: \"db5eab28-bc03-4a6d-9581-2a60eb5535f2\") " pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.327210 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.327189 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-etc-tuned\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.330632 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.330606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9zn4\" (UniqueName: \"kubernetes.io/projected/ab33eeb6-d933-4ada-b0d3-f443b2e02a62-kube-api-access-f9zn4\") pod \"tuned-7qhcd\" (UID: \"ab33eeb6-d933-4ada-b0d3-f443b2e02a62\") " pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.330745 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.330725 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqmrs\" (UniqueName: \"kubernetes.io/projected/73176d5b-f86b-4085-ac7d-f21bc8ca8ca9-kube-api-access-nqmrs\") pod \"node-ca-q9cds\" (UID: \"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9\") " pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.330817 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.330783 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2rrp\" (UniqueName: \"kubernetes.io/projected/d52c4310-0a82-4e6b-98d6-8e25eda1cf05-kube-api-access-l2rrp\") pod \"iptables-alerter-q6k6z\" (UID: \"d52c4310-0a82-4e6b-98d6-8e25eda1cf05\") " pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.331731 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.331710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7s7\" (UniqueName: \"kubernetes.io/projected/3c9bc805-1de3-443d-a2c4-595d3b41cfe5-kube-api-access-df7s7\") pod \"aws-ebs-csi-driver-node-dpmgh\" (UID: \"3c9bc805-1de3-443d-a2c4-595d3b41cfe5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.332661 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.332643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjjvg\" (UniqueName: \"kubernetes.io/projected/f16c5677-e975-4784-9ae0-9a8ff8ba1c9d-kube-api-access-mjjvg\") pod \"multus-additional-cni-plugins-h9m72\" (UID: \"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d\") " pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.332857 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.332833 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggl9\" (UniqueName: \"kubernetes.io/projected/d291a890-2702-49cf-aaf5-f9b5a809f4f6-kube-api-access-hggl9\") pod \"ovnkube-node-25trz\" (UID: \"d291a890-2702-49cf-aaf5-f9b5a809f4f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.418985 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.418953 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:27:59.425329 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425267 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-hostroot\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425329 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425337 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-socket-dir-parent\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425355 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-os-release\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-hostroot\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425370 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-kubelet\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-kubelet\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-etc-kubernetes\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425883 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-etc-kubernetes\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425883 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-socket-dir-parent\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425883 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425803 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cni-binary-copy\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425883 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425839 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-daemon-config\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.425883 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-os-release\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425909 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425951 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-netns\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.425983 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-bin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426014 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-k8s-cni-cncf-io\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426047 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-multus\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426087 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtv4p\" (UniqueName: \"kubernetes.io/projected/f78e8d15-bb0c-4ade-9152-cd547c8e9731-kube-api-access-dtv4p\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.426123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cnibin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426153 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-system-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426212 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426245 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-conf-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426276 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-multus-certs\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426470 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426305 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2qr\" (UniqueName: \"kubernetes.io/projected/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-kube-api-access-xz2qr\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426470 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cni-binary-copy\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426504 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-netns\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426557 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-bin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-k8s-cni-cncf-io\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.426783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426650 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-var-lib-cni-multus\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427056 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426837 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-system-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427056 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.426910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-cnibin\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427056 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.427013 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-cni-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427056 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.427012 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:27:59.427252 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.427073 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-conf-dir\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427252 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.427106 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:27:59.927063275 +0000 UTC m=+3.217507001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:27:59.427252 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.427124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-host-run-multus-certs\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.427517 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.427247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-multus-daemon-config\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.433727 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.433704 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:27:59.433727 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.433725 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:27:59.433903 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.433735 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:27:59.433903 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.433783 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:27:59.933770049 +0000 UTC m=+3.224213761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:27:59.436043 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.435974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2qr\" (UniqueName: \"kubernetes.io/projected/158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7-kube-api-access-xz2qr\") pod \"multus-5vnv2\" (UID: \"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7\") " pod="openshift-multus/multus-5vnv2" May 28 10:27:59.436151 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.436064 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtv4p\" (UniqueName: \"kubernetes.io/projected/f78e8d15-bb0c-4ade-9152-cd547c8e9731-kube-api-access-dtv4p\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.510491 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.510456 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q6k6z" May 28 10:27:59.520400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.520363 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:27:59.530193 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.530172 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:27:59.535835 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.535814 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" May 28 10:27:59.543400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.543376 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" May 28 10:27:59.550954 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.550932 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q9cds" May 28 10:27:59.558504 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.558488 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9m72" May 28 10:27:59.564065 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.564048 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vnv2" May 28 10:27:59.929481 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:27:59.929420 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:27:59.929662 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.929569 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:27:59.929662 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:27:59.929650 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:00.9296345 +0000 UTC m=+4.220078219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:27:59.946972 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.946926 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab33eeb6_d933_4ada_b0d3_f443b2e02a62.slice/crio-9d5d6907783070a5c5dba8eecab0e710ca8a4128b7d1f2874f7768a15485b50a WatchSource:0}: Error finding container 9d5d6907783070a5c5dba8eecab0e710ca8a4128b7d1f2874f7768a15485b50a: Status 404 returned error can't find the container with id 9d5d6907783070a5c5dba8eecab0e710ca8a4128b7d1f2874f7768a15485b50a May 28 10:27:59.948281 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.948257 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52c4310_0a82_4e6b_98d6_8e25eda1cf05.slice/crio-6c63519dbb76e6cffa009ae71df3a5fb1b0cb02e019bcafffaa1763b6699b670 WatchSource:0}: Error finding container 6c63519dbb76e6cffa009ae71df3a5fb1b0cb02e019bcafffaa1763b6699b670: Status 404 returned error can't find the container with id 6c63519dbb76e6cffa009ae71df3a5fb1b0cb02e019bcafffaa1763b6699b670 May 28 10:27:59.951173 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.951151 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5eab28_bc03_4a6d_9581_2a60eb5535f2.slice/crio-41afd60340fa97a432359ee8f49afb63ea36d795952eb4fe9456970cfad115e2 WatchSource:0}: Error finding container 41afd60340fa97a432359ee8f49afb63ea36d795952eb4fe9456970cfad115e2: Status 404 returned error can't find the container with id 41afd60340fa97a432359ee8f49afb63ea36d795952eb4fe9456970cfad115e2 May 28 10:27:59.951916 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.951782 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16c5677_e975_4784_9ae0_9a8ff8ba1c9d.slice/crio-a28544006c8123ff1d9238c0a6975540b42a2ace877d2a7c82b7b2ee1b6d2877 WatchSource:0}: Error finding container a28544006c8123ff1d9238c0a6975540b42a2ace877d2a7c82b7b2ee1b6d2877: Status 404 returned error can't find the container with id a28544006c8123ff1d9238c0a6975540b42a2ace877d2a7c82b7b2ee1b6d2877 May 28 10:27:59.952467 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.952429 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd291a890_2702_49cf_aaf5_f9b5a809f4f6.slice/crio-882791b0f6aecd5a57b456f527240b28b0f9726124c716ad0b3925258d88cdbb WatchSource:0}: Error finding container 882791b0f6aecd5a57b456f527240b28b0f9726124c716ad0b3925258d88cdbb: Status 404 returned error can't find the container with id 882791b0f6aecd5a57b456f527240b28b0f9726124c716ad0b3925258d88cdbb May 28 10:27:59.953709 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.953605 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158c42b2_3c1d_4f9b_9c9c_1f1b4f2606d7.slice/crio-dc0b6c1061627dbde04a5a0b23bee059560bbb71ebb016c527be10a1ced9671a WatchSource:0}: Error finding container dc0b6c1061627dbde04a5a0b23bee059560bbb71ebb016c527be10a1ced9671a: Status 404 returned error can't find the container with id dc0b6c1061627dbde04a5a0b23bee059560bbb71ebb016c527be10a1ced9671a May 28 10:27:59.954336 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.954317 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73176d5b_f86b_4085_ac7d_f21bc8ca8ca9.slice/crio-24c86c84ae831a7da4845161c63092a2b03f59da41d0e316c4d9b9a4bf016cf1 WatchSource:0}: Error finding container 24c86c84ae831a7da4845161c63092a2b03f59da41d0e316c4d9b9a4bf016cf1: Status 404 returned error can't find the container with id 24c86c84ae831a7da4845161c63092a2b03f59da41d0e316c4d9b9a4bf016cf1 May 28 10:27:59.956172 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:27:59.956107 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9bc805_1de3_443d_a2c4_595d3b41cfe5.slice/crio-770a7ca1372b383c8c44122e789b6bc1bc5bebf746b2c40172b5a2cb81a0f6fb WatchSource:0}: Error finding container 770a7ca1372b383c8c44122e789b6bc1bc5bebf746b2c40172b5a2cb81a0f6fb: Status 404 returned error can't find the container with id 770a7ca1372b383c8c44122e789b6bc1bc5bebf746b2c40172b5a2cb81a0f6fb May 28 10:28:00.029922 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.029894 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:00.030039 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.030015 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:28:00.030099 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.030039 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:28:00.030099 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.030062 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:00.030172 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.030113 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:01.030094886 +0000 UTC m=+4.320538620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:00.250184 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.250026 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:22:58 +0000 UTC" deadline="2027-10-25 23:59:46.915121014 +0000 UTC" May 28 10:28:00.250184 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.250182 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12373h31m46.664942215s" May 28 10:28:00.300819 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.300785 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:00.300963 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.300916 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:00.308790 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.308760 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" event={"ID":"ab33eeb6-d933-4ada-b0d3-f443b2e02a62","Type":"ContainerStarted","Data":"9d5d6907783070a5c5dba8eecab0e710ca8a4128b7d1f2874f7768a15485b50a"} May 28 10:28:00.309623 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.309605 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" event={"ID":"3c9bc805-1de3-443d-a2c4-595d3b41cfe5","Type":"ContainerStarted","Data":"770a7ca1372b383c8c44122e789b6bc1bc5bebf746b2c40172b5a2cb81a0f6fb"} May 28 10:28:00.310536 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.310518 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"882791b0f6aecd5a57b456f527240b28b0f9726124c716ad0b3925258d88cdbb"} May 28 10:28:00.311475 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.311456 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ltqz" event={"ID":"db5eab28-bc03-4a6d-9581-2a60eb5535f2","Type":"ContainerStarted","Data":"41afd60340fa97a432359ee8f49afb63ea36d795952eb4fe9456970cfad115e2"} May 28 10:28:00.312259 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.312242 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q6k6z" event={"ID":"d52c4310-0a82-4e6b-98d6-8e25eda1cf05","Type":"ContainerStarted","Data":"6c63519dbb76e6cffa009ae71df3a5fb1b0cb02e019bcafffaa1763b6699b670"} May 28 10:28:00.313520 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.313502 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" event={"ID":"9378f2db33647a17188b12c706cbe771","Type":"ContainerStarted","Data":"f8509818cc6e2ca63677436a0225699a4063448932e10dc60160c9760715df97"} May 28 10:28:00.314772 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.314755 2575 generic.go:358] "Generic (PLEG): container finished" podID="bc20a162883e61fed67ce6c61168757c" containerID="96d0bd183941e26c3e111eac89cec9ae024baf0efac50fefb10b084b833cad6b" exitCode=0 May 28 10:28:00.314854 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.314805 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" event={"ID":"bc20a162883e61fed67ce6c61168757c","Type":"ContainerDied","Data":"96d0bd183941e26c3e111eac89cec9ae024baf0efac50fefb10b084b833cad6b"} May 28 10:28:00.315785 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.315765 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerStarted","Data":"a28544006c8123ff1d9238c0a6975540b42a2ace877d2a7c82b7b2ee1b6d2877"} May 28 10:28:00.316670 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.316649 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q9cds" event={"ID":"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9","Type":"ContainerStarted","Data":"24c86c84ae831a7da4845161c63092a2b03f59da41d0e316c4d9b9a4bf016cf1"} May 28 10:28:00.317601 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.317583 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vnv2" event={"ID":"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7","Type":"ContainerStarted","Data":"dc0b6c1061627dbde04a5a0b23bee059560bbb71ebb016c527be10a1ced9671a"} May 28 10:28:00.341827 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.341773 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-178.ec2.internal" podStartSLOduration=2.341754413 podStartE2EDuration="2.341754413s" podCreationTimestamp="2026-05-28 10:27:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:00.326919142 +0000 UTC m=+3.617362878" watchObservedRunningTime="2026-05-28 10:28:00.341754413 +0000 UTC m=+3.632198148" May 28 10:28:00.951863 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:00.951259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:00.951863 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.951415 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:00.951863 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:00.951499 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:02.951478991 +0000 UTC m=+6.241922709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:01.052567 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:01.052529 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:01.052743 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:01.052725 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:28:01.052805 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:01.052745 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:28:01.052805 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:01.052757 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:01.052899 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:01.052815 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:03.052796636 +0000 UTC m=+6.343240361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:01.305709 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:01.305648 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:01.306155 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:01.305768 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:01.333745 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:01.333498 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" event={"ID":"bc20a162883e61fed67ce6c61168757c","Type":"ContainerStarted","Data":"79cd75572ceea33492959abb54df9a63431fbd8cb3d0b29e240437ed0bad6acb"} May 28 10:28:01.347568 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:01.346665 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-178.ec2.internal" podStartSLOduration=3.346649946 podStartE2EDuration="3.346649946s" podCreationTimestamp="2026-05-28 10:27:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:01.346525835 +0000 UTC m=+4.636969570" watchObservedRunningTime="2026-05-28 10:28:01.346649946 +0000 UTC m=+4.637093681" May 28 10:28:02.301131 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:02.301097 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:02.301365 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:02.301248 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:02.969087 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:02.969049 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:02.969617 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:02.969190 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:02.969617 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:02.969254 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:06.969236178 +0000 UTC m=+10.259679891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:03.070953 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:03.070340 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:03.070953 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:03.070535 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:28:03.070953 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:03.070554 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:28:03.070953 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:03.070567 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:03.070953 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:03.070625 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:07.070608101 +0000 UTC m=+10.361051817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:03.305344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:03.304879 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:03.305344 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:03.304995 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:04.301359 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:04.300883 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:04.301359 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:04.301018 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:05.301418 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:05.300927 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:05.301418 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:05.301047 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:06.301150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:06.301116 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:06.301377 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:06.301267 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:07.003587 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:07.003547 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:07.004073 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.003699 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:07.004073 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.003771 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:15.003749969 +0000 UTC m=+18.294193686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:07.104193 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:07.104153 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:07.104371 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.104348 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:28:07.104434 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.104377 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:28:07.104434 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.104392 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:07.104550 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.104473 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:15.1044584 +0000 UTC m=+18.394902117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:07.301618 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:07.301545 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:07.301760 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:07.301666 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:08.301530 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:08.301492 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:08.301953 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:08.301633 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:09.300880 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:09.300839 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:09.301075 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:09.300979 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:10.300694 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:10.300663 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:10.301080 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:10.300770 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:11.301355 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:11.301316 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:11.301814 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:11.301454 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:12.300589 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:12.300550 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:12.300769 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:12.300661 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:13.301043 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:13.300988 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:13.301532 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:13.301117 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:14.300620 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:14.300588 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:14.300911 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:14.300738 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:15.059326 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:15.059294 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:15.059800 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.059404 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:15.059800 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.059481 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.059461047 +0000 UTC m=+34.349904763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:15.160552 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:15.160508 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:15.160736 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.160710 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:28:15.160797 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.160739 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:28:15.160797 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.160753 2575 projected.go:194] Error preparing data for projected volume kube-api-access-n2dhx for pod openshift-network-diagnostics/network-check-target-tsc9d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:15.160893 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.160812 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx podName:cff501bb-534f-42a4-89b6-20405e12d0d0 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.160795333 +0000 UTC m=+34.451239047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2dhx" (UniqueName: "kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx") pod "network-check-target-tsc9d" (UID: "cff501bb-534f-42a4-89b6-20405e12d0d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:28:15.300989 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:15.300957 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:15.301175 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:15.301081 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:16.300864 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:16.300830 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:16.301323 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:16.300953 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:17.302014 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:17.301990 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:17.302348 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:17.302071 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:18.301014 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.300728 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:18.301141 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:18.301122 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:18.362505 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.362474 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" event={"ID":"ab33eeb6-d933-4ada-b0d3-f443b2e02a62","Type":"ContainerStarted","Data":"1ce2062f3785219dcd0716688331e198ae8ffb270456204a9980ca82d73a20e6"} May 28 10:28:18.363828 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.363804 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" event={"ID":"3c9bc805-1de3-443d-a2c4-595d3b41cfe5","Type":"ContainerStarted","Data":"a23d8d0c15db67f98c57cf010dcaf8ba71d9f947183ccf6ec71a33c784a7803e"} May 28 10:28:18.366469 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366433 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"ad162d7f58594acdc4503ef5effe455d4d38346a077e95d976972ab76ad1c1ef"} May 28 10:28:18.366558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366475 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"052b5775adbe5c4092189cb5af5292657913354e2b44788a180406292f9b9ce4"} May 28 10:28:18.366558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366486 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"5feedde50646a3f5bfe8dbcf587a80b0064b8b4801291da79fca26d9b0107b6f"} May 28 10:28:18.366558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366499 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"dfab7197c482512bf418e3e6a5d20cf78ccbfb7f1b4cb31f7f45c42648d9f78a"} May 28 10:28:18.366558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366511 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"2c5f5a6e3295572cf268ee16200812aab18b35f842e796a023aeb6bd9b29bda2"} May 28 10:28:18.366558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.366523 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"9bff6b5ef7b88607ed68cc023d7058d361a6590f45fd30628bbb73f3f0c248c8"} May 28 10:28:18.367673 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.367650 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ltqz" event={"ID":"db5eab28-bc03-4a6d-9581-2a60eb5535f2","Type":"ContainerStarted","Data":"4a1758904b85c8a393e8733650ba09fa1e7fe14ff088ad4fca9ed974bc45a142"} May 28 10:28:18.369350 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.369317 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="f7fa60a8262a2ab06c57e7cc8573ea952c2a151ac182e83e53a0b638ec5e3d3f" exitCode=0 May 28 10:28:18.372176 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.369679 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"f7fa60a8262a2ab06c57e7cc8573ea952c2a151ac182e83e53a0b638ec5e3d3f"} May 28 10:28:18.373782 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.373758 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q9cds" event={"ID":"73176d5b-f86b-4085-ac7d-f21bc8ca8ca9","Type":"ContainerStarted","Data":"208b1b15f175691f851b06f5fd480819182db27b96f6479e8d9905f67438ab3b"} May 28 10:28:18.375343 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.375318 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vnv2" event={"ID":"158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7","Type":"ContainerStarted","Data":"c91230f88d5c6774e79a03b427fe35d3931722100de460d88998dfb5b9177df3"} May 28 10:28:18.377952 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.377917 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7qhcd" podStartSLOduration=3.5680607220000002 podStartE2EDuration="21.377906896s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.949423907 +0000 UTC m=+3.239867621" lastFinishedPulling="2026-05-28 10:28:17.75927008 +0000 UTC m=+21.049713795" observedRunningTime="2026-05-28 10:28:18.377260546 +0000 UTC m=+21.667704283" watchObservedRunningTime="2026-05-28 10:28:18.377906896 +0000 UTC m=+21.668350629" May 28 10:28:18.390809 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.390773 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7ltqz" podStartSLOduration=3.5845216989999997 podStartE2EDuration="21.390763311s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.953029601 +0000 UTC m=+3.243473312" lastFinishedPulling="2026-05-28 10:28:17.759271201 +0000 UTC m=+21.049714924" observedRunningTime="2026-05-28 10:28:18.390540836 +0000 UTC m=+21.680984574" watchObservedRunningTime="2026-05-28 10:28:18.390763311 +0000 UTC m=+21.681207055" May 28 10:28:18.445603 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.445557 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q9cds" podStartSLOduration=3.64280016 podStartE2EDuration="21.445541483s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.956530659 +0000 UTC m=+3.246974372" lastFinishedPulling="2026-05-28 10:28:17.759271978 +0000 UTC m=+21.049715695" observedRunningTime="2026-05-28 10:28:18.405776044 +0000 UTC m=+21.696219779" watchObservedRunningTime="2026-05-28 10:28:18.445541483 +0000 UTC m=+21.735985234" May 28 10:28:18.797334 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.797299 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:28:18.797968 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.797951 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:28:18.812386 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:18.812343 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5vnv2" podStartSLOduration=3.990954872 podStartE2EDuration="21.812330564s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.955412427 +0000 UTC m=+3.245856144" lastFinishedPulling="2026-05-28 10:28:17.776788124 +0000 UTC m=+21.067231836" observedRunningTime="2026-05-28 10:28:18.465756485 +0000 UTC m=+21.756200218" watchObservedRunningTime="2026-05-28 10:28:18.812330564 +0000 UTC m=+22.102774353" May 28 10:28:19.095774 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.095748 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 10:28:19.287434 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.287112 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T10:28:19.095769823Z","UUID":"dc069393-d837-4c11-88e8-d15d7f0158e8","Handler":null,"Name":"","Endpoint":""} May 28 10:28:19.291340 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.291316 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 10:28:19.291340 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.291348 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 10:28:19.301299 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.301272 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:19.301411 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:19.301391 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:19.379413 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.379327 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" event={"ID":"3c9bc805-1de3-443d-a2c4-595d3b41cfe5","Type":"ContainerStarted","Data":"e08f3ced1ed56192d3a83bb6886177a48db620846b0a1373e3a434fc71d5e5ff"} May 28 10:28:19.380807 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.380746 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q6k6z" event={"ID":"d52c4310-0a82-4e6b-98d6-8e25eda1cf05","Type":"ContainerStarted","Data":"258f1d4462597d11dfec9b26855045b6ad7c08b92da5dacee263519eb79839da"} May 28 10:28:19.381403 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.381377 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:28:19.381679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.381648 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ltqz" May 28 10:28:19.408694 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:19.408638 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q6k6z" podStartSLOduration=4.597425648 podStartE2EDuration="22.408618129s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.950298581 +0000 UTC m=+3.240742293" lastFinishedPulling="2026-05-28 10:28:17.761491045 +0000 UTC m=+21.051934774" observedRunningTime="2026-05-28 10:28:19.408043333 +0000 UTC m=+22.698487069" watchObservedRunningTime="2026-05-28 10:28:19.408618129 +0000 UTC m=+22.699061864" May 28 10:28:20.300800 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:20.300765 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:20.300991 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:20.300891 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:20.384970 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:20.384938 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" event={"ID":"3c9bc805-1de3-443d-a2c4-595d3b41cfe5","Type":"ContainerStarted","Data":"684a445a0fc948989d4f1c6995a397952e92a85a87520254d31e8e17b14bc1e2"} May 28 10:28:20.404887 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:20.404829 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dpmgh" podStartSLOduration=3.533456383 podStartE2EDuration="23.404810655s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.957801224 +0000 UTC m=+3.248244936" lastFinishedPulling="2026-05-28 10:28:19.829155485 +0000 UTC m=+23.119599208" observedRunningTime="2026-05-28 10:28:20.404496693 +0000 UTC m=+23.694940434" watchObservedRunningTime="2026-05-28 10:28:20.404810655 +0000 UTC m=+23.695254389" May 28 10:28:21.300668 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.300637 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:21.300885 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:21.300765 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:21.309497 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.309467 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-p545l"] May 28 10:28:21.313860 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.313841 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.316539 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.316504 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t5mcj\"" May 28 10:28:21.316539 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.316521 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 10:28:21.316705 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.316506 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 10:28:21.389770 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.389731 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"bb4fa5c539541714f0e2f9d40db2decfc9a4d99ed82d52e1fb78e1cb9df05b7e"} May 28 10:28:21.405388 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.405359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4wc9\" (UniqueName: \"kubernetes.io/projected/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-kube-api-access-b4wc9\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.405546 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.405483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-hosts-file\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.405595 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.405544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-tmp-dir\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.506696 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.506659 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-hosts-file\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.506870 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.506708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-tmp-dir\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.506870 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.506742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4wc9\" (UniqueName: \"kubernetes.io/projected/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-kube-api-access-b4wc9\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.506870 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.506815 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-hosts-file\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.507120 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.507099 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-tmp-dir\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.520560 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.520540 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4wc9\" (UniqueName: \"kubernetes.io/projected/0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84-kube-api-access-b4wc9\") pod \"node-resolver-p545l\" (UID: \"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84\") " pod="openshift-dns/node-resolver-p545l" May 28 10:28:21.623700 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:21.623622 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p545l" May 28 10:28:22.301622 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:22.301592 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:22.301824 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:22.301727 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:22.607932 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:22.607719 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccfbc4f_e1fe_4a6b_9803_9e5eff081c84.slice/crio-1f85bb3dd2201bb6af9039ddce5bd62d91d5f1e6f19377979816db7e167700d2 WatchSource:0}: Error finding container 1f85bb3dd2201bb6af9039ddce5bd62d91d5f1e6f19377979816db7e167700d2: Status 404 returned error can't find the container with id 1f85bb3dd2201bb6af9039ddce5bd62d91d5f1e6f19377979816db7e167700d2 May 28 10:28:23.300975 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.300942 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:23.301123 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:23.301042 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:23.394725 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.394691 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p545l" event={"ID":"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84","Type":"ContainerStarted","Data":"259c3612879ed95e4cfe0802315bb94010bd0444a6b5c8b736c42970aa38abb4"} May 28 10:28:23.394866 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.394737 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p545l" event={"ID":"0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84","Type":"ContainerStarted","Data":"1f85bb3dd2201bb6af9039ddce5bd62d91d5f1e6f19377979816db7e167700d2"} May 28 10:28:23.397631 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.397605 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" event={"ID":"d291a890-2702-49cf-aaf5-f9b5a809f4f6","Type":"ContainerStarted","Data":"710ce6ddadc8b68da92026a143bdcb4f5d77cacf12dd0d88c5a08c9c61794c0c"} May 28 10:28:23.397876 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.397860 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:28:23.399210 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.399186 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="8c14191629c178e6654e6b64493ade6ace879b5d6e80de585a99e39001ccbc04" exitCode=0 May 28 10:28:23.399300 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.399216 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"8c14191629c178e6654e6b64493ade6ace879b5d6e80de585a99e39001ccbc04"} May 28 10:28:23.410594 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.410560 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-p545l" podStartSLOduration=2.41054889 podStartE2EDuration="2.41054889s" podCreationTimestamp="2026-05-28 10:28:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:23.410236925 +0000 UTC m=+26.700680660" watchObservedRunningTime="2026-05-28 10:28:23.41054889 +0000 UTC m=+26.700992625" May 28 10:28:23.413709 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.413691 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:28:23.458710 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.458672 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" podStartSLOduration=8.604613862 podStartE2EDuration="26.458661187s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.954185854 +0000 UTC m=+3.244629581" lastFinishedPulling="2026-05-28 10:28:17.808233179 +0000 UTC m=+21.098676906" observedRunningTime="2026-05-28 10:28:23.458303534 +0000 UTC m=+26.748747268" watchObservedRunningTime="2026-05-28 10:28:23.458661187 +0000 UTC m=+26.749104920" May 28 10:28:23.952692 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:23.952657 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:28:24.301457 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.301283 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:24.301612 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:24.301557 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:24.401945 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.401905 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:28:24.417023 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.416990 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:28:24.619839 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.619802 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsc9d"] May 28 10:28:24.619971 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.619933 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:24.620396 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:24.620039 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:24.622571 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.622548 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tb2q6"] May 28 10:28:24.622660 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:24.622639 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:24.622728 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:24.622712 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:25.405116 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:25.405081 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="a264f619746f1ee1b9636bfd2379e566c1b13e3ce44e8964cc8ef161d0c85f57" exitCode=0 May 28 10:28:25.405575 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:25.405165 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"a264f619746f1ee1b9636bfd2379e566c1b13e3ce44e8964cc8ef161d0c85f57"} May 28 10:28:26.301232 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:26.301199 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:26.301387 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:26.301200 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:26.301387 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:26.301309 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:26.301493 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:26.301388 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:27.411561 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:27.411530 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="f754656638d43fd6e38a4f8964c6151d86813dceb4e739fd16cab73b5d04c969" exitCode=0 May 28 10:28:27.411929 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:27.411588 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"f754656638d43fd6e38a4f8964c6151d86813dceb4e739fd16cab73b5d04c969"} May 28 10:28:28.300987 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:28.300954 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:28.301183 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:28.300955 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:28.301183 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:28.301097 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:28.301183 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:28.301164 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:30.300691 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.300664 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:30.300691 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.300677 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:30.301738 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.301197 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsc9d" podUID="cff501bb-534f-42a4-89b6-20405e12d0d0" May 28 10:28:30.302602 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.302550 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tb2q6" podUID="f78e8d15-bb0c-4ade-9152-cd547c8e9731" May 28 10:28:30.487807 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.487781 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-178.ec2.internal" event="NodeReady" May 28 10:28:30.487995 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.487925 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 10:28:30.530346 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.530319 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gfcfd"] May 28 10:28:30.550686 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.550659 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569"] May 28 10:28:30.551006 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.550823 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.553759 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.553732 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 10:28:30.554069 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.554021 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 10:28:30.554169 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.554079 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 10:28:30.554996 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.554977 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 10:28:30.555886 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.555333 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2s7sz\"" May 28 10:28:30.562557 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.562536 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 10:28:30.566816 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.566616 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z2k2w"] May 28 10:28:30.566816 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.566768 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.570697 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.570652 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 10:28:30.571054 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.570892 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 10:28:30.571054 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.570997 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 10:28:30.571177 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.571142 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 10:28:30.571265 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.571247 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-25nn2\"" May 28 10:28:30.585278 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.585228 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f48bffccb-ttlfn"] May 28 10:28:30.585479 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.585424 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.593310 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.591186 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 28 10:28:30.593310 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.591246 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 28 10:28:30.594992 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.593754 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9qhk2\"" May 28 10:28:30.594992 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.593996 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 28 10:28:30.595327 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.595305 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 28 10:28:30.600184 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.600161 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 28 10:28:30.613064 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.613033 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:28:30.613206 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.613186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.616112 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616077 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 10:28:30.616215 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616159 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lbpgm\"" May 28 10:28:30.616597 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616578 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 10:28:30.616697 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616664 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 10:28:30.616759 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616745 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 10:28:30.616906 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.616885 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 10:28:30.618360 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.618341 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 10:28:30.637730 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.637610 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c"] May 28 10:28:30.637853 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.637781 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.640528 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.640509 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 10:28:30.640625 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.640596 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 10:28:30.640929 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.640904 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ncrcv\"" May 28 10:28:30.641024 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.640955 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 10:28:30.647158 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.647138 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 10:28:30.656558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.656540 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:28:30.656699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.656679 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" May 28 10:28:30.659373 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.659330 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 10:28:30.660381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.660328 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 10:28:30.660381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.660374 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g7bmp\"" May 28 10:28:30.678671 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678652 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6"] May 28 10:28:30.678853 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-trusted-ca\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.678958 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-serving-cert\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.678958 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678876 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.678958 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4pgn\" (UniqueName: \"kubernetes.io/projected/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-kube-api-access-m4pgn\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.678958 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-tmp\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.678958 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.678919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-serving-cert\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-config\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq2rm\" (UniqueName: \"kubernetes.io/projected/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-kube-api-access-xq2rm\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-snapshots\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-config\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.679244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrr5q\" (UniqueName: \"kubernetes.io/projected/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-kube-api-access-wrr5q\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.679586 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.679256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.695679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.695657 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt"] May 28 10:28:30.695826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.695804 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.698522 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.698500 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 10:28:30.698604 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.698503 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q6cnx\"" May 28 10:28:30.698768 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.698751 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 10:28:30.698911 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.698894 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 10:28:30.699129 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.699112 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 10:28:30.718938 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.718920 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97"] May 28 10:28:30.719093 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.719066 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:30.721553 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.721513 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 10:28:30.721957 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.721721 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 10:28:30.721957 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.721736 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 10:28:30.721957 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.721723 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5m28d\"" May 28 10:28:30.739087 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.739069 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z"] May 28 10:28:30.739229 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.739214 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.742024 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.742006 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v5s6l\"" May 28 10:28:30.742114 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.742027 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 10:28:30.742171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.742143 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 10:28:30.742281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.742262 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 10:28:30.742281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.742276 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 10:28:30.752136 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.752118 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm"] May 28 10:28:30.752259 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.752244 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.754659 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.754642 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 28 10:28:30.754753 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.754672 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 28 10:28:30.754989 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.754973 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 28 10:28:30.755365 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.755349 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 28 10:28:30.768167 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.768147 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6"] May 28 10:28:30.768290 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.768274 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" May 28 10:28:30.771003 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.770903 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-klspb\"" May 28 10:28:30.771003 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.770977 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 10:28:30.771147 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.770977 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 10:28:30.780142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780229 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780229 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780219 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.780344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjm4s\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxdx\" (UniqueName: \"kubernetes.io/projected/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-kube-api-access-6kxdx\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.780344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780348 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780377 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xq2rm\" (UniqueName: \"kubernetes.io/projected/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-kube-api-access-xq2rm\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780482 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-config\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780512 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrr5q\" (UniqueName: \"kubernetes.io/projected/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-kube-api-access-wrr5q\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780542 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-stats-auth\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecc9809a-ded4-4014-8677-92aa621fcd51-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780698 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-tmp\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwq8b\" (UniqueName: \"kubernetes.io/projected/68ff2104-0252-468c-b74f-07c0e1c064a4-kube-api-access-cwq8b\") pod \"volume-data-source-validator-5cf8c89d64-m6g9c\" (UID: \"68ff2104-0252-468c-b74f-07c0e1c064a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780759 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-serving-cert\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780816 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-config\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-snapshots\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.780941 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.780971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jmtw\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-trusted-ca\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781151 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-serving-cert\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781177 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4pgn\" (UniqueName: \"kubernetes.io/projected/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-kube-api-access-m4pgn\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-default-certificate\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwq9c\" (UniqueName: \"kubernetes.io/projected/ecc9809a-ded4-4014-8677-92aa621fcd51-kube-api-access-vwq9c\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781455 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.781649 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781605 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-config\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.782213 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-config\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.782213 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781909 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-tmp\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.782213 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.781961 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-snapshots\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.782360 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.782303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.782812 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.782649 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-trusted-ca\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.784756 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.784737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.784920 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.784899 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-serving-cert\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.785016 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.784917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-serving-cert\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.786197 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.786177 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k"] May 28 10:28:30.786334 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.786316 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.788610 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.788569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq2rm\" (UniqueName: \"kubernetes.io/projected/7e3c08e6-521f-4f1d-9634-bbc2f80725bd-kube-api-access-xq2rm\") pod \"kube-storage-version-migrator-operator-565644f49-5w569\" (UID: \"7e3c08e6-521f-4f1d-9634-bbc2f80725bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.788699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.788651 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 28 10:28:30.788699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.788666 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 28 10:28:30.789021 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.789004 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nw5nn\"" May 28 10:28:30.789584 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.789542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrr5q\" (UniqueName: \"kubernetes.io/projected/fa0e5fd1-425c-4549-bd9a-4c51393ddc18-kube-api-access-wrr5q\") pod \"insights-operator-78bdfb888c-gfcfd\" (UID: \"fa0e5fd1-425c-4549-bd9a-4c51393ddc18\") " pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.789680 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.789664 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4pgn\" (UniqueName: \"kubernetes.io/projected/3f315ad3-baa1-4058-a8de-9cf1a5b3afb0-kube-api-access-m4pgn\") pod \"console-operator-76dff48d59-z2k2w\" (UID: \"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0\") " pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.807276 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.807255 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt"] May 28 10:28:30.807395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.807379 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.810057 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.810028 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 28 10:28:30.810205 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.810183 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 28 10:28:30.810299 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.810249 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 28 10:28:30.810364 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.810299 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 28 10:28:30.823013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.822965 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gfcfd"] May 28 10:28:30.823013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823021 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823038 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823050 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823055 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823061 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823154 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z2k2w"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823162 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:28:30.823182 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.823176 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p698z"] May 28 10:28:30.825795 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.825779 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 28 10:28:30.825882 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.825832 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5xs27\"" May 28 10:28:30.835121 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.835107 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fldd4"] May 28 10:28:30.835269 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.835252 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:30.837894 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.837875 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 10:28:30.838106 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.838092 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-67n6w\"" May 28 10:28:30.838330 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.838179 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 10:28:30.838330 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.838208 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 10:28:30.863377 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863351 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt"] May 28 10:28:30.863377 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863380 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863392 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863404 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863414 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863425 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f48bffccb-ttlfn"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863456 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863467 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fldd4"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863481 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p698z"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863492 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z"] May 28 10:28:30.863548 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.863481 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fldd4" May 28 10:28:30.865664 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.865644 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" May 28 10:28:30.866348 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.866285 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d8qsq\"" May 28 10:28:30.866348 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.866319 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 10:28:30.866679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.866662 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 10:28:30.876832 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.876535 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.881865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.881912 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864d8c9a-fd9a-4771-84cd-3014c52ed589-config\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.881945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.881974 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882003 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jmtw\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882073 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcpw\" (UniqueName: \"kubernetes.io/projected/b89cf7ac-b38e-410a-8d9f-b42e51ea00be-kube-api-access-8bcpw\") pod \"network-check-source-7f44b6dd87-ppbkm\" (UID: \"b89cf7ac-b38e-410a-8d9f-b42e51ea00be\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68742847-67d2-4bea-81df-dbdd99e8102c-klusterlet-config\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwz7\" (UniqueName: \"kubernetes.io/projected/68742847-67d2-4bea-81df-dbdd99e8102c-kube-api-access-pnwz7\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882252 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882277 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-default-certificate\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.883349 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882304 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882334 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882373 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwq9c\" (UniqueName: \"kubernetes.io/projected/ecc9809a-ded4-4014-8677-92aa621fcd51-kube-api-access-vwq9c\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882423 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpp9\" (UniqueName: \"kubernetes.io/projected/864d8c9a-fd9a-4771-84cd-3014c52ed589-kube-api-access-wtpp9\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882521 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjm4s\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882548 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxdx\" (UniqueName: \"kubernetes.io/projected/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-kube-api-access-6kxdx\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882571 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68742847-67d2-4bea-81df-dbdd99e8102c-tmp\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/575b7b1f-022c-40f7-bd5a-671842bd0538-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6674\" (UniqueName: \"kubernetes.io/projected/779c15c8-cd06-4edf-9896-e4fdb0257536-kube-api-access-b6674\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.882748 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-stats-auth\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864d8c9a-fd9a-4771-84cd-3014c52ed589-serving-cert\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.884150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883236 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883268 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecc9809a-ded4-4014-8677-92aa621fcd51-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883305 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883336 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwq8b\" (UniqueName: \"kubernetes.io/projected/68ff2104-0252-468c-b74f-07c0e1c064a4-kube-api-access-cwq8b\") pod \"volume-data-source-validator-5cf8c89d64-m6g9c\" (UID: \"68ff2104-0252-468c-b74f-07c0e1c064a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883420 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.884888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.883269 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.885332 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.885206 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.385184979 +0000 UTC m=+34.675628713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.885729 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.885965 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.885995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.886049 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886055 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886071 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.886101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecc9809a-ded4-4014-8677-92aa621fcd51-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886113 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.386098051 +0000 UTC m=+34.676541764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886118 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886131 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886167 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886182 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.386165668 +0000 UTC m=+34.676609385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.386195504 +0000 UTC m=+34.676639228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886271 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:30.886502 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.886319 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.386306703 +0000 UTC m=+34.676750436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:30.887347 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.886580 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.887947 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.887902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-stats-auth\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.888475 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.888428 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.888573 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.888487 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.889517 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.889474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.889714 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.889668 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-default-certificate\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.891123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.891100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.894148 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.894129 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwq8b\" (UniqueName: \"kubernetes.io/projected/68ff2104-0252-468c-b74f-07c0e1c064a4-kube-api-access-cwq8b\") pod \"volume-data-source-validator-5cf8c89d64-m6g9c\" (UID: \"68ff2104-0252-468c-b74f-07c0e1c064a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" May 28 10:28:30.895567 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.895522 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jmtw\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.896026 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.896006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:30.897123 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.897082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjm4s\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.897582 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.897552 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:30.897641 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.897598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxdx\" (UniqueName: \"kubernetes.io/projected/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-kube-api-access-6kxdx\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:30.897801 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.897782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwq9c\" (UniqueName: \"kubernetes.io/projected/ecc9809a-ded4-4014-8677-92aa621fcd51-kube-api-access-vwq9c\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:30.905766 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.905740 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:30.966868 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.966285 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984325 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/575b7b1f-022c-40f7-bd5a-671842bd0538-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6674\" (UniqueName: \"kubernetes.io/projected/779c15c8-cd06-4edf-9896-e4fdb0257536-kube-api-access-b6674\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psj8x\" (UniqueName: \"kubernetes.io/projected/ff836f4c-5d6a-4541-b12e-31507939d0a3-kube-api-access-psj8x\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984464 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864d8c9a-fd9a-4771-84cd-3014c52ed589-serving-cert\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff836f4c-5d6a-4541-b12e-31507939d0a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsdsr\" (UniqueName: \"kubernetes.io/projected/c83e193b-639f-4a1a-adf4-6aef5861673a-kube-api-access-gsdsr\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c83e193b-639f-4a1a-adf4-6aef5861673a-config-volume\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984704 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864d8c9a-fd9a-4771-84cd-3014c52ed589-config\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984819 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcpw\" (UniqueName: \"kubernetes.io/projected/b89cf7ac-b38e-410a-8d9f-b42e51ea00be-kube-api-access-8bcpw\") pod \"network-check-source-7f44b6dd87-ppbkm\" (UID: \"b89cf7ac-b38e-410a-8d9f-b42e51ea00be\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" May 28 10:28:30.986872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984842 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68742847-67d2-4bea-81df-dbdd99e8102c-klusterlet-config\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984904 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984930 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwz7\" (UniqueName: \"kubernetes.io/projected/68742847-67d2-4bea-81df-dbdd99e8102c-kube-api-access-pnwz7\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.984976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686fj\" (UniqueName: \"kubernetes.io/projected/10d98d32-e339-41e8-807a-7331f43e7659-kube-api-access-686fj\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985033 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpp9\" (UniqueName: \"kubernetes.io/projected/864d8c9a-fd9a-4771-84cd-3014c52ed589-kube-api-access-wtpp9\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68742847-67d2-4bea-81df-dbdd99e8102c-tmp\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c83e193b-639f-4a1a-adf4-6aef5861673a-tmp-dir\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlxrq\" (UniqueName: \"kubernetes.io/projected/4cce1726-ad8f-45ae-8def-9d6e7e43570d-kube-api-access-zlxrq\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.985871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/575b7b1f-022c-40f7-bd5a-671842bd0538-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.987235 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:30.987775 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.987317 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.487297184 +0000 UTC m=+34.777740990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:30.988373 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.987996 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/864d8c9a-fd9a-4771-84cd-3014c52ed589-config\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:30.991915 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.991350 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68742847-67d2-4bea-81df-dbdd99e8102c-klusterlet-config\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.991915 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.991505 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:30.991915 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:30.991558 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.491539905 +0000 UTC m=+34.781983621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:30.992146 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.992104 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68742847-67d2-4bea-81df-dbdd99e8102c-tmp\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:30.996175 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.996126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/864d8c9a-fd9a-4771-84cd-3014c52ed589-serving-cert\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:31.000214 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:30.999789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6674\" (UniqueName: \"kubernetes.io/projected/779c15c8-cd06-4edf-9896-e4fdb0257536-kube-api-access-b6674\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:31.011742 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.011686 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcpw\" (UniqueName: \"kubernetes.io/projected/b89cf7ac-b38e-410a-8d9f-b42e51ea00be-kube-api-access-8bcpw\") pod \"network-check-source-7f44b6dd87-ppbkm\" (UID: \"b89cf7ac-b38e-410a-8d9f-b42e51ea00be\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" May 28 10:28:31.015679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.015166 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwz7\" (UniqueName: \"kubernetes.io/projected/68742847-67d2-4bea-81df-dbdd99e8102c-kube-api-access-pnwz7\") pod \"klusterlet-addon-workmgr-565d8dcdb9-rq52z\" (UID: \"68742847-67d2-4bea-81df-dbdd99e8102c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:31.015679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.015529 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpp9\" (UniqueName: \"kubernetes.io/projected/864d8c9a-fd9a-4771-84cd-3014c52ed589-kube-api-access-wtpp9\") pod \"service-ca-operator-57b5b68b8-xvc97\" (UID: \"864d8c9a-fd9a-4771-84cd-3014c52ed589\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:31.049705 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.049151 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" May 28 10:28:31.062636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.062598 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:31.077965 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.077484 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086236 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c83e193b-639f-4a1a-adf4-6aef5861673a-config-volume\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086407 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086456 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086530 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086574 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-686fj\" (UniqueName: \"kubernetes.io/projected/10d98d32-e339-41e8-807a-7331f43e7659-kube-api-access-686fj\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086621 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c83e193b-639f-4a1a-adf4-6aef5861673a-tmp-dir\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086656 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlxrq\" (UniqueName: \"kubernetes.io/projected/4cce1726-ad8f-45ae-8def-9d6e7e43570d-kube-api-access-zlxrq\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086690 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086740 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psj8x\" (UniqueName: \"kubernetes.io/projected/ff836f4c-5d6a-4541-b12e-31507939d0a3-kube-api-access-psj8x\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086779 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff836f4c-5d6a-4541-b12e-31507939d0a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086806 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086855 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdsr\" (UniqueName: \"kubernetes.io/projected/c83e193b-639f-4a1a-adf4-6aef5861673a-kube-api-access-gsdsr\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.086922 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.091449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.088677 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c83e193b-639f-4a1a-adf4-6aef5861673a-tmp-dir\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.089176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c83e193b-639f-4a1a-adf4-6aef5861673a-config-volume\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.089269 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.089324 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.589304736 +0000 UTC m=+34.879748463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.090155 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.090231 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:31.590214154 +0000 UTC m=+34.880657881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.090762 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:31.092395 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.090836 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs podName:f78e8d15-bb0c-4ade-9152-cd547c8e9731 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:03.090812093 +0000 UTC m=+66.381255805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs") pod "network-metrics-daemon-tb2q6" (UID: "f78e8d15-bb0c-4ade-9152-cd547c8e9731") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:28:31.093534 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.093492 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.094449 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.094407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.094547 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.094492 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4cce1726-ad8f-45ae-8def-9d6e7e43570d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.094618 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.094597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff836f4c-5d6a-4541-b12e-31507939d0a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:31.096699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.096655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.097254 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.097205 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cce1726-ad8f-45ae-8def-9d6e7e43570d-hub\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.099131 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.099046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-686fj\" (UniqueName: \"kubernetes.io/projected/10d98d32-e339-41e8-807a-7331f43e7659-kube-api-access-686fj\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:31.102126 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.101537 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsdsr\" (UniqueName: \"kubernetes.io/projected/c83e193b-639f-4a1a-adf4-6aef5861673a-kube-api-access-gsdsr\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.102126 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.101921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlxrq\" (UniqueName: \"kubernetes.io/projected/4cce1726-ad8f-45ae-8def-9d6e7e43570d-kube-api-access-zlxrq\") pod \"cluster-proxy-proxy-agent-79d9547ffd-tbp2k\" (UID: \"4cce1726-ad8f-45ae-8def-9d6e7e43570d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.102126 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.102033 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psj8x\" (UniqueName: \"kubernetes.io/projected/ff836f4c-5d6a-4541-b12e-31507939d0a3-kube-api-access-psj8x\") pod \"managed-serviceaccount-addon-agent-67f4fd77dd-dqswt\" (UID: \"ff836f4c-5d6a-4541-b12e-31507939d0a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:31.107551 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.107483 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gfcfd"] May 28 10:28:31.115783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.115162 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569"] May 28 10:28:31.117031 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.116749 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-z2k2w"] May 28 10:28:31.129946 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.129909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0e5fd1_425c_4549_bd9a_4c51393ddc18.slice/crio-3fc9b27db1174f7f9aaa899ff974377f07de8e6d65fdba9d61817086e5c1df44 WatchSource:0}: Error finding container 3fc9b27db1174f7f9aaa899ff974377f07de8e6d65fdba9d61817086e5c1df44: Status 404 returned error can't find the container with id 3fc9b27db1174f7f9aaa899ff974377f07de8e6d65fdba9d61817086e5c1df44 May 28 10:28:31.132107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.131718 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:28:31.134201 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.134170 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3c08e6_521f_4f1d_9634_bbc2f80725bd.slice/crio-2e424560a903c1d8223c7e4ea3eb4116b46aa21fd462507cbe4fa2aa3d4f2e7d WatchSource:0}: Error finding container 2e424560a903c1d8223c7e4ea3eb4116b46aa21fd462507cbe4fa2aa3d4f2e7d: Status 404 returned error can't find the container with id 2e424560a903c1d8223c7e4ea3eb4116b46aa21fd462507cbe4fa2aa3d4f2e7d May 28 10:28:31.144616 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.144278 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" May 28 10:28:31.188479 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.187854 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:31.198293 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.196776 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c"] May 28 10:28:31.201150 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.201111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dhx\" (UniqueName: \"kubernetes.io/projected/cff501bb-534f-42a4-89b6-20405e12d0d0-kube-api-access-n2dhx\") pod \"network-check-target-tsc9d\" (UID: \"cff501bb-534f-42a4-89b6-20405e12d0d0\") " pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:31.277412 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.277104 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97"] May 28 10:28:31.282395 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.282363 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864d8c9a_fd9a_4771_84cd_3014c52ed589.slice/crio-39eee112e6fa26abc492328fd65fc69089020548b2598e9864b979c71916606d WatchSource:0}: Error finding container 39eee112e6fa26abc492328fd65fc69089020548b2598e9864b979c71916606d: Status 404 returned error can't find the container with id 39eee112e6fa26abc492328fd65fc69089020548b2598e9864b979c71916606d May 28 10:28:31.298778 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.298751 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z"] May 28 10:28:31.302541 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.302514 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68742847_67d2_4bea_81df_dbdd99e8102c.slice/crio-d6b56b5f58047c9138e45d7fe07d1cd230c06dd3ec77c400175a0a23e7380c95 WatchSource:0}: Error finding container d6b56b5f58047c9138e45d7fe07d1cd230c06dd3ec77c400175a0a23e7380c95: Status 404 returned error can't find the container with id d6b56b5f58047c9138e45d7fe07d1cd230c06dd3ec77c400175a0a23e7380c95 May 28 10:28:31.318105 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.318022 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm"] May 28 10:28:31.321186 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.321143 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89cf7ac_b38e_410a_8d9f_b42e51ea00be.slice/crio-6a985efcaef9c8f01436f9c6ec5b1203a7e27c85710e66cdd77c250208a9b24c WatchSource:0}: Error finding container 6a985efcaef9c8f01436f9c6ec5b1203a7e27c85710e66cdd77c250208a9b24c: Status 404 returned error can't find the container with id 6a985efcaef9c8f01436f9c6ec5b1203a7e27c85710e66cdd77c250208a9b24c May 28 10:28:31.338695 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.338672 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt"] May 28 10:28:31.341108 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.341080 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff836f4c_5d6a_4541_b12e_31507939d0a3.slice/crio-07b06efe278b66d3e1b6f44bc781c7710641e78b51c474c0b2674272527c0b50 WatchSource:0}: Error finding container 07b06efe278b66d3e1b6f44bc781c7710641e78b51c474c0b2674272527c0b50: Status 404 returned error can't find the container with id 07b06efe278b66d3e1b6f44bc781c7710641e78b51c474c0b2674272527c0b50 May 28 10:28:31.347045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.347013 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k"] May 28 10:28:31.351018 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:31.350893 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cce1726_ad8f_45ae_8def_9d6e7e43570d.slice/crio-6979eee3c4be714fdc6f446d76f27caab94a8b0e89bc7eca3776c6a310186e31 WatchSource:0}: Error finding container 6979eee3c4be714fdc6f446d76f27caab94a8b0e89bc7eca3776c6a310186e31: Status 404 returned error can't find the container with id 6979eee3c4be714fdc6f446d76f27caab94a8b0e89bc7eca3776c6a310186e31 May 28 10:28:31.390358 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.390322 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:31.390556 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.390378 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:31.390556 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.390410 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:31.390556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390530 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:31.390556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390536 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.390513321 +0000 UTC m=+35.680957033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390578 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.390562547 +0000 UTC m=+35.681006259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.390575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390538 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.390633 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390637 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390682 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390726 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.390714966 +0000 UTC m=+35.681158697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390690 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:31.390771 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390772 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:31.391052 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390779 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.390763135 +0000 UTC m=+35.681206865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:31.391052 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.390817 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.3908054 +0000 UTC m=+35.681249123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:31.420424 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.420390 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" event={"ID":"b89cf7ac-b38e-410a-8d9f-b42e51ea00be","Type":"ContainerStarted","Data":"6a985efcaef9c8f01436f9c6ec5b1203a7e27c85710e66cdd77c250208a9b24c"} May 28 10:28:31.421561 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.421533 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" event={"ID":"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0","Type":"ContainerStarted","Data":"f8bf04f269ed7bc8fb2c429eb92bedb125b19971d2915c7c12ebd0e0fc708f42"} May 28 10:28:31.422659 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.422635 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" event={"ID":"7e3c08e6-521f-4f1d-9634-bbc2f80725bd","Type":"ContainerStarted","Data":"2e424560a903c1d8223c7e4ea3eb4116b46aa21fd462507cbe4fa2aa3d4f2e7d"} May 28 10:28:31.423787 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.423758 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" event={"ID":"ff836f4c-5d6a-4541-b12e-31507939d0a3","Type":"ContainerStarted","Data":"07b06efe278b66d3e1b6f44bc781c7710641e78b51c474c0b2674272527c0b50"} May 28 10:28:31.424817 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.424788 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" event={"ID":"fa0e5fd1-425c-4549-bd9a-4c51393ddc18","Type":"ContainerStarted","Data":"3fc9b27db1174f7f9aaa899ff974377f07de8e6d65fdba9d61817086e5c1df44"} May 28 10:28:31.425794 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.425772 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" event={"ID":"68742847-67d2-4bea-81df-dbdd99e8102c","Type":"ContainerStarted","Data":"d6b56b5f58047c9138e45d7fe07d1cd230c06dd3ec77c400175a0a23e7380c95"} May 28 10:28:31.426840 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.426817 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" event={"ID":"864d8c9a-fd9a-4771-84cd-3014c52ed589","Type":"ContainerStarted","Data":"39eee112e6fa26abc492328fd65fc69089020548b2598e9864b979c71916606d"} May 28 10:28:31.427973 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.427939 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerStarted","Data":"6979eee3c4be714fdc6f446d76f27caab94a8b0e89bc7eca3776c6a310186e31"} May 28 10:28:31.428934 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.428916 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" event={"ID":"68ff2104-0252-468c-b74f-07c0e1c064a4","Type":"ContainerStarted","Data":"030c8dd07229bc872d2d9dd303bbcc535d5a29a1b11a523a614ac5aecdf12c50"} May 28 10:28:31.491760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.491728 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:31.491957 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.491816 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:31.491957 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.491876 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:31.491957 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.491928 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:31.491957 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.491940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.491926375 +0000 UTC m=+35.782370087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:31.492089 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.491967 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.491956241 +0000 UTC m=+35.782399953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:31.592894 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.592796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:31.593060 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:31.592927 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:31.593060 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.592945 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:31.593060 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.593017 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.592999636 +0000 UTC m=+35.883443347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:31.593221 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.593075 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:31.593221 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:31.593128 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:28:32.593116004 +0000 UTC m=+35.883559721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:32.301467 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.301081 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:32.301467 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.301422 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:28:32.307392 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.306774 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lbkvj\"" May 28 10:28:32.307392 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.307037 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 10:28:32.307392 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.307274 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8wbmd\"" May 28 10:28:32.315845 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.315821 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:32.403015 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.402941 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:32.403015 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.402998 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.403096 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403111 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403128 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403171 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.403150464 +0000 UTC m=+37.693594187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.403206 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:32.403255 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403217 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403266 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.403250202 +0000 UTC m=+37.693693940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403285 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.403275292 +0000 UTC m=+37.693719005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403305 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403355 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.403340492 +0000 UTC m=+37.693784227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.403379 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403530 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:32.403556 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403547 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:32.403833 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.403589 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.403575227 +0000 UTC m=+37.694018945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:32.504717 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.504671 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:32.504903 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.504825 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:32.504961 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.504828 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:32.505022 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.505003 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.504980187 +0000 UTC m=+37.795423917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:32.505203 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.505186 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:32.505281 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.505271 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.505253641 +0000 UTC m=+37.795697358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:32.605746 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.605667 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:32.605906 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:32.605773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:32.605906 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.605813 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:32.605906 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.605860 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:32.605906 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.605891 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.605870078 +0000 UTC m=+37.896313805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:32.606113 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:32.605913 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:34.605901256 +0000 UTC m=+37.896344973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:34.069976 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.069953 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsc9d"] May 28 10:28:34.173818 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:34.173784 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff501bb_534f_42a4_89b6_20405e12d0d0.slice/crio-a1ffeb65b7e10ba8d67839aa7bd51b7825b2f07b1200382ea759782ae50126e7 WatchSource:0}: Error finding container a1ffeb65b7e10ba8d67839aa7bd51b7825b2f07b1200382ea759782ae50126e7: Status 404 returned error can't find the container with id a1ffeb65b7e10ba8d67839aa7bd51b7825b2f07b1200382ea759782ae50126e7 May 28 10:28:34.424354 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.424316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:34.424521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.424379 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:34.424521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.424410 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:34.424521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.424480 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:34.424521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.424520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424562 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.424536461 +0000 UTC m=+41.714980174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424593 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424605 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424617 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.424635105 +0000 UTC m=+41.715078839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424670 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.424661369 +0000 UTC m=+41.715105085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424692 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424701 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:34.424729 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424731 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.424719282 +0000 UTC m=+41.715163002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:34.425099 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424736 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:34.425099 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.424767 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.42476028 +0000 UTC m=+41.715204022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:34.436790 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.436752 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsc9d" event={"ID":"cff501bb-534f-42a4-89b6-20405e12d0d0","Type":"ContainerStarted","Data":"a1ffeb65b7e10ba8d67839aa7bd51b7825b2f07b1200382ea759782ae50126e7"} May 28 10:28:34.525297 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.525260 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:34.525475 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.525404 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:34.525475 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.525431 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:34.525575 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.525537 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.525514151 +0000 UTC m=+41.815957883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:34.525575 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.525549 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:34.525685 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.525602 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.525585708 +0000 UTC m=+41.816029438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:34.626192 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.626152 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:34.626365 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:34.626309 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:34.626631 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.626539 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:34.626631 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.626614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.626595457 +0000 UTC m=+41.917039173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:34.627054 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.626927 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:34.627054 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:34.626979 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:28:38.626964456 +0000 UTC m=+41.917408191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:38.470365 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.470326 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.470398 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.470429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470576 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470583 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470606 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.470599 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470636 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.470615702 +0000 UTC m=+49.761059436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470663 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470671 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.470664517 +0000 UTC m=+49.761108229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470683 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.470678121 +0000 UTC m=+49.761121833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470721 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.470706576 +0000 UTC m=+49.761150307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:38.470837 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.470742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:38.471359 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470904 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:38.471359 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470918 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:38.471359 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.470951 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.470942824 +0000 UTC m=+49.761386574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:38.571897 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.571864 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:38.572075 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.571982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:38.572075 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.572042 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:38.572183 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.572092 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:38.572183 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.572120 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.572101813 +0000 UTC m=+49.862545528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:38.572183 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.572147 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.57212877 +0000 UTC m=+49.862572483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:38.673528 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.673493 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:38.673709 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:38.673591 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:38.673709 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.673677 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:38.673810 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.673756 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.673734887 +0000 UTC m=+49.964178599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:38.673810 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.673679 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:38.673917 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:38.673838 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:28:46.673817677 +0000 UTC m=+49.964261405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:40.488197 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.488161 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fd7r5"] May 28 10:28:40.507927 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.507899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fd7r5"] May 28 10:28:40.508077 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.508024 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.511135 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.511103 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 10:28:40.690670 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.690619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-original-pull-secret\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.690854 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.690835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-kubelet-config\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.690933 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.690865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-dbus\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.791842 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.791809 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-original-pull-secret\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.791988 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.791944 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-kubelet-config\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.791988 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.791960 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-dbus\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.792083 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.792065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-kubelet-config\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.792122 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.792094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-dbus\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.794872 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.794847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3-original-pull-secret\") pod \"global-pull-secret-syncer-fd7r5\" (UID: \"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3\") " pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:40.818800 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:40.818769 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd7r5" May 28 10:28:44.323490 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.323463 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fd7r5"] May 28 10:28:44.463093 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.463057 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" event={"ID":"fa0e5fd1-425c-4549-bd9a-4c51393ddc18","Type":"ContainerStarted","Data":"347e98f89a116fb3a8ed14450dfb81f6b2030e534611de4e6f6ca4d2efcde388"} May 28 10:28:44.465033 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.464992 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsc9d" event={"ID":"cff501bb-534f-42a4-89b6-20405e12d0d0","Type":"ContainerStarted","Data":"c41c4ce1b595017db9b78b3f594836a77bae6416c4195ba5d1a6cbef562b77d8"} May 28 10:28:44.465372 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.465354 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:28:44.466296 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.466272 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" event={"ID":"68742847-67d2-4bea-81df-dbdd99e8102c","Type":"ContainerStarted","Data":"f83367998e73a8e330f935b0bc67944c287e0c805ff9fe5e65a17e9143e2a1d2"} May 28 10:28:44.467926 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.467907 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:44.468579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.468560 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" May 28 10:28:44.470104 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.470038 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" event={"ID":"864d8c9a-fd9a-4771-84cd-3014c52ed589","Type":"ContainerStarted","Data":"5eb5e3eaa5a5e2359f12ca69dbdd487c59021fd3c66cabc8e4c3ac163476b809"} May 28 10:28:44.471405 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.471383 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fd7r5" event={"ID":"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3","Type":"ContainerStarted","Data":"e1356a93c2c39ab3ff9507300d13a681aa07bcac1c0008f367e15390ac702cf9"} May 28 10:28:44.472902 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.472838 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerStarted","Data":"2c49c8520bc8b86f01751acf7c5dcedc478440919c6b5de544a8e1e4cbf46fc0"} May 28 10:28:44.474392 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.474300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" event={"ID":"68ff2104-0252-468c-b74f-07c0e1c064a4","Type":"ContainerStarted","Data":"3c303d9210b2ddeb5b5d43d85905c80166876bc8f16c0615ecbdecfbe76dcd18"} May 28 10:28:44.477273 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.477255 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerStarted","Data":"06d4a58c7f74060ebc4f140f91fa14f6dd3325c82a613d3eb626d37c38133b9b"} May 28 10:28:44.478991 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.478971 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" event={"ID":"b89cf7ac-b38e-410a-8d9f-b42e51ea00be","Type":"ContainerStarted","Data":"eef19087c4b8ceec2b770769f47c5766d9c61e63e79d827beb1f8fe84d13ec26"} May 28 10:28:44.480699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.480633 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/0.log" May 28 10:28:44.480699 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.480670 2575 generic.go:358] "Generic (PLEG): container finished" podID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" containerID="9311b9920a6b9e40604bfa1b2b4f1bd1900b5101162b9371cf2c0885a0c00b3f" exitCode=255 May 28 10:28:44.480844 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.480736 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" event={"ID":"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0","Type":"ContainerDied","Data":"9311b9920a6b9e40604bfa1b2b4f1bd1900b5101162b9371cf2c0885a0c00b3f"} May 28 10:28:44.480986 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.480964 2575 scope.go:117] "RemoveContainer" containerID="9311b9920a6b9e40604bfa1b2b4f1bd1900b5101162b9371cf2c0885a0c00b3f" May 28 10:28:44.482463 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.482423 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" event={"ID":"7e3c08e6-521f-4f1d-9634-bbc2f80725bd","Type":"ContainerStarted","Data":"ef0c8c4e83e442b2aa15117cddbf4e918ffa94b525e89163b51d38e84ebcdb69"} May 28 10:28:44.484841 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.484793 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" podStartSLOduration=28.557844407 podStartE2EDuration="41.484778182s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.137078904 +0000 UTC m=+34.427522621" lastFinishedPulling="2026-05-28 10:28:44.064012684 +0000 UTC m=+47.354456396" observedRunningTime="2026-05-28 10:28:44.483599449 +0000 UTC m=+47.774043184" watchObservedRunningTime="2026-05-28 10:28:44.484778182 +0000 UTC m=+47.775221917" May 28 10:28:44.508338 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.503794 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" podStartSLOduration=28.511764707 podStartE2EDuration="41.503777086s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.144260825 +0000 UTC m=+34.434704553" lastFinishedPulling="2026-05-28 10:28:44.136273207 +0000 UTC m=+47.426716932" observedRunningTime="2026-05-28 10:28:44.502844042 +0000 UTC m=+47.793287777" watchObservedRunningTime="2026-05-28 10:28:44.503777086 +0000 UTC m=+47.794220821" May 28 10:28:44.531531 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.525841 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ppbkm" podStartSLOduration=24.680841986 podStartE2EDuration="37.525814672s" podCreationTimestamp="2026-05-28 10:28:07 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.323346161 +0000 UTC m=+34.613789873" lastFinishedPulling="2026-05-28 10:28:44.168318834 +0000 UTC m=+47.458762559" observedRunningTime="2026-05-28 10:28:44.524770051 +0000 UTC m=+47.815213785" watchObservedRunningTime="2026-05-28 10:28:44.525814672 +0000 UTC m=+47.816258408" May 28 10:28:44.583587 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.583509 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" podStartSLOduration=28.736313487 podStartE2EDuration="41.583490003s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.289094127 +0000 UTC m=+34.579537843" lastFinishedPulling="2026-05-28 10:28:44.136270642 +0000 UTC m=+47.426714359" observedRunningTime="2026-05-28 10:28:44.582714327 +0000 UTC m=+47.873158062" watchObservedRunningTime="2026-05-28 10:28:44.583490003 +0000 UTC m=+47.873933738" May 28 10:28:44.631394 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.631333 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tsc9d" podStartSLOduration=37.668785776 podStartE2EDuration="47.631311366s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:28:34.18729882 +0000 UTC m=+37.477742538" lastFinishedPulling="2026-05-28 10:28:44.14982441 +0000 UTC m=+47.440268128" observedRunningTime="2026-05-28 10:28:44.600213228 +0000 UTC m=+47.890656962" watchObservedRunningTime="2026-05-28 10:28:44.631311366 +0000 UTC m=+47.921755102" May 28 10:28:44.665720 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.665666 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m6g9c" podStartSLOduration=28.737415607 podStartE2EDuration="41.665647872s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.211766237 +0000 UTC m=+34.502209963" lastFinishedPulling="2026-05-28 10:28:44.139998501 +0000 UTC m=+47.430442228" observedRunningTime="2026-05-28 10:28:44.665115232 +0000 UTC m=+47.955558968" watchObservedRunningTime="2026-05-28 10:28:44.665647872 +0000 UTC m=+47.956091608" May 28 10:28:44.666813 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:44.666775 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565d8dcdb9-rq52z" podStartSLOduration=10.802069608 podStartE2EDuration="23.666764223s" podCreationTimestamp="2026-05-28 10:28:21 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.304926567 +0000 UTC m=+34.595370280" lastFinishedPulling="2026-05-28 10:28:44.169621181 +0000 UTC m=+47.460064895" observedRunningTime="2026-05-28 10:28:44.646360149 +0000 UTC m=+47.936803887" watchObservedRunningTime="2026-05-28 10:28:44.666764223 +0000 UTC m=+47.957207958" May 28 10:28:45.493378 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.493336 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="06d4a58c7f74060ebc4f140f91fa14f6dd3325c82a613d3eb626d37c38133b9b" exitCode=0 May 28 10:28:45.494400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.493430 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"06d4a58c7f74060ebc4f140f91fa14f6dd3325c82a613d3eb626d37c38133b9b"} May 28 10:28:45.496642 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.496563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/1.log" May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.496933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/0.log" May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.496964 2575 generic.go:358] "Generic (PLEG): container finished" podID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" exitCode=255 May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.497805 2575 scope.go:117] "RemoveContainer" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:45.497991 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z2k2w_openshift-console-operator(3f315ad3-baa1-4058-a8de-9cf1a5b3afb0)\"" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podUID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.498036 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" event={"ID":"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0","Type":"ContainerDied","Data":"59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6"} May 28 10:28:45.500464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:45.498066 2575 scope.go:117] "RemoveContainer" containerID="9311b9920a6b9e40604bfa1b2b4f1bd1900b5101162b9371cf2c0885a0c00b3f" May 28 10:28:46.505246 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.504348 2575 generic.go:358] "Generic (PLEG): container finished" podID="f16c5677-e975-4784-9ae0-9a8ff8ba1c9d" containerID="18d6daecb40be9553bb7d24503b7c139f14c16773ec7c8452364840fda40fe9b" exitCode=0 May 28 10:28:46.505246 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.504730 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerDied","Data":"18d6daecb40be9553bb7d24503b7c139f14c16773ec7c8452364840fda40fe9b"} May 28 10:28:46.506619 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.506595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/1.log" May 28 10:28:46.507120 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.507076 2575 scope.go:117] "RemoveContainer" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" May 28 10:28:46.507322 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.507280 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z2k2w_openshift-console-operator(3f315ad3-baa1-4058-a8de-9cf1a5b3afb0)\"" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podUID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.560316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.560417 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.560499 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.560577 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.560665 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560695 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560710 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58ff65d499-ff55p: secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560769 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls podName:b9784bc0-a4b4-40f7-b319-7dc27e668598 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.56074925 +0000 UTC m=+65.851192966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls") pod "image-registry-58ff65d499-ff55p" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598") : secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560796 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560806 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774887b856-tfbsz: secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560838 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls podName:b3e232da-fb85-4989-8c4c-112a5bbceaae nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.560826871 +0000 UTC m=+65.851270585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls") pod "image-registry-774887b856-tfbsz" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae") : secret "image-registry-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.560940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.560920412 +0000 UTC m=+65.851364132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : configmap references non-existent config key: service-ca.crt May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.561094 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.561133 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls podName:ecc9809a-ded4-4014-8677-92aa621fcd51 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.561121205 +0000 UTC m=+65.851564917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-x6wb6" (UID: "ecc9809a-ded4-4014-8677-92aa621fcd51") : secret "cluster-monitoring-operator-tls" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.561497 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:28:46.561473 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.561538 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs podName:d6bf45d4-7a06-49e5-add6-5c52b3aafc37 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.561525433 +0000 UTC m=+65.851969156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs") pod "router-default-6f48bffccb-ttlfn" (UID: "d6bf45d4-7a06-49e5-add6-5c52b3aafc37") : secret "router-metrics-certs-default" not found May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.662107 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.662255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.662466 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.662508 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.662529 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert podName:575b7b1f-022c-40f7-bd5a-671842bd0538 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.662508975 +0000 UTC m=+65.952952704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-8fmp6" (UID: "575b7b1f-022c-40f7-bd5a-671842bd0538") : secret "networking-console-plugin-cert" not found May 28 10:28:46.662682 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.662562 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls podName:779c15c8-cd06-4edf-9896-e4fdb0257536 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.66254979 +0000 UTC m=+65.952993513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls") pod "cluster-samples-operator-697587599-bqbvt" (UID: "779c15c8-cd06-4edf-9896-e4fdb0257536") : secret "samples-operator-tls" not found May 28 10:28:46.763038 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.762919 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:28:46.763207 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.763077 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:28:46.763207 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.763148 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert podName:10d98d32-e339-41e8-807a-7331f43e7659 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.763128223 +0000 UTC m=+66.053571955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert") pod "ingress-canary-p698z" (UID: "10d98d32-e339-41e8-807a-7331f43e7659") : secret "canary-serving-cert" not found May 28 10:28:46.763207 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.763178 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:28:46.763367 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.763085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:28:46.763367 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:46.763231 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls podName:c83e193b-639f-4a1a-adf4-6aef5861673a nodeName:}" failed. No retries permitted until 2026-05-28 10:29:02.763215158 +0000 UTC m=+66.053658875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls") pod "dns-default-fldd4" (UID: "c83e193b-639f-4a1a-adf4-6aef5861673a") : secret "dns-default-metrics-tls" not found May 28 10:28:46.916422 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.916381 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b"] May 28 10:28:46.920152 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.920128 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" May 28 10:28:46.923056 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.923031 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 10:28:46.923197 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.923033 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 10:28:46.923197 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.923033 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f6qps\"" May 28 10:28:46.927585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.927554 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b"] May 28 10:28:46.965845 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:46.965804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8679\" (UniqueName: \"kubernetes.io/projected/4220d220-0a2e-4256-aaeb-b54997aa80fc-kube-api-access-f8679\") pod \"migrator-b985f5d89-l7h4b\" (UID: \"4220d220-0a2e-4256-aaeb-b54997aa80fc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" May 28 10:28:47.009250 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.009220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p545l_0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84/dns-node-resolver/0.log" May 28 10:28:47.067168 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.067135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8679\" (UniqueName: \"kubernetes.io/projected/4220d220-0a2e-4256-aaeb-b54997aa80fc-kube-api-access-f8679\") pod \"migrator-b985f5d89-l7h4b\" (UID: \"4220d220-0a2e-4256-aaeb-b54997aa80fc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" May 28 10:28:47.076655 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.076627 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8679\" (UniqueName: \"kubernetes.io/projected/4220d220-0a2e-4256-aaeb-b54997aa80fc-kube-api-access-f8679\") pod \"migrator-b985f5d89-l7h4b\" (UID: \"4220d220-0a2e-4256-aaeb-b54997aa80fc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" May 28 10:28:47.233954 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.233743 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" May 28 10:28:47.360498 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.360404 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cdj8x"] May 28 10:28:47.407209 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.407163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cdj8x"] May 28 10:28:47.407383 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.407259 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.410180 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.409900 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 10:28:47.410180 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.409942 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 10:28:47.410180 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.409959 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-676fd\"" May 28 10:28:47.471746 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.471711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87qjz\" (UniqueName: \"kubernetes.io/projected/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-api-access-87qjz\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.471746 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.471751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.471981 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.471815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1549743-85f7-4beb-9647-743ec57ed3fe-data-volume\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.471981 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.471926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.471981 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.471958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1549743-85f7-4beb-9647-743ec57ed3fe-crio-socket\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573016 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.572980 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87qjz\" (UniqueName: \"kubernetes.io/projected/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-api-access-87qjz\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573016 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573017 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573063 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1549743-85f7-4beb-9647-743ec57ed3fe-data-volume\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573142 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1549743-85f7-4beb-9647-743ec57ed3fe-crio-socket\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1549743-85f7-4beb-9647-743ec57ed3fe-crio-socket\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:47.573387 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 10:28:47.573549 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:47.573475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls podName:c1549743-85f7-4beb-9647-743ec57ed3fe nodeName:}" failed. No retries permitted until 2026-05-28 10:28:48.073454727 +0000 UTC m=+51.363898461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cdj8x" (UID: "c1549743-85f7-4beb-9647-743ec57ed3fe") : secret "insights-runtime-extractor-tls" not found May 28 10:28:47.573912 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573592 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.573912 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.573658 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1549743-85f7-4beb-9647-743ec57ed3fe-data-volume\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.583885 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.583859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87qjz\" (UniqueName: \"kubernetes.io/projected/c1549743-85f7-4beb-9647-743ec57ed3fe-kube-api-access-87qjz\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:47.808431 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:47.808405 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q9cds_73176d5b-f86b-4085-ac7d-f21bc8ca8ca9/node-ca/0.log" May 28 10:28:48.077689 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.077617 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:48.077820 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:48.077769 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 10:28:48.077862 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:48.077837 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls podName:c1549743-85f7-4beb-9647-743ec57ed3fe nodeName:}" failed. No retries permitted until 2026-05-28 10:28:49.077818404 +0000 UTC m=+52.368262117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cdj8x" (UID: "c1549743-85f7-4beb-9647-743ec57ed3fe") : secret "insights-runtime-extractor-tls" not found May 28 10:28:48.270750 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.270701 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wqb9r"] May 28 10:28:48.290407 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.290365 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wqb9r"] May 28 10:28:48.290590 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.290513 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.294536 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.294513 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 28 10:28:48.294679 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.294639 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 28 10:28:48.295752 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.295731 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 28 10:28:48.295867 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.295760 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 28 10:28:48.295867 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.295815 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bj4kh\"" May 28 10:28:48.381107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.381010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-cabundle\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.381280 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.381165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-key\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.381280 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.381211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24kl\" (UniqueName: \"kubernetes.io/projected/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-kube-api-access-c24kl\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.482295 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.482259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-cabundle\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.482502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.482394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-key\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.482502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.482457 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c24kl\" (UniqueName: \"kubernetes.io/projected/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-kube-api-access-c24kl\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.482975 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.482950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-cabundle\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.485218 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.485191 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-signing-key\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.493422 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.493397 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24kl\" (UniqueName: \"kubernetes.io/projected/d4e8fe36-eef2-482b-a7a9-edddb4e6d57e-kube-api-access-c24kl\") pod \"service-ca-67d667c7d-wqb9r\" (UID: \"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e\") " pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:48.604386 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:48.604359 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" May 28 10:28:49.089066 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:49.089017 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:49.089263 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:49.089182 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 10:28:49.089263 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:49.089260 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls podName:c1549743-85f7-4beb-9647-743ec57ed3fe nodeName:}" failed. No retries permitted until 2026-05-28 10:28:51.08924032 +0000 UTC m=+54.379684051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cdj8x" (UID: "c1549743-85f7-4beb-9647-743ec57ed3fe") : secret "insights-runtime-extractor-tls" not found May 28 10:28:50.685505 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:50.685375 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-wqb9r"] May 28 10:28:50.689197 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:50.689172 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e8fe36_eef2_482b_a7a9_edddb4e6d57e.slice/crio-22f9991c74a5d6ffaf3f41bba9b7176d584b7cc50a102782515765b73493bd0f WatchSource:0}: Error finding container 22f9991c74a5d6ffaf3f41bba9b7176d584b7cc50a102782515765b73493bd0f: Status 404 returned error can't find the container with id 22f9991c74a5d6ffaf3f41bba9b7176d584b7cc50a102782515765b73493bd0f May 28 10:28:50.690634 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:50.690598 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b"] May 28 10:28:50.696457 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:28:50.696411 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4220d220_0a2e_4256_aaeb_b54997aa80fc.slice/crio-6a404ebb4dc6f8f747a8999888e1746ffbe3da99e80d958d57e7fef2d3ba9fb0 WatchSource:0}: Error finding container 6a404ebb4dc6f8f747a8999888e1746ffbe3da99e80d958d57e7fef2d3ba9fb0: Status 404 returned error can't find the container with id 6a404ebb4dc6f8f747a8999888e1746ffbe3da99e80d958d57e7fef2d3ba9fb0 May 28 10:28:50.906565 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:50.906519 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:50.906565 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:50.906572 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:28:50.907057 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:50.907044 2575 scope.go:117] "RemoveContainer" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" May 28 10:28:50.907281 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:50.907261 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-z2k2w_openshift-console-operator(3f315ad3-baa1-4058-a8de-9cf1a5b3afb0)\"" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podUID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" May 28 10:28:51.117824 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.117745 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:51.117962 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:51.117894 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 10:28:51.117962 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:51.117958 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls podName:c1549743-85f7-4beb-9647-743ec57ed3fe nodeName:}" failed. No retries permitted until 2026-05-28 10:28:55.117938972 +0000 UTC m=+58.408382702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cdj8x" (UID: "c1549743-85f7-4beb-9647-743ec57ed3fe") : secret "insights-runtime-extractor-tls" not found May 28 10:28:51.524145 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.524094 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fd7r5" event={"ID":"bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3","Type":"ContainerStarted","Data":"98bc2419cba83dee34e1699bd0ffb74d35c5f298d783408a9c0f3589c7d56fd8"} May 28 10:28:51.525234 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.525202 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" event={"ID":"4220d220-0a2e-4256-aaeb-b54997aa80fc","Type":"ContainerStarted","Data":"6a404ebb4dc6f8f747a8999888e1746ffbe3da99e80d958d57e7fef2d3ba9fb0"} May 28 10:28:51.526669 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.526642 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" event={"ID":"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e","Type":"ContainerStarted","Data":"c32fe8414014fbb28824171c23bab0ad496c333111dc5a428c76a3cd1439b8cd"} May 28 10:28:51.526669 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.526670 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" event={"ID":"d4e8fe36-eef2-482b-a7a9-edddb4e6d57e","Type":"ContainerStarted","Data":"22f9991c74a5d6ffaf3f41bba9b7176d584b7cc50a102782515765b73493bd0f"} May 28 10:28:51.528366 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.528343 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerStarted","Data":"ab414bfcc587f1ed1a5846498ad343dee7758e1f7297265629ea1ad41e10bf8e"} May 28 10:28:51.528479 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.528371 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerStarted","Data":"666f93093d45cce9ea7d8b66b000eff58881c5824a10343af3cf90dcb861331e"} May 28 10:28:51.531148 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.531127 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9m72" event={"ID":"f16c5677-e975-4784-9ae0-9a8ff8ba1c9d","Type":"ContainerStarted","Data":"0252b9d1465e256cd62dae7c7cd51fe11e77df89f87db70aa6075e40999a54de"} May 28 10:28:51.536419 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.536390 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" event={"ID":"ff836f4c-5d6a-4541-b12e-31507939d0a3","Type":"ContainerStarted","Data":"3a8a3ca196ea69a323b339571b94311b2fc56fcce1e8194a781d4e363b1fde5d"} May 28 10:28:51.556670 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.556624 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-wqb9r" podStartSLOduration=3.556612166 podStartE2EDuration="3.556612166s" podCreationTimestamp="2026-05-28 10:28:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:51.556524318 +0000 UTC m=+54.846968057" watchObservedRunningTime="2026-05-28 10:28:51.556612166 +0000 UTC m=+54.847055901" May 28 10:28:51.557190 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.557157 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fd7r5" podStartSLOduration=5.391860725 podStartE2EDuration="11.55714782s" podCreationTimestamp="2026-05-28 10:28:40 +0000 UTC" firstStartedPulling="2026-05-28 10:28:44.347274234 +0000 UTC m=+47.637717949" lastFinishedPulling="2026-05-28 10:28:50.512561329 +0000 UTC m=+53.803005044" observedRunningTime="2026-05-28 10:28:51.540958894 +0000 UTC m=+54.831402630" watchObservedRunningTime="2026-05-28 10:28:51.55714782 +0000 UTC m=+54.847591554" May 28 10:28:51.582738 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.582387 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9m72" podStartSLOduration=17.94852327 podStartE2EDuration="54.58237064s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:27:59.953904873 +0000 UTC m=+3.244348595" lastFinishedPulling="2026-05-28 10:28:36.58775224 +0000 UTC m=+39.878195965" observedRunningTime="2026-05-28 10:28:51.581373157 +0000 UTC m=+54.871816915" watchObservedRunningTime="2026-05-28 10:28:51.58237064 +0000 UTC m=+54.872814374" May 28 10:28:51.599677 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.599636 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67f4fd77dd-dqswt" podStartSLOduration=11.442581644 podStartE2EDuration="30.599624961s" podCreationTimestamp="2026-05-28 10:28:21 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.343196723 +0000 UTC m=+34.633640435" lastFinishedPulling="2026-05-28 10:28:50.50024004 +0000 UTC m=+53.790683752" observedRunningTime="2026-05-28 10:28:51.599175875 +0000 UTC m=+54.889619610" watchObservedRunningTime="2026-05-28 10:28:51.599624961 +0000 UTC m=+54.890068694" May 28 10:28:51.624770 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:51.624716 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" podStartSLOduration=11.478509965 podStartE2EDuration="30.624703415s" podCreationTimestamp="2026-05-28 10:28:21 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.35404764 +0000 UTC m=+34.644491352" lastFinishedPulling="2026-05-28 10:28:50.500241077 +0000 UTC m=+53.790684802" observedRunningTime="2026-05-28 10:28:51.623652065 +0000 UTC m=+54.914095802" watchObservedRunningTime="2026-05-28 10:28:51.624703415 +0000 UTC m=+54.915147152" May 28 10:28:52.543139 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:52.542691 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" event={"ID":"4220d220-0a2e-4256-aaeb-b54997aa80fc","Type":"ContainerStarted","Data":"8c8115738ce1e31b6cec2eb6c8294bfc1386299f3587419d5acb5461280fc1fb"} May 28 10:28:53.544791 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:53.544750 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" event={"ID":"4220d220-0a2e-4256-aaeb-b54997aa80fc","Type":"ContainerStarted","Data":"95b3f4557fd128b2791f6db276784a02125135989284c0e680a0ac125b65ec49"} May 28 10:28:53.563085 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:53.563034 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-l7h4b" podStartSLOduration=5.910571293 podStartE2EDuration="7.563020871s" podCreationTimestamp="2026-05-28 10:28:46 +0000 UTC" firstStartedPulling="2026-05-28 10:28:50.698360248 +0000 UTC m=+53.988803974" lastFinishedPulling="2026-05-28 10:28:52.350809838 +0000 UTC m=+55.641253552" observedRunningTime="2026-05-28 10:28:53.561674575 +0000 UTC m=+56.852118310" watchObservedRunningTime="2026-05-28 10:28:53.563020871 +0000 UTC m=+56.853464604" May 28 10:28:55.157403 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:55.157368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:28:55.157781 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:55.157550 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 28 10:28:55.157781 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:28:55.157632 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls podName:c1549743-85f7-4beb-9647-743ec57ed3fe nodeName:}" failed. No retries permitted until 2026-05-28 10:29:03.157611395 +0000 UTC m=+66.448055115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cdj8x" (UID: "c1549743-85f7-4beb-9647-743ec57ed3fe") : secret "insights-runtime-extractor-tls" not found May 28 10:28:56.424448 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:28:56.424408 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-25trz" May 28 10:29:01.135084 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:01.135040 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" podUID="4cce1726-ad8f-45ae-8def-9d6e7e43570d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:29:02.301163 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.301135 2575 scope.go:117] "RemoveContainer" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" May 28 10:29:02.571981 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.571913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:29:02.572225 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.572213 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/1.log" May 28 10:29:02.572273 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.572245 2575 generic.go:358] "Generic (PLEG): container finished" podID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" containerID="99639af7af23d323a24a3f4b1e031ddb5a41ed10257ce3259551b382e7ac09dd" exitCode=255 May 28 10:29:02.572324 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.572310 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" event={"ID":"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0","Type":"ContainerDied","Data":"99639af7af23d323a24a3f4b1e031ddb5a41ed10257ce3259551b382e7ac09dd"} May 28 10:29:02.572372 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.572350 2575 scope.go:117] "RemoveContainer" containerID="59a75a07c0d1497e4b3d64230d5cbbd3f3efd57d81b7e64b4c99ad4afa2f54d6" May 28 10:29:02.572712 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.572690 2575 scope.go:117] "RemoveContainer" containerID="99639af7af23d323a24a3f4b1e031ddb5a41ed10257ce3259551b382e7ac09dd" May 28 10:29:02.572907 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:29:02.572889 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-z2k2w_openshift-console-operator(3f315ad3-baa1-4058-a8de-9cf1a5b3afb0)\"" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podUID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" May 28 10:29:02.625525 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.625496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:02.625659 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.625542 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:02.625659 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.625573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:02.625800 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.625776 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:29:02.625859 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.625827 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:29:02.626263 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.626233 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-service-ca-bundle\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:02.627953 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.627929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6bf45d4-7a06-49e5-add6-5c52b3aafc37-metrics-certs\") pod \"router-default-6f48bffccb-ttlfn\" (UID: \"d6bf45d4-7a06-49e5-add6-5c52b3aafc37\") " pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:02.628069 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.628048 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"image-registry-774887b856-tfbsz\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:29:02.628069 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.628061 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"image-registry-58ff65d499-ff55p\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:02.628176 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.628149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecc9809a-ded4-4014-8677-92aa621fcd51-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-x6wb6\" (UID: \"ecc9809a-ded4-4014-8677-92aa621fcd51\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:29:02.726265 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.726239 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lbpgm\"" May 28 10:29:02.726403 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.726239 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:29:02.726530 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.726506 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:29:02.728506 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.728483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/779c15c8-cd06-4edf-9896-e4fdb0257536-samples-operator-tls\") pod \"cluster-samples-operator-697587599-bqbvt\" (UID: \"779c15c8-cd06-4edf-9896-e4fdb0257536\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:29:02.728633 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.728618 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/575b7b1f-022c-40f7-bd5a-671842bd0538-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-8fmp6\" (UID: \"575b7b1f-022c-40f7-bd5a-671842bd0538\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:29:02.734433 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.734416 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:02.749892 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.749873 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ncrcv\"" May 28 10:29:02.758215 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.758189 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:02.802955 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.802925 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:29:02.807395 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.807347 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q6cnx\"" May 28 10:29:02.822581 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.815054 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" May 28 10:29:02.827398 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.827372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:29:02.827547 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.827457 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:29:02.830662 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.830615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10d98d32-e339-41e8-807a-7331f43e7659-cert\") pod \"ingress-canary-p698z\" (UID: \"10d98d32-e339-41e8-807a-7331f43e7659\") " pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:29:02.831943 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.831734 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5m28d\"" May 28 10:29:02.831943 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.831915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c83e193b-639f-4a1a-adf4-6aef5861673a-metrics-tls\") pod \"dns-default-fldd4\" (UID: \"c83e193b-639f-4a1a-adf4-6aef5861673a\") " pod="openshift-dns/dns-default-fldd4" May 28 10:29:02.840153 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.840045 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" May 28 10:29:02.880907 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.880852 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f48bffccb-ttlfn"] May 28 10:29:02.911567 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.911540 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nw5nn\"" May 28 10:29:02.920689 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.920455 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" May 28 10:29:02.926991 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.926312 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:29:02.941650 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:02.941621 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9784bc0_a4b4_40f7_b319_7dc27e668598.slice/crio-ba5cb4683ec704aaa817a1f61bc1d51dcef879e5c3f75280e9b411c911817d44 WatchSource:0}: Error finding container ba5cb4683ec704aaa817a1f61bc1d51dcef879e5c3f75280e9b411c911817d44: Status 404 returned error can't find the container with id ba5cb4683ec704aaa817a1f61bc1d51dcef879e5c3f75280e9b411c911817d44 May 28 10:29:02.965378 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.964598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-67n6w\"" May 28 10:29:02.972066 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.971566 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p698z" May 28 10:29:02.975803 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.975586 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d8qsq\"" May 28 10:29:02.984677 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.984250 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fldd4" May 28 10:29:02.985004 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:02.984907 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:29:03.009477 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.009234 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e232da_fb85_4989_8c4c_112a5bbceaae.slice/crio-a50a0de4c327e134713a39478fc13dbe6425c21f17790c76e3334c4c585fd0d4 WatchSource:0}: Error finding container a50a0de4c327e134713a39478fc13dbe6425c21f17790c76e3334c4c585fd0d4: Status 404 returned error can't find the container with id a50a0de4c327e134713a39478fc13dbe6425c21f17790c76e3334c4c585fd0d4 May 28 10:29:03.011012 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.010986 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6"] May 28 10:29:03.023027 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.022972 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc9809a_ded4_4014_8677_92aa621fcd51.slice/crio-1d5f22c661cda4e57bce0da532a1215be1979a05bc56cfcfac6370ed3ff0904f WatchSource:0}: Error finding container 1d5f22c661cda4e57bce0da532a1215be1979a05bc56cfcfac6370ed3ff0904f: Status 404 returned error can't find the container with id 1d5f22c661cda4e57bce0da532a1215be1979a05bc56cfcfac6370ed3ff0904f May 28 10:29:03.040310 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.040261 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt"] May 28 10:29:03.116743 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.116427 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6"] May 28 10:29:03.119689 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.119645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575b7b1f_022c_40f7_bd5a_671842bd0538.slice/crio-a9379dd0564deb14d1403212403056881b804d39df2d78f9f25b406ff8100912 WatchSource:0}: Error finding container a9379dd0564deb14d1403212403056881b804d39df2d78f9f25b406ff8100912: Status 404 returned error can't find the container with id a9379dd0564deb14d1403212403056881b804d39df2d78f9f25b406ff8100912 May 28 10:29:03.129975 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.129910 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:29:03.132636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.132423 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 10:29:03.143868 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.143842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78e8d15-bb0c-4ade-9152-cd547c8e9731-metrics-certs\") pod \"network-metrics-daemon-tb2q6\" (UID: \"f78e8d15-bb0c-4ade-9152-cd547c8e9731\") " pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:29:03.168211 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.168158 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p698z"] May 28 10:29:03.172236 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.172192 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d98d32_e339_41e8_807a_7331f43e7659.slice/crio-f0f5fd4d9bffe7fff7d4d13386651e10a480ed0d867d615e098450103979b7a3 WatchSource:0}: Error finding container f0f5fd4d9bffe7fff7d4d13386651e10a480ed0d867d615e098450103979b7a3: Status 404 returned error can't find the container with id f0f5fd4d9bffe7fff7d4d13386651e10a480ed0d867d615e098450103979b7a3 May 28 10:29:03.199191 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.199160 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fldd4"] May 28 10:29:03.202890 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.202865 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83e193b_639f_4a1a_adf4_6aef5861673a.slice/crio-0eb31aa83c91f6f8285be9816f41f78165f07735fe3db5c31235dfe6a5996baf WatchSource:0}: Error finding container 0eb31aa83c91f6f8285be9816f41f78165f07735fe3db5c31235dfe6a5996baf: Status 404 returned error can't find the container with id 0eb31aa83c91f6f8285be9816f41f78165f07735fe3db5c31235dfe6a5996baf May 28 10:29:03.228107 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.227933 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lbkvj\"" May 28 10:29:03.231513 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.231473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:29:03.233719 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.233695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1549743-85f7-4beb-9647-743ec57ed3fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cdj8x\" (UID: \"c1549743-85f7-4beb-9647-743ec57ed3fe\") " pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:29:03.235637 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.235613 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tb2q6" May 28 10:29:03.322641 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.322617 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-676fd\"" May 28 10:29:03.330214 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.330116 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cdj8x" May 28 10:29:03.377948 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.377385 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tb2q6"] May 28 10:29:03.380294 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.380256 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78e8d15_bb0c_4ade_9152_cd547c8e9731.slice/crio-dde06cc686a1988043db0a2a634cc6599ae3fb9ffba829b50feca508b4c918a7 WatchSource:0}: Error finding container dde06cc686a1988043db0a2a634cc6599ae3fb9ffba829b50feca508b4c918a7: Status 404 returned error can't find the container with id dde06cc686a1988043db0a2a634cc6599ae3fb9ffba829b50feca508b4c918a7 May 28 10:29:03.474133 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.474088 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cdj8x"] May 28 10:29:03.478163 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:03.478134 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1549743_85f7_4beb_9647_743ec57ed3fe.slice/crio-f56029bc26aa36cac1a92b8eda3fded46a0223bebb96a18c66d54f27a1a25b16 WatchSource:0}: Error finding container f56029bc26aa36cac1a92b8eda3fded46a0223bebb96a18c66d54f27a1a25b16: Status 404 returned error can't find the container with id f56029bc26aa36cac1a92b8eda3fded46a0223bebb96a18c66d54f27a1a25b16 May 28 10:29:03.577797 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.577764 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" event={"ID":"575b7b1f-022c-40f7-bd5a-671842bd0538","Type":"ContainerStarted","Data":"a9379dd0564deb14d1403212403056881b804d39df2d78f9f25b406ff8100912"} May 28 10:29:03.579281 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.579253 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cdj8x" event={"ID":"c1549743-85f7-4beb-9647-743ec57ed3fe","Type":"ContainerStarted","Data":"dc07b26553ed2c5f9f35fe9d834473740dc1fc6de5be0dcb860a67e9b5ec39b0"} May 28 10:29:03.579398 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.579289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cdj8x" event={"ID":"c1549743-85f7-4beb-9647-743ec57ed3fe","Type":"ContainerStarted","Data":"f56029bc26aa36cac1a92b8eda3fded46a0223bebb96a18c66d54f27a1a25b16"} May 28 10:29:03.581083 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.580999 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p698z" event={"ID":"10d98d32-e339-41e8-807a-7331f43e7659","Type":"ContainerStarted","Data":"f0f5fd4d9bffe7fff7d4d13386651e10a480ed0d867d615e098450103979b7a3"} May 28 10:29:03.582277 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.582250 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" event={"ID":"779c15c8-cd06-4edf-9896-e4fdb0257536","Type":"ContainerStarted","Data":"14e2bb23b8da53c079516a07188ae6b355e965a3642227778a7f31237e98ae8d"} May 28 10:29:03.583844 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.583824 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774887b856-tfbsz" event={"ID":"b3e232da-fb85-4989-8c4c-112a5bbceaae","Type":"ContainerStarted","Data":"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05"} May 28 10:29:03.583937 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.583852 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774887b856-tfbsz" event={"ID":"b3e232da-fb85-4989-8c4c-112a5bbceaae","Type":"ContainerStarted","Data":"a50a0de4c327e134713a39478fc13dbe6425c21f17790c76e3334c4c585fd0d4"} May 28 10:29:03.583999 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.583960 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:29:03.585469 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.585425 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" event={"ID":"d6bf45d4-7a06-49e5-add6-5c52b3aafc37","Type":"ContainerStarted","Data":"890c787aa6a58e87c28aab2f73ea281ad80e58c9c98295c9dccae62230447cac"} May 28 10:29:03.585559 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.585475 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" event={"ID":"d6bf45d4-7a06-49e5-add6-5c52b3aafc37","Type":"ContainerStarted","Data":"54b74ae40b805d869be99196c4f84260a045fa85f02f42f4f623a2708078a85b"} May 28 10:29:03.586978 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.586961 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:29:03.588453 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.588402 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb2q6" event={"ID":"f78e8d15-bb0c-4ade-9152-cd547c8e9731","Type":"ContainerStarted","Data":"dde06cc686a1988043db0a2a634cc6599ae3fb9ffba829b50feca508b4c918a7"} May 28 10:29:03.590237 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.590214 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" event={"ID":"b9784bc0-a4b4-40f7-b319-7dc27e668598","Type":"ContainerStarted","Data":"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d"} May 28 10:29:03.590321 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.590242 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" event={"ID":"b9784bc0-a4b4-40f7-b319-7dc27e668598","Type":"ContainerStarted","Data":"ba5cb4683ec704aaa817a1f61bc1d51dcef879e5c3f75280e9b411c911817d44"} May 28 10:29:03.590394 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.590318 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:03.591401 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.591378 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" event={"ID":"ecc9809a-ded4-4014-8677-92aa621fcd51","Type":"ContainerStarted","Data":"1d5f22c661cda4e57bce0da532a1215be1979a05bc56cfcfac6370ed3ff0904f"} May 28 10:29:03.592959 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.592938 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fldd4" event={"ID":"c83e193b-639f-4a1a-adf4-6aef5861673a","Type":"ContainerStarted","Data":"0eb31aa83c91f6f8285be9816f41f78165f07735fe3db5c31235dfe6a5996baf"} May 28 10:29:03.606570 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.606521 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-774887b856-tfbsz" podStartSLOduration=60.606506151 podStartE2EDuration="1m0.606506151s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:29:03.606058396 +0000 UTC m=+66.896502131" watchObservedRunningTime="2026-05-28 10:29:03.606506151 +0000 UTC m=+66.896949892" May 28 10:29:03.627764 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.627717 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" podStartSLOduration=60.627705739 podStartE2EDuration="1m0.627705739s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:29:03.626924747 +0000 UTC m=+66.917368482" watchObservedRunningTime="2026-05-28 10:29:03.627705739 +0000 UTC m=+66.918149473" May 28 10:29:03.647021 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.646964 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" podStartSLOduration=60.646947566 podStartE2EDuration="1m0.646947566s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:29:03.646069869 +0000 UTC m=+66.936513629" watchObservedRunningTime="2026-05-28 10:29:03.646947566 +0000 UTC m=+66.937391302" May 28 10:29:03.735411 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.735373 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:03.744502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:03.744267 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:04.607472 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:04.605611 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:04.607472 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:04.607176 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f48bffccb-ttlfn" May 28 10:29:07.614535 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.614499 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" event={"ID":"575b7b1f-022c-40f7-bd5a-671842bd0538","Type":"ContainerStarted","Data":"ca4193546caedf0b25aff07f5b46deb86108c08c1b3243c54dd6e0c2a113e0c1"} May 28 10:29:07.616068 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.616044 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cdj8x" event={"ID":"c1549743-85f7-4beb-9647-743ec57ed3fe","Type":"ContainerStarted","Data":"84dfe867c679a2f0e461f36678fcf15cb8d56ed2a8b6e2852f761d50de96ecbf"} May 28 10:29:07.617329 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.617306 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p698z" event={"ID":"10d98d32-e339-41e8-807a-7331f43e7659","Type":"ContainerStarted","Data":"13e31336cbfafa11b884c26e5f9c5b315a00d5a3c17c7e0080022616da28d72d"} May 28 10:29:07.618917 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.618895 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" event={"ID":"779c15c8-cd06-4edf-9896-e4fdb0257536","Type":"ContainerStarted","Data":"a1aaa00bf7ca8a3016e17f6a0ad7ed78f197aacb5fa26508f6ccc05f942df8f0"} May 28 10:29:07.619019 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.618923 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" event={"ID":"779c15c8-cd06-4edf-9896-e4fdb0257536","Type":"ContainerStarted","Data":"0a154f661797ae059afbd2f39b45c028adbe7700441778d44b1cc4ce9c6fdb33"} May 28 10:29:07.620274 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.620243 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb2q6" event={"ID":"f78e8d15-bb0c-4ade-9152-cd547c8e9731","Type":"ContainerStarted","Data":"a9f5acb3774c37d1b2a461f696b030c8bd793ff00a341504de97a1bee3174bf9"} May 28 10:29:07.620370 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.620274 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tb2q6" event={"ID":"f78e8d15-bb0c-4ade-9152-cd547c8e9731","Type":"ContainerStarted","Data":"bb0c80db38d2c2785a5c448eda41e9720eb69e890aa7e11adfa6e37528687115"} May 28 10:29:07.621484 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.621464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" event={"ID":"ecc9809a-ded4-4014-8677-92aa621fcd51","Type":"ContainerStarted","Data":"483047b2c2e4c0a16b6f7d21ec52b4f63f24a62efd51fef5f609cf934c333bf3"} May 28 10:29:07.622882 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.622859 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fldd4" event={"ID":"c83e193b-639f-4a1a-adf4-6aef5861673a","Type":"ContainerStarted","Data":"d9760d0781b765eafcbb91abb1ce1aa8fdab42c3b1c41df2ec13e61b50b4eac9"} May 28 10:29:07.622969 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.622884 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fldd4" event={"ID":"c83e193b-639f-4a1a-adf4-6aef5861673a","Type":"ContainerStarted","Data":"756430b11b08361d173b783e3cc66ca439dab27da24dc5cbc8244a2d1e7cc275"} May 28 10:29:07.623042 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.623029 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fldd4" May 28 10:29:07.633177 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.633140 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-8fmp6" podStartSLOduration=51.821823753 podStartE2EDuration="55.633129982s" podCreationTimestamp="2026-05-28 10:28:12 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.121840058 +0000 UTC m=+66.412283771" lastFinishedPulling="2026-05-28 10:29:06.933146287 +0000 UTC m=+70.223590000" observedRunningTime="2026-05-28 10:29:07.631877251 +0000 UTC m=+70.922320986" watchObservedRunningTime="2026-05-28 10:29:07.633129982 +0000 UTC m=+70.923573716" May 28 10:29:07.650347 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.650304 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fldd4" podStartSLOduration=33.880816144 podStartE2EDuration="37.650289446s" podCreationTimestamp="2026-05-28 10:28:30 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.20522869 +0000 UTC m=+66.495672408" lastFinishedPulling="2026-05-28 10:29:06.974701994 +0000 UTC m=+70.265145710" observedRunningTime="2026-05-28 10:29:07.649309617 +0000 UTC m=+70.939753375" watchObservedRunningTime="2026-05-28 10:29:07.650289446 +0000 UTC m=+70.940733181" May 28 10:29:07.668865 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.668826 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-x6wb6" podStartSLOduration=60.723387492 podStartE2EDuration="1m4.668811733s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.027802388 +0000 UTC m=+66.318246107" lastFinishedPulling="2026-05-28 10:29:06.973226631 +0000 UTC m=+70.263670348" observedRunningTime="2026-05-28 10:29:07.666972074 +0000 UTC m=+70.957415810" watchObservedRunningTime="2026-05-28 10:29:07.668811733 +0000 UTC m=+70.959255468" May 28 10:29:07.684142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.684100 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-bqbvt" podStartSLOduration=60.816816629 podStartE2EDuration="1m4.684086388s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.102962206 +0000 UTC m=+66.393405930" lastFinishedPulling="2026-05-28 10:29:06.97023196 +0000 UTC m=+70.260675689" observedRunningTime="2026-05-28 10:29:07.683639159 +0000 UTC m=+70.974082894" watchObservedRunningTime="2026-05-28 10:29:07.684086388 +0000 UTC m=+70.974530123" May 28 10:29:07.699964 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.699919 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p698z" podStartSLOduration=33.902241879 podStartE2EDuration="37.699903916s" podCreationTimestamp="2026-05-28 10:28:30 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.174417942 +0000 UTC m=+66.464861667" lastFinishedPulling="2026-05-28 10:29:06.972079984 +0000 UTC m=+70.262523704" observedRunningTime="2026-05-28 10:29:07.699376695 +0000 UTC m=+70.989820458" watchObservedRunningTime="2026-05-28 10:29:07.699903916 +0000 UTC m=+70.990347651" May 28 10:29:07.717466 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:07.717416 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tb2q6" podStartSLOduration=67.127104424 podStartE2EDuration="1m10.717400143s" podCreationTimestamp="2026-05-28 10:27:57 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.382575635 +0000 UTC m=+66.673019349" lastFinishedPulling="2026-05-28 10:29:06.972871346 +0000 UTC m=+70.263315068" observedRunningTime="2026-05-28 10:29:07.715019795 +0000 UTC m=+71.005463532" watchObservedRunningTime="2026-05-28 10:29:07.717400143 +0000 UTC m=+71.007843883" May 28 10:29:09.632505 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:09.632468 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cdj8x" event={"ID":"c1549743-85f7-4beb-9647-743ec57ed3fe","Type":"ContainerStarted","Data":"1d623da70a8eb138998339da31c7f2e1c5767f62121e8de84e71eea69c1499d4"} May 28 10:29:09.669862 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:09.666112 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cdj8x" podStartSLOduration=17.667178651 podStartE2EDuration="22.666091909s" podCreationTimestamp="2026-05-28 10:28:47 +0000 UTC" firstStartedPulling="2026-05-28 10:29:03.555058467 +0000 UTC m=+66.845502179" lastFinishedPulling="2026-05-28 10:29:08.553971722 +0000 UTC m=+71.844415437" observedRunningTime="2026-05-28 10:29:09.66426626 +0000 UTC m=+72.954709991" watchObservedRunningTime="2026-05-28 10:29:09.666091909 +0000 UTC m=+72.956535648" May 28 10:29:10.038390 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.038359 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:29:10.055129 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.054915 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t"] May 28 10:29:10.104290 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.104262 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t"] May 28 10:29:10.104422 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.104391 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:10.107274 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.107248 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2spf5\"" May 28 10:29:10.107388 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.107356 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 28 10:29:10.108299 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.108269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43bd528f-f386-473b-924b-e34b00eaf47e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t\" (UID: \"43bd528f-f386-473b-924b-e34b00eaf47e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:10.209136 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.209089 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43bd528f-f386-473b-924b-e34b00eaf47e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t\" (UID: \"43bd528f-f386-473b-924b-e34b00eaf47e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:10.211550 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.211525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43bd528f-f386-473b-924b-e34b00eaf47e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t\" (UID: \"43bd528f-f386-473b-924b-e34b00eaf47e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:10.413948 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.413861 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:10.543479 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.543455 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t"] May 28 10:29:10.546230 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:10.546201 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43bd528f_f386_473b_924b_e34b00eaf47e.slice/crio-694f27ddcc27fbdc4ca241e89cad0bfd9e4cfe1e5224b4aa24d52ff3fbed6175 WatchSource:0}: Error finding container 694f27ddcc27fbdc4ca241e89cad0bfd9e4cfe1e5224b4aa24d52ff3fbed6175: Status 404 returned error can't find the container with id 694f27ddcc27fbdc4ca241e89cad0bfd9e4cfe1e5224b4aa24d52ff3fbed6175 May 28 10:29:10.637034 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.636991 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" event={"ID":"43bd528f-f386-473b-924b-e34b00eaf47e","Type":"ContainerStarted","Data":"694f27ddcc27fbdc4ca241e89cad0bfd9e4cfe1e5224b4aa24d52ff3fbed6175"} May 28 10:29:10.906795 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.906754 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:29:10.906795 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.906796 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:29:10.907344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:10.907320 2575 scope.go:117] "RemoveContainer" containerID="99639af7af23d323a24a3f4b1e031ddb5a41ed10257ce3259551b382e7ac09dd" May 28 10:29:10.907641 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:29:10.907612 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-z2k2w_openshift-console-operator(3f315ad3-baa1-4058-a8de-9cf1a5b3afb0)\"" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podUID="3f315ad3-baa1-4058-a8de-9cf1a5b3afb0" May 28 10:29:11.133270 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:11.133191 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" podUID="4cce1726-ad8f-45ae-8def-9d6e7e43570d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:29:12.644325 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:12.644286 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" event={"ID":"43bd528f-f386-473b-924b-e34b00eaf47e","Type":"ContainerStarted","Data":"27892b2778c6f57037c0c4168fcd4e44617d5e13121d8546231c5156312577b9"} May 28 10:29:12.644803 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:12.644430 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:12.649385 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:12.649343 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" May 28 10:29:12.660972 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:12.660922 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t" podStartSLOduration=1.266473142 podStartE2EDuration="2.660908935s" podCreationTimestamp="2026-05-28 10:29:10 +0000 UTC" firstStartedPulling="2026-05-28 10:29:10.548278997 +0000 UTC m=+73.838722709" lastFinishedPulling="2026-05-28 10:29:11.94271479 +0000 UTC m=+75.233158502" observedRunningTime="2026-05-28 10:29:12.660349722 +0000 UTC m=+75.950793457" watchObservedRunningTime="2026-05-28 10:29:12.660908935 +0000 UTC m=+75.951352670" May 28 10:29:13.659829 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.659792 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sbms5"] May 28 10:29:13.701670 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.701634 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sbms5"] May 28 10:29:13.701818 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.701764 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.705583 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.705557 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 28 10:29:13.705583 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.705572 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 28 10:29:13.705785 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.705576 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 10:29:13.705785 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.705557 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mslgf\"" May 28 10:29:13.736831 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.736804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.736988 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.736836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.736988 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.736861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpsh5\" (UniqueName: \"kubernetes.io/projected/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-kube-api-access-cpsh5\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.736988 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.736882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.837862 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.837827 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.837862 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.837863 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.838122 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.837893 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpsh5\" (UniqueName: \"kubernetes.io/projected/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-kube-api-access-cpsh5\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.838122 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.837918 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.838122 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:29:13.838012 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 28 10:29:13.838122 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:29:13.838077 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls podName:63f1537c-08ae-44ab-a9f0-a8c5737c3ee5 nodeName:}" failed. No retries permitted until 2026-05-28 10:29:14.338061137 +0000 UTC m=+77.628504868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-sbms5" (UID: "63f1537c-08ae-44ab-a9f0-a8c5737c3ee5") : secret "prometheus-operator-tls" not found May 28 10:29:13.838631 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.838604 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.840178 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.840156 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:13.846938 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:13.846911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpsh5\" (UniqueName: \"kubernetes.io/projected/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-kube-api-access-cpsh5\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:14.342134 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:14.342091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:14.344498 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:14.344465 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/63f1537c-08ae-44ab-a9f0-a8c5737c3ee5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-sbms5\" (UID: \"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:14.611619 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:14.611540 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" May 28 10:29:14.738007 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:14.737982 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-sbms5"] May 28 10:29:14.740157 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:14.740132 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f1537c_08ae_44ab_a9f0_a8c5737c3ee5.slice/crio-00b882d1d6e2666f21cb836e609dfe442d05eac9e1214da3ba445e5a690130ae WatchSource:0}: Error finding container 00b882d1d6e2666f21cb836e609dfe442d05eac9e1214da3ba445e5a690130ae: Status 404 returned error can't find the container with id 00b882d1d6e2666f21cb836e609dfe442d05eac9e1214da3ba445e5a690130ae May 28 10:29:15.502745 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:15.502712 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tsc9d" May 28 10:29:15.654100 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:15.654063 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" event={"ID":"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5","Type":"ContainerStarted","Data":"00b882d1d6e2666f21cb836e609dfe442d05eac9e1214da3ba445e5a690130ae"} May 28 10:29:17.630027 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:17.629998 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fldd4" May 28 10:29:17.661784 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:17.661743 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" event={"ID":"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5","Type":"ContainerStarted","Data":"cf2f31207e77388f17a0b150ea50234ded38c689c77b37ebadec8dd1a6c96b99"} May 28 10:29:17.661784 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:17.661788 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" event={"ID":"63f1537c-08ae-44ab-a9f0-a8c5737c3ee5","Type":"ContainerStarted","Data":"9610af6f279558a477967f2df59376a756ed8adec08351d02876b79cbd520601"} May 28 10:29:17.679067 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:17.679010 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-sbms5" podStartSLOduration=2.786304144 podStartE2EDuration="4.678995043s" podCreationTimestamp="2026-05-28 10:29:13 +0000 UTC" firstStartedPulling="2026-05-28 10:29:14.742015911 +0000 UTC m=+78.032459626" lastFinishedPulling="2026-05-28 10:29:16.63470681 +0000 UTC m=+79.925150525" observedRunningTime="2026-05-28 10:29:17.678170869 +0000 UTC m=+80.968614603" watchObservedRunningTime="2026-05-28 10:29:17.678995043 +0000 UTC m=+80.969438782" May 28 10:29:20.044997 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.044962 2575 patch_prober.go:28] interesting pod/image-registry-58ff65d499-ff55p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 10:29:20.045480 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.045016 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 10:29:20.056611 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.056577 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jzpn8"] May 28 10:29:20.109545 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.109515 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.112212 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.112192 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pvjpf\"" May 28 10:29:20.113940 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.113922 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 10:29:20.114579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.114249 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 10:29:20.114676 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.114269 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 10:29:20.189382 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-textfile\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-tls\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-root\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-wtmp\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h8rl\" (UniqueName: \"kubernetes.io/projected/4e735108-ff94-4fb5-b656-330db0d456ec-kube-api-access-8h8rl\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189558 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189762 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189762 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-sys\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.189762 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.189687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-metrics-client-ca\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290455 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290403 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-tls\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-root\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290487 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-wtmp\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290509 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h8rl\" (UniqueName: \"kubernetes.io/projected/4e735108-ff94-4fb5-b656-330db0d456ec-kube-api-access-8h8rl\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290536 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290568 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290644 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-sys\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290662 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-wtmp\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290687 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-metrics-client-ca\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290700 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-root\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290755 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-textfile\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.290950 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.290856 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e735108-ff94-4fb5-b656-330db0d456ec-sys\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.291184 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.291092 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-textfile\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.291373 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.291352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-metrics-client-ca\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.291453 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.291396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.293622 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.293594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.293733 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.293624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e735108-ff94-4fb5-b656-330db0d456ec-node-exporter-tls\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.299798 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.299742 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h8rl\" (UniqueName: \"kubernetes.io/projected/4e735108-ff94-4fb5-b656-330db0d456ec-kube-api-access-8h8rl\") pod \"node-exporter-jzpn8\" (UID: \"4e735108-ff94-4fb5-b656-330db0d456ec\") " pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.422606 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.422574 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jzpn8" May 28 10:29:20.432162 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:29:20.432124 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e735108_ff94_4fb5_b656_330db0d456ec.slice/crio-90151574bcd63a23115c12c9ad2cc4e3eb7a8476f2549336138644363b3f631a WatchSource:0}: Error finding container 90151574bcd63a23115c12c9ad2cc4e3eb7a8476f2549336138644363b3f631a: Status 404 returned error can't find the container with id 90151574bcd63a23115c12c9ad2cc4e3eb7a8476f2549336138644363b3f631a May 28 10:29:20.671249 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:20.671153 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzpn8" event={"ID":"4e735108-ff94-4fb5-b656-330db0d456ec","Type":"ContainerStarted","Data":"90151574bcd63a23115c12c9ad2cc4e3eb7a8476f2549336138644363b3f631a"} May 28 10:29:21.134118 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.133949 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" podUID="4cce1726-ad8f-45ae-8def-9d6e7e43570d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:29:21.134118 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.134025 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" May 28 10:29:21.134778 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.134741 2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ab414bfcc587f1ed1a5846498ad343dee7758e1f7297265629ea1ad41e10bf8e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 28 10:29:21.134862 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.134804 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" podUID="4cce1726-ad8f-45ae-8def-9d6e7e43570d" containerName="service-proxy" containerID="cri-o://ab414bfcc587f1ed1a5846498ad343dee7758e1f7297265629ea1ad41e10bf8e" gracePeriod=30 May 28 10:29:21.676427 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.676392 2575 generic.go:358] "Generic (PLEG): container finished" podID="4cce1726-ad8f-45ae-8def-9d6e7e43570d" containerID="ab414bfcc587f1ed1a5846498ad343dee7758e1f7297265629ea1ad41e10bf8e" exitCode=2 May 28 10:29:21.676674 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.676468 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerDied","Data":"ab414bfcc587f1ed1a5846498ad343dee7758e1f7297265629ea1ad41e10bf8e"} May 28 10:29:21.676674 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:21.676503 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79d9547ffd-tbp2k" event={"ID":"4cce1726-ad8f-45ae-8def-9d6e7e43570d","Type":"ContainerStarted","Data":"c930b1564fb13fce79288c0f2700fa2fa17933b91d086c1018a64df7e5220077"} May 28 10:29:22.680794 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:22.680759 2575 generic.go:358] "Generic (PLEG): container finished" podID="4e735108-ff94-4fb5-b656-330db0d456ec" containerID="e606ed64e264471382db3e88e180f383d169b24a5935017a2d1c9c8b0f2950d3" exitCode=0 May 28 10:29:22.681173 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:22.680844 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzpn8" event={"ID":"4e735108-ff94-4fb5-b656-330db0d456ec","Type":"ContainerDied","Data":"e606ed64e264471382db3e88e180f383d169b24a5935017a2d1c9c8b0f2950d3"} May 28 10:29:22.807410 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:22.807378 2575 patch_prober.go:28] interesting pod/image-registry-774887b856-tfbsz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 10:29:22.807523 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:22.807433 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-774887b856-tfbsz" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 10:29:23.686029 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:23.685991 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzpn8" event={"ID":"4e735108-ff94-4fb5-b656-330db0d456ec","Type":"ContainerStarted","Data":"8714a5093a9f9e0c1258b373eed2d4df349e2b9ebc531af56e322dd51a920020"} May 28 10:29:23.686424 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:23.686036 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jzpn8" event={"ID":"4e735108-ff94-4fb5-b656-330db0d456ec","Type":"ContainerStarted","Data":"5b057ba19fb6d4ecb000ae155d5e74d7621965714df86d80224733aeefae3d47"} May 28 10:29:23.709257 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:23.709200 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jzpn8" podStartSLOduration=2.332800339 podStartE2EDuration="3.709183558s" podCreationTimestamp="2026-05-28 10:29:20 +0000 UTC" firstStartedPulling="2026-05-28 10:29:20.433982049 +0000 UTC m=+83.724425761" lastFinishedPulling="2026-05-28 10:29:21.810365268 +0000 UTC m=+85.100808980" observedRunningTime="2026-05-28 10:29:23.707352264 +0000 UTC m=+86.997796004" watchObservedRunningTime="2026-05-28 10:29:23.709183558 +0000 UTC m=+86.999627291" May 28 10:29:24.301875 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.301844 2575 scope.go:117] "RemoveContainer" containerID="99639af7af23d323a24a3f4b1e031ddb5a41ed10257ce3259551b382e7ac09dd" May 28 10:29:24.610277 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.610202 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:29:24.696262 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.693572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:29:24.696262 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.694456 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" event={"ID":"3f315ad3-baa1-4058-a8de-9cf1a5b3afb0","Type":"ContainerStarted","Data":"58c1c3dbd1660fc7a7a4419b6b684355cd95e66614f3d9cf0d774e23a3b2310b"} May 28 10:29:24.696777 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.696485 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:29:24.703176 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.703142 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" May 28 10:29:24.716703 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:24.716655 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-z2k2w" podStartSLOduration=68.712873528 podStartE2EDuration="1m21.716639291s" podCreationTimestamp="2026-05-28 10:28:03 +0000 UTC" firstStartedPulling="2026-05-28 10:28:31.136742328 +0000 UTC m=+34.427186052" lastFinishedPulling="2026-05-28 10:28:44.140508098 +0000 UTC m=+47.430951815" observedRunningTime="2026-05-28 10:29:24.715613648 +0000 UTC m=+88.006057393" watchObservedRunningTime="2026-05-28 10:29:24.716639291 +0000 UTC m=+88.007083004" May 28 10:29:30.042697 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:30.042667 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:35.059321 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.059279 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerName="registry" containerID="cri-o://362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d" gracePeriod=30 May 28 10:29:35.305729 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.305702 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:35.436381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436306 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436342 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jmtw\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436385 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436411 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436474 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436529 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436636 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436611 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436887 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436641 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets\") pod \"b9784bc0-a4b4-40f7-b319-7dc27e668598\" (UID: \"b9784bc0-a4b4-40f7-b319-7dc27e668598\") " May 28 10:29:35.436887 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436834 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:29:35.436996 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.436923 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-trusted-ca\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.437122 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.437093 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:29:35.439213 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.439176 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:29:35.439213 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.439188 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw" (OuterVolumeSpecName: "kube-api-access-4jmtw") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "kube-api-access-4jmtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:29:35.439381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.439236 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:29:35.439381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.439271 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:29:35.439381 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.439323 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:29:35.445429 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.445405 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b9784bc0-a4b4-40f7-b319-7dc27e668598" (UID: "b9784bc0-a4b4-40f7-b319-7dc27e668598"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 10:29:35.538207 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538174 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-certificates\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538207 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538203 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-bound-sa-token\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538207 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538213 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-registry-tls\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538429 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538225 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-image-registry-private-configuration\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538429 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538235 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9784bc0-a4b4-40f7-b319-7dc27e668598-installation-pull-secrets\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538429 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538246 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9784bc0-a4b4-40f7-b319-7dc27e668598-ca-trust-extracted\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.538429 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.538254 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jmtw\" (UniqueName: \"kubernetes.io/projected/b9784bc0-a4b4-40f7-b319-7dc27e668598-kube-api-access-4jmtw\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:29:35.731585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.731506 2575 generic.go:358] "Generic (PLEG): container finished" podID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerID="362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d" exitCode=0 May 28 10:29:35.731585 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.731570 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" May 28 10:29:35.731793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.731602 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" event={"ID":"b9784bc0-a4b4-40f7-b319-7dc27e668598","Type":"ContainerDied","Data":"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d"} May 28 10:29:35.731793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.731647 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58ff65d499-ff55p" event={"ID":"b9784bc0-a4b4-40f7-b319-7dc27e668598","Type":"ContainerDied","Data":"ba5cb4683ec704aaa817a1f61bc1d51dcef879e5c3f75280e9b411c911817d44"} May 28 10:29:35.731793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.731666 2575 scope.go:117] "RemoveContainer" containerID="362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d" May 28 10:29:35.744013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.743996 2575 scope.go:117] "RemoveContainer" containerID="362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d" May 28 10:29:35.744276 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:29:35.744252 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d\": container with ID starting with 362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d not found: ID does not exist" containerID="362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d" May 28 10:29:35.744368 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.744278 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d"} err="failed to get container status \"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d\": rpc error: code = NotFound desc = could not find container \"362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d\": container with ID starting with 362890ef631aa3f2630f1e0dc5f90217935a661ebbd4898b6a2ded741c64de5d not found: ID does not exist" May 28 10:29:35.758923 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.758898 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:29:35.762817 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:35.762794 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58ff65d499-ff55p"] May 28 10:29:36.378045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:36.378009 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:29:37.305673 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:37.305639 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" path="/var/lib/kubelet/pods/b9784bc0-a4b4-40f7-b319-7dc27e668598/volumes" May 28 10:29:55.806044 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.806010 2575 generic.go:358] "Generic (PLEG): container finished" podID="7e3c08e6-521f-4f1d-9634-bbc2f80725bd" containerID="ef0c8c4e83e442b2aa15117cddbf4e918ffa94b525e89163b51d38e84ebcdb69" exitCode=0 May 28 10:29:55.806541 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.806084 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" event={"ID":"7e3c08e6-521f-4f1d-9634-bbc2f80725bd","Type":"ContainerDied","Data":"ef0c8c4e83e442b2aa15117cddbf4e918ffa94b525e89163b51d38e84ebcdb69"} May 28 10:29:55.806541 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.806509 2575 scope.go:117] "RemoveContainer" containerID="ef0c8c4e83e442b2aa15117cddbf4e918ffa94b525e89163b51d38e84ebcdb69" May 28 10:29:55.807521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.807497 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa0e5fd1-425c-4549-bd9a-4c51393ddc18" containerID="347e98f89a116fb3a8ed14450dfb81f6b2030e534611de4e6f6ca4d2efcde388" exitCode=0 May 28 10:29:55.807647 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.807528 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" event={"ID":"fa0e5fd1-425c-4549-bd9a-4c51393ddc18","Type":"ContainerDied","Data":"347e98f89a116fb3a8ed14450dfb81f6b2030e534611de4e6f6ca4d2efcde388"} May 28 10:29:55.807822 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:55.807807 2575 scope.go:117] "RemoveContainer" containerID="347e98f89a116fb3a8ed14450dfb81f6b2030e534611de4e6f6ca4d2efcde388" May 28 10:29:56.812142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:56.812106 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5w569" event={"ID":"7e3c08e6-521f-4f1d-9634-bbc2f80725bd","Type":"ContainerStarted","Data":"fa3dfd71eb84cc0b73d07d69307bb41d0cc94965910761efe31127f0460e2be8"} May 28 10:29:56.813617 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:56.813595 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gfcfd" event={"ID":"fa0e5fd1-425c-4549-bd9a-4c51393ddc18","Type":"ContainerStarted","Data":"7bcdffbbe58f08c40c3821f6076e341658d76cd75e3fb064340745da30994bff"} May 28 10:29:58.733630 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:58.733567 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-x6wb6_ecc9809a-ded4-4014-8677-92aa621fcd51/cluster-monitoring-operator/0.log" May 28 10:29:59.930604 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:29:59.930577 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/init-textfile/0.log" May 28 10:30:00.132777 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:00.132739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/node-exporter/0.log" May 28 10:30:00.333490 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:00.333456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/kube-rbac-proxy/0.log" May 28 10:30:01.402333 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.402268 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-774887b856-tfbsz" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerName="registry" containerID="cri-o://823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05" gracePeriod=30 May 28 10:30:01.651800 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.651776 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:30:01.768912 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.768882 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769089 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.768929 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769089 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.768962 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769089 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769030 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769089 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769076 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769299 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769110 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769355 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769313 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769410 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769372 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjm4s\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s\") pod \"b3e232da-fb85-4989-8c4c-112a5bbceaae\" (UID: \"b3e232da-fb85-4989-8c4c-112a5bbceaae\") " May 28 10:30:01.769701 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769663 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:30:01.769866 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.769731 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:30:01.771698 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.771665 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:30:01.771698 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.771687 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:30:01.771884 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.771867 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:30:01.772066 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.772046 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s" (OuterVolumeSpecName: "kube-api-access-kjm4s") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "kube-api-access-kjm4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:30:01.772127 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.772046 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:30:01.777518 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.777495 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b3e232da-fb85-4989-8c4c-112a5bbceaae" (UID: "b3e232da-fb85-4989-8c4c-112a5bbceaae"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 10:30:01.829314 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.829282 2575 generic.go:358] "Generic (PLEG): container finished" podID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerID="823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05" exitCode=0 May 28 10:30:01.829514 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.829345 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774887b856-tfbsz" May 28 10:30:01.829514 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.829350 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774887b856-tfbsz" event={"ID":"b3e232da-fb85-4989-8c4c-112a5bbceaae","Type":"ContainerDied","Data":"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05"} May 28 10:30:01.829514 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.829466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774887b856-tfbsz" event={"ID":"b3e232da-fb85-4989-8c4c-112a5bbceaae","Type":"ContainerDied","Data":"a50a0de4c327e134713a39478fc13dbe6425c21f17790c76e3334c4c585fd0d4"} May 28 10:30:01.829514 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.829483 2575 scope.go:117] "RemoveContainer" containerID="823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05" May 28 10:30:01.837564 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.837538 2575 scope.go:117] "RemoveContainer" containerID="823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05" May 28 10:30:01.837834 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:30:01.837806 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05\": container with ID starting with 823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05 not found: ID does not exist" containerID="823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05" May 28 10:30:01.837920 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.837841 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05"} err="failed to get container status \"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05\": rpc error: code = NotFound desc = could not find container \"823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05\": container with ID starting with 823fd81528920c480344749e9a76bcf9d1f0d642553861b1678d29b58fb1af05 not found: ID does not exist" May 28 10:30:01.851127 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.851102 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:30:01.857455 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.857418 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-774887b856-tfbsz"] May 28 10:30:01.870288 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870260 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-installation-pull-secrets\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870288 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870289 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-bound-sa-token\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870301 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-certificates\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870310 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjm4s\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-kube-api-access-kjm4s\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870320 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3e232da-fb85-4989-8c4c-112a5bbceaae-registry-tls\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870328 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3e232da-fb85-4989-8c4c-112a5bbceaae-ca-trust-extracted\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870338 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3e232da-fb85-4989-8c4c-112a5bbceaae-image-registry-private-configuration\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:01.870477 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:01.870349 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3e232da-fb85-4989-8c4c-112a5bbceaae-trusted-ca\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 10:30:03.305434 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:03.305401 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" path="/var/lib/kubelet/pods/b3e232da-fb85-4989-8c4c-112a5bbceaae/volumes" May 28 10:30:03.733738 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:03.733658 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sbms5_63f1537c-08ae-44ab-a9f0-a8c5737c3ee5/prometheus-operator/0.log" May 28 10:30:03.931767 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:03.931733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sbms5_63f1537c-08ae-44ab-a9f0-a8c5737c3ee5/kube-rbac-proxy/0.log" May 28 10:30:04.131821 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:04.131779 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t_43bd528f-f386-473b-924b-e34b00eaf47e/prometheus-operator-admission-webhook/0.log" May 28 10:30:06.130995 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:06.130966 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-8fmp6_575b7b1f-022c-40f7-bd5a-671842bd0538/networking-console-plugin/0.log" May 28 10:30:06.331613 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:06.331586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:30:06.534968 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:06.534936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/3.log" May 28 10:30:07.332069 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:07.332035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f48bffccb-ttlfn_d6bf45d4-7a06-49e5-add6-5c52b3aafc37/router/0.log" May 28 10:30:07.534760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:07.534727 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p698z_10d98d32-e339-41e8-807a-7331f43e7659/serve-healthcheck-canary/0.log" May 28 10:30:15.878231 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:15.878193 2575 generic.go:358] "Generic (PLEG): container finished" podID="864d8c9a-fd9a-4771-84cd-3014c52ed589" containerID="5eb5e3eaa5a5e2359f12ca69dbdd487c59021fd3c66cabc8e4c3ac163476b809" exitCode=0 May 28 10:30:15.878622 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:15.878268 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" event={"ID":"864d8c9a-fd9a-4771-84cd-3014c52ed589","Type":"ContainerDied","Data":"5eb5e3eaa5a5e2359f12ca69dbdd487c59021fd3c66cabc8e4c3ac163476b809"} May 28 10:30:15.878665 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:15.878624 2575 scope.go:117] "RemoveContainer" containerID="5eb5e3eaa5a5e2359f12ca69dbdd487c59021fd3c66cabc8e4c3ac163476b809" May 28 10:30:16.883328 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:30:16.883290 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xvc97" event={"ID":"864d8c9a-fd9a-4771-84cd-3014c52ed589","Type":"ContainerStarted","Data":"b2b104b12a6236099818f3fbb76810d22cedab633ddf5cb6c4d9fefff1e1d393"} May 28 10:32:00.418715 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.418669 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8"] May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419093 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerName="registry" May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419111 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerName="registry" May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419149 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerName="registry" May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419158 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerName="registry" May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419236 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3e232da-fb85-4989-8c4c-112a5bbceaae" containerName="registry" May 28 10:32:00.419285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.419253 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9784bc0-a4b4-40f7-b319-7dc27e668598" containerName="registry" May 28 10:32:00.422210 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.422187 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.426143 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.426117 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 10:32:00.426261 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.426145 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 10:32:00.426261 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.426159 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 10:32:00.426550 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.426535 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l2lm6\"" May 28 10:32:00.426626 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.426611 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 10:32:00.445584 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.445558 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8"] May 28 10:32:00.572045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.572003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.572239 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.572048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tdn\" (UniqueName: \"kubernetes.io/projected/e572fe5d-14df-4e1d-bcb2-ac57950a0378-kube-api-access-z7tdn\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.572239 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.572100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-webhook-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.673577 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.673490 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.673577 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.673528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tdn\" (UniqueName: \"kubernetes.io/projected/e572fe5d-14df-4e1d-bcb2-ac57950a0378-kube-api-access-z7tdn\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.673577 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.673554 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-webhook-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.676038 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.676008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.676038 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.676036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e572fe5d-14df-4e1d-bcb2-ac57950a0378-webhook-cert\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.684854 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.684831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tdn\" (UniqueName: \"kubernetes.io/projected/e572fe5d-14df-4e1d-bcb2-ac57950a0378-kube-api-access-z7tdn\") pod \"opendatahub-operator-controller-manager-65df8896fb-r29c8\" (UID: \"e572fe5d-14df-4e1d-bcb2-ac57950a0378\") " pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.731973 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.731943 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:00.885639 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:00.885600 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8"] May 28 10:32:00.891833 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:32:00.891803 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode572fe5d_14df_4e1d_bcb2_ac57950a0378.slice/crio-58fe32c482fccb16d539572311d11b6aa59dada3c032e24dc7cb1980e481efe6 WatchSource:0}: Error finding container 58fe32c482fccb16d539572311d11b6aa59dada3c032e24dc7cb1980e481efe6: Status 404 returned error can't find the container with id 58fe32c482fccb16d539572311d11b6aa59dada3c032e24dc7cb1980e481efe6 May 28 10:32:01.189768 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:01.189727 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" event={"ID":"e572fe5d-14df-4e1d-bcb2-ac57950a0378","Type":"ContainerStarted","Data":"58fe32c482fccb16d539572311d11b6aa59dada3c032e24dc7cb1980e481efe6"} May 28 10:32:04.202177 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:04.202143 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" event={"ID":"e572fe5d-14df-4e1d-bcb2-ac57950a0378","Type":"ContainerStarted","Data":"fa2feb0162b5261a2476c2a3ea750ad7e654b67206f21f2f212d8ee15cbf4fbf"} May 28 10:32:04.202612 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:04.202277 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:04.241515 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:04.241467 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" podStartSLOduration=1.675367877 podStartE2EDuration="4.241424823s" podCreationTimestamp="2026-05-28 10:32:00 +0000 UTC" firstStartedPulling="2026-05-28 10:32:00.893466188 +0000 UTC m=+244.183909901" lastFinishedPulling="2026-05-28 10:32:03.459523123 +0000 UTC m=+246.749966847" observedRunningTime="2026-05-28 10:32:04.240260766 +0000 UTC m=+247.530704493" watchObservedRunningTime="2026-05-28 10:32:04.241424823 +0000 UTC m=+247.531868558" May 28 10:32:15.208599 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:15.208527 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65df8896fb-r29c8" May 28 10:32:19.703369 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.703330 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5df4974f78-l7g99"] May 28 10:32:19.706664 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.706646 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.710382 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.710360 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 28 10:32:19.710510 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.710473 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dbp7l\"" May 28 10:32:19.712072 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.712053 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 28 10:32:19.721185 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.721160 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df4974f78-l7g99"] May 28 10:32:19.840319 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.840276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844ef598-d7b1-4301-873f-5b64afe42d13-tls-certs\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.840555 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.840334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844ef598-d7b1-4301-873f-5b64afe42d13-tmp\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.840555 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.840424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7nc\" (UniqueName: \"kubernetes.io/projected/844ef598-d7b1-4301-873f-5b64afe42d13-kube-api-access-ht7nc\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.941192 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.941155 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7nc\" (UniqueName: \"kubernetes.io/projected/844ef598-d7b1-4301-873f-5b64afe42d13-kube-api-access-ht7nc\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.941363 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.941205 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844ef598-d7b1-4301-873f-5b64afe42d13-tls-certs\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.941363 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.941248 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844ef598-d7b1-4301-873f-5b64afe42d13-tmp\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.943556 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.943527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844ef598-d7b1-4301-873f-5b64afe42d13-tmp\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.943773 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.943752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844ef598-d7b1-4301-873f-5b64afe42d13-tls-certs\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:19.949580 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:19.949558 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7nc\" (UniqueName: \"kubernetes.io/projected/844ef598-d7b1-4301-873f-5b64afe42d13-kube-api-access-ht7nc\") pod \"kube-auth-proxy-5df4974f78-l7g99\" (UID: \"844ef598-d7b1-4301-873f-5b64afe42d13\") " pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:20.017122 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:20.017077 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" May 28 10:32:20.148142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:20.148114 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df4974f78-l7g99"] May 28 10:32:20.152229 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:32:20.152196 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844ef598_d7b1_4301_873f_5b64afe42d13.slice/crio-fb15e0b9bdfc293b229cd0a1b12fe710d0e0ec75eb09f48ef4ed810a885d6f3d WatchSource:0}: Error finding container fb15e0b9bdfc293b229cd0a1b12fe710d0e0ec75eb09f48ef4ed810a885d6f3d: Status 404 returned error can't find the container with id fb15e0b9bdfc293b229cd0a1b12fe710d0e0ec75eb09f48ef4ed810a885d6f3d May 28 10:32:20.255175 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:20.255136 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" event={"ID":"844ef598-d7b1-4301-873f-5b64afe42d13","Type":"ContainerStarted","Data":"fb15e0b9bdfc293b229cd0a1b12fe710d0e0ec75eb09f48ef4ed810a885d6f3d"} May 28 10:32:24.272604 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:24.272558 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" event={"ID":"844ef598-d7b1-4301-873f-5b64afe42d13","Type":"ContainerStarted","Data":"4ed3daa99a59171f34c205081cd9311adbe6d384b7c4f5233ad161ebe18914f7"} May 28 10:32:28.653868 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.653657 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5df4974f78-l7g99" podStartSLOduration=6.157617731 podStartE2EDuration="9.653639767s" podCreationTimestamp="2026-05-28 10:32:19 +0000 UTC" firstStartedPulling="2026-05-28 10:32:20.154222256 +0000 UTC m=+263.444665984" lastFinishedPulling="2026-05-28 10:32:23.650244305 +0000 UTC m=+266.940688020" observedRunningTime="2026-05-28 10:32:24.291565287 +0000 UTC m=+267.582009021" watchObservedRunningTime="2026-05-28 10:32:28.653639767 +0000 UTC m=+271.944083500" May 28 10:32:28.655414 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.655389 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qnslx"] May 28 10:32:28.658863 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.658845 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:28.662193 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.662172 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 28 10:32:28.663898 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.663878 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zlmdl\"" May 28 10:32:28.676873 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.676846 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qnslx"] May 28 10:32:28.702241 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.702206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:28.702400 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.702265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmx92\" (UniqueName: \"kubernetes.io/projected/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-kube-api-access-hmx92\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:28.803433 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.803398 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmx92\" (UniqueName: \"kubernetes.io/projected/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-kube-api-access-hmx92\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:28.803602 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.803519 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:28.803661 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:32:28.803648 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 28 10:32:28.803730 ip-10-0-141-178 kubenswrapper[2575]: E0528 10:32:28.803720 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert podName:6bfaad13-e84b-4636-8cb4-78b4fb43c5e4 nodeName:}" failed. No retries permitted until 2026-05-28 10:32:29.303699187 +0000 UTC m=+272.594142903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert") pod "kserve-controller-manager-856948b99f-qnslx" (UID: "6bfaad13-e84b-4636-8cb4-78b4fb43c5e4") : secret "kserve-webhook-server-cert" not found May 28 10:32:28.815084 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:28.815056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmx92\" (UniqueName: \"kubernetes.io/projected/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-kube-api-access-hmx92\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:29.307510 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:29.307479 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:29.309826 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:29.309808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bfaad13-e84b-4636-8cb4-78b4fb43c5e4-cert\") pod \"kserve-controller-manager-856948b99f-qnslx\" (UID: \"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4\") " pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:29.570629 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:29.570526 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:29.713311 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:29.713282 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-qnslx"] May 28 10:32:29.715941 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:32:29.715913 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfaad13_e84b_4636_8cb4_78b4fb43c5e4.slice/crio-dc4dfdd0836dc0f2aa8ba34df5ab979765d4d06b06bb23017e9cc177a0c67428 WatchSource:0}: Error finding container dc4dfdd0836dc0f2aa8ba34df5ab979765d4d06b06bb23017e9cc177a0c67428: Status 404 returned error can't find the container with id dc4dfdd0836dc0f2aa8ba34df5ab979765d4d06b06bb23017e9cc177a0c67428 May 28 10:32:30.292854 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:30.292807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" event={"ID":"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4","Type":"ContainerStarted","Data":"dc4dfdd0836dc0f2aa8ba34df5ab979765d4d06b06bb23017e9cc177a0c67428"} May 28 10:32:34.309900 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:34.309859 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" event={"ID":"6bfaad13-e84b-4636-8cb4-78b4fb43c5e4","Type":"ContainerStarted","Data":"8fc80d0862458509e03ae934b974d504eaa3d049efaf7067256b268004b0a4d9"} May 28 10:32:34.310386 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:34.309922 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:32:34.548815 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:34.548760 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" podStartSLOduration=2.871164437 podStartE2EDuration="6.548743535s" podCreationTimestamp="2026-05-28 10:32:28 +0000 UTC" firstStartedPulling="2026-05-28 10:32:29.717279166 +0000 UTC m=+273.007722884" lastFinishedPulling="2026-05-28 10:32:33.394858267 +0000 UTC m=+276.685301982" observedRunningTime="2026-05-28 10:32:34.547609356 +0000 UTC m=+277.838053091" watchObservedRunningTime="2026-05-28 10:32:34.548743535 +0000 UTC m=+277.839187268" May 28 10:32:57.223474 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:57.223423 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:32:57.224068 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:57.223523 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:32:57.236576 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:32:57.236550 2575 kubelet.go:1628] "Image garbage collection succeeded" May 28 10:33:03.974248 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.974213 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc"] May 28 10:33:03.977608 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.977594 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:03.984244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.984220 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 28 10:33:03.984372 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.984319 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 28 10:33:03.984462 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.984320 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 28 10:33:03.984462 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.984325 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 28 10:33:03.984462 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.984328 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fl6vf\"" May 28 10:33:03.992282 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:03.992260 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc"] May 28 10:33:04.104760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.104710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ec4634-ea32-49f6-84f7-9f34698351cb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.104760 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.104760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.105013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.104847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.105013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.104913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwj5m\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-kube-api-access-gwj5m\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.105013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.104966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.105013 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.105009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.105166 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.105035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206227 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206190 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ec4634-ea32-49f6-84f7-9f34698351cb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206227 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206229 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206482 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206246 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206482 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206277 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwj5m\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-kube-api-access-gwj5m\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206482 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206602 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206489 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.206602 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.207008 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.206973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.208807 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.208775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5ec4634-ea32-49f6-84f7-9f34698351cb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.208918 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.208808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.208918 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.208781 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.209009 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.208930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.214888 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.214868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.217536 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.217513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwj5m\" (UniqueName: \"kubernetes.io/projected/b5ec4634-ea32-49f6-84f7-9f34698351cb-kube-api-access-gwj5m\") pod \"istiod-openshift-gateway-798958bb55-x6fqc\" (UID: \"b5ec4634-ea32-49f6-84f7-9f34698351cb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.286241 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.286209 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:04.432839 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.432808 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc"] May 28 10:33:04.434041 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:33:04.434009 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ec4634_ea32_49f6_84f7_9f34698351cb.slice/crio-f920f4a66a1ad9c3dae6cfd86239e312f6a7e90abd9f9b67c82d36b41e31984c WatchSource:0}: Error finding container f920f4a66a1ad9c3dae6cfd86239e312f6a7e90abd9f9b67c82d36b41e31984c: Status 404 returned error can't find the container with id f920f4a66a1ad9c3dae6cfd86239e312f6a7e90abd9f9b67c82d36b41e31984c May 28 10:33:04.436137 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:04.436117 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 10:33:05.318348 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:05.318323 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-qnslx" May 28 10:33:05.407468 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:05.407396 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" event={"ID":"b5ec4634-ea32-49f6-84f7-9f34698351cb","Type":"ContainerStarted","Data":"f920f4a66a1ad9c3dae6cfd86239e312f6a7e90abd9f9b67c82d36b41e31984c"} May 28 10:33:07.385661 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:07.385620 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 10:33:07.386038 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:07.385699 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 28 10:33:08.419047 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:08.418998 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" event={"ID":"b5ec4634-ea32-49f6-84f7-9f34698351cb","Type":"ContainerStarted","Data":"4ec64aab21de6b991b236b822145830ea88793986ed1cc464d29c6c95618ba92"} May 28 10:33:08.419565 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:08.419212 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:08.420808 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:08.420787 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" May 28 10:33:08.443535 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:08.443491 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x6fqc" podStartSLOduration=2.494666221 podStartE2EDuration="5.443477917s" podCreationTimestamp="2026-05-28 10:33:03 +0000 UTC" firstStartedPulling="2026-05-28 10:33:04.436575744 +0000 UTC m=+307.727019467" lastFinishedPulling="2026-05-28 10:33:07.385387448 +0000 UTC m=+310.675831163" observedRunningTime="2026-05-28 10:33:08.442946572 +0000 UTC m=+311.733390306" watchObservedRunningTime="2026-05-28 10:33:08.443477917 +0000 UTC m=+311.733921651" May 28 10:33:58.214882 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.214853 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gh6rg"] May 28 10:33:58.223614 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.223587 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:33:58.227080 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.227055 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 10:33:58.227223 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.227125 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49mcp\"" May 28 10:33:58.228035 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.228018 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 10:33:58.250803 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.250772 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gh6rg"] May 28 10:33:58.377145 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.377103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkvps\" (UniqueName: \"kubernetes.io/projected/b2ff83f3-fe17-45c2-badd-c3e8ce194188-kube-api-access-hkvps\") pod \"authorino-operator-657f44b778-gh6rg\" (UID: \"b2ff83f3-fe17-45c2-badd-c3e8ce194188\") " pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:33:58.478676 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.478584 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkvps\" (UniqueName: \"kubernetes.io/projected/b2ff83f3-fe17-45c2-badd-c3e8ce194188-kube-api-access-hkvps\") pod \"authorino-operator-657f44b778-gh6rg\" (UID: \"b2ff83f3-fe17-45c2-badd-c3e8ce194188\") " pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:33:58.487980 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.487947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkvps\" (UniqueName: \"kubernetes.io/projected/b2ff83f3-fe17-45c2-badd-c3e8ce194188-kube-api-access-hkvps\") pod \"authorino-operator-657f44b778-gh6rg\" (UID: \"b2ff83f3-fe17-45c2-badd-c3e8ce194188\") " pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:33:58.534344 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.534305 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:33:58.665242 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:58.665210 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gh6rg"] May 28 10:33:58.668969 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:33:58.668939 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ff83f3_fe17_45c2_badd_c3e8ce194188.slice/crio-d7064ea529c1ef45be70af12a110cc037de5cc22e2a70f9e3552db742526149e WatchSource:0}: Error finding container d7064ea529c1ef45be70af12a110cc037de5cc22e2a70f9e3552db742526149e: Status 404 returned error can't find the container with id d7064ea529c1ef45be70af12a110cc037de5cc22e2a70f9e3552db742526149e May 28 10:33:59.589512 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:33:59.589475 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" event={"ID":"b2ff83f3-fe17-45c2-badd-c3e8ce194188","Type":"ContainerStarted","Data":"d7064ea529c1ef45be70af12a110cc037de5cc22e2a70f9e3552db742526149e"} May 28 10:34:01.598372 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:01.598321 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" event={"ID":"b2ff83f3-fe17-45c2-badd-c3e8ce194188","Type":"ContainerStarted","Data":"c799fc01a32e25da510cdfb59ee70b7bd2370873b715f63cef7fe7a26d8d2cc0"} May 28 10:34:01.598824 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:01.598390 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:34:01.626039 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:01.625990 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" podStartSLOduration=1.629047315 podStartE2EDuration="3.625976159s" podCreationTimestamp="2026-05-28 10:33:58 +0000 UTC" firstStartedPulling="2026-05-28 10:33:58.673905934 +0000 UTC m=+361.964349646" lastFinishedPulling="2026-05-28 10:34:00.670834776 +0000 UTC m=+363.961278490" observedRunningTime="2026-05-28 10:34:01.62296448 +0000 UTC m=+364.913408214" watchObservedRunningTime="2026-05-28 10:34:01.625976159 +0000 UTC m=+364.916419892" May 28 10:34:12.605570 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:12.605533 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-gh6rg" May 28 10:34:46.407063 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.407023 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:34:46.410503 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.410482 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.413249 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.413224 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 10:34:46.413249 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.413236 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vcw4r\"" May 28 10:34:46.420709 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.420685 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:34:46.458010 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.457976 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:34:46.495521 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.495482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f6ed3b8-b368-48a8-acae-adde001130c3-config-file\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.495662 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.495536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gcql\" (UniqueName: \"kubernetes.io/projected/5f6ed3b8-b368-48a8-acae-adde001130c3-kube-api-access-6gcql\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.596293 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.596259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f6ed3b8-b368-48a8-acae-adde001130c3-config-file\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.596507 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.596303 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gcql\" (UniqueName: \"kubernetes.io/projected/5f6ed3b8-b368-48a8-acae-adde001130c3-kube-api-access-6gcql\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.596914 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.596894 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f6ed3b8-b368-48a8-acae-adde001130c3-config-file\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.605640 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.605614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gcql\" (UniqueName: \"kubernetes.io/projected/5f6ed3b8-b368-48a8-acae-adde001130c3-kube-api-access-6gcql\") pod \"limitador-limitador-78c99df468-5pdld\" (UID: \"5f6ed3b8-b368-48a8-acae-adde001130c3\") " pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.721796 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.721711 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:34:46.854023 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:46.853997 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:34:46.855864 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:34:46.855833 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6ed3b8_b368_48a8_acae_adde001130c3.slice/crio-1c982b23b8f9dea630b192dfc439f863c901724576e2935121e0b2d51eb619f7 WatchSource:0}: Error finding container 1c982b23b8f9dea630b192dfc439f863c901724576e2935121e0b2d51eb619f7: Status 404 returned error can't find the container with id 1c982b23b8f9dea630b192dfc439f863c901724576e2935121e0b2d51eb619f7 May 28 10:34:47.762608 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:47.762564 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" event={"ID":"5f6ed3b8-b368-48a8-acae-adde001130c3","Type":"ContainerStarted","Data":"1c982b23b8f9dea630b192dfc439f863c901724576e2935121e0b2d51eb619f7"} May 28 10:34:49.772433 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:49.772391 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" event={"ID":"5f6ed3b8-b368-48a8-acae-adde001130c3","Type":"ContainerStarted","Data":"42e01eba819b5dbab9f32a57c68b0c893f77e2a9ac809306ff137a1204864048"} May 28 10:34:49.791457 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:49.791343 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" podStartSLOduration=1.116570527 podStartE2EDuration="3.791328207s" podCreationTimestamp="2026-05-28 10:34:46 +0000 UTC" firstStartedPulling="2026-05-28 10:34:46.857562429 +0000 UTC m=+410.148006144" lastFinishedPulling="2026-05-28 10:34:49.532320112 +0000 UTC m=+412.822763824" observedRunningTime="2026-05-28 10:34:49.790024106 +0000 UTC m=+413.080467840" watchObservedRunningTime="2026-05-28 10:34:49.791328207 +0000 UTC m=+413.081771940" May 28 10:34:50.775634 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:34:50.775605 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:35:01.780559 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:35:01.780528 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5pdld" May 28 10:35:58.867030 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:35:58.866993 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:36:33.818285 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:33.818248 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:36:36.194599 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:36.194562 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:36:54.488744 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.488656 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:36:54.874130 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.874043 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk"] May 28 10:36:54.877624 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.877606 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.880382 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.880358 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 10:36:54.881466 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.881425 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 10:36:54.881562 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.881490 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 28 10:36:54.881562 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.881505 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zjds8\"" May 28 10:36:54.888081 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.888059 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk"] May 28 10:36:54.891758 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d170f84-713a-45e7-9261-9b3f22a7fe9e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.891858 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.891858 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.891972 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.891972 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9jsg\" (UniqueName: \"kubernetes.io/projected/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kube-api-access-n9jsg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.891972 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.891944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993049 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993018 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d170f84-713a-45e7-9261-9b3f22a7fe9e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993188 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993188 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993081 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993188 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993103 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993188 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993138 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9jsg\" (UniqueName: \"kubernetes.io/projected/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kube-api-access-n9jsg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993188 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993549 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993579 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.993717 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.993608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.995427 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.995400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d170f84-713a-45e7-9261-9b3f22a7fe9e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:54.995566 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:54.995516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d170f84-713a-45e7-9261-9b3f22a7fe9e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:55.001581 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:55.001559 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9jsg\" (UniqueName: \"kubernetes.io/projected/3d170f84-713a-45e7-9261-9b3f22a7fe9e-kube-api-access-n9jsg\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk\" (UID: \"3d170f84-713a-45e7-9261-9b3f22a7fe9e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:55.188933 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:55.188849 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:36:55.336190 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:55.336134 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk"] May 28 10:36:55.337629 ip-10-0-141-178 kubenswrapper[2575]: W0528 10:36:55.337593 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d170f84_713a_45e7_9261_9b3f22a7fe9e.slice/crio-9298983fed658a30e2b96f2392dac60d2d72dea3376d6ff2ffc92fb0bb1daa28 WatchSource:0}: Error finding container 9298983fed658a30e2b96f2392dac60d2d72dea3376d6ff2ffc92fb0bb1daa28: Status 404 returned error can't find the container with id 9298983fed658a30e2b96f2392dac60d2d72dea3376d6ff2ffc92fb0bb1daa28 May 28 10:36:56.210373 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:56.210341 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" event={"ID":"3d170f84-713a-45e7-9261-9b3f22a7fe9e","Type":"ContainerStarted","Data":"9298983fed658a30e2b96f2392dac60d2d72dea3376d6ff2ffc92fb0bb1daa28"} May 28 10:36:59.292728 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:36:59.292676 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:37:01.233174 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:01.233132 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" event={"ID":"3d170f84-713a-45e7-9261-9b3f22a7fe9e","Type":"ContainerStarted","Data":"294b6828cd279d9cb904c98a75609a5b15c61975d8355d2eb3efdd4100aa3807"} May 28 10:37:06.252309 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:06.252277 2575 generic.go:358] "Generic (PLEG): container finished" podID="3d170f84-713a-45e7-9261-9b3f22a7fe9e" containerID="294b6828cd279d9cb904c98a75609a5b15c61975d8355d2eb3efdd4100aa3807" exitCode=0 May 28 10:37:06.252709 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:06.252352 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" event={"ID":"3d170f84-713a-45e7-9261-9b3f22a7fe9e","Type":"ContainerDied","Data":"294b6828cd279d9cb904c98a75609a5b15c61975d8355d2eb3efdd4100aa3807"} May 28 10:37:08.260905 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:08.260869 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" event={"ID":"3d170f84-713a-45e7-9261-9b3f22a7fe9e","Type":"ContainerStarted","Data":"05ddf5a0c95b91130a6d69461d8bb487d48c3f433d8f6d6b650379f27494be54"} May 28 10:37:08.261308 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:08.261075 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:37:08.281621 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:08.281579 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" podStartSLOduration=2.173369486 podStartE2EDuration="14.281567527s" podCreationTimestamp="2026-05-28 10:36:54 +0000 UTC" firstStartedPulling="2026-05-28 10:36:55.339827822 +0000 UTC m=+538.630271538" lastFinishedPulling="2026-05-28 10:37:07.448025867 +0000 UTC m=+550.738469579" observedRunningTime="2026-05-28 10:37:08.279188316 +0000 UTC m=+551.569632046" watchObservedRunningTime="2026-05-28 10:37:08.281567527 +0000 UTC m=+551.572011261" May 28 10:37:19.276936 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:19.276902 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk" May 28 10:37:57.254305 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:57.254271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:37:57.255325 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:37:57.255308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:38:13.523847 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:38:13.523678 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:38:24.997056 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:38:24.997015 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:38:34.107296 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:38:34.107259 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:38:43.992124 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:38:43.992085 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:38:52.328144 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:38:52.328109 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:39:03.430502 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:39:03.430464 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:39:35.299371 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:39:35.299332 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:39:40.052577 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:39:40.052488 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:40:15.897426 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:40:15.897389 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:40:31.301419 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:40:31.301384 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:41:10.291923 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:41:10.291826 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:41:26.487766 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:41:26.487729 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:41:42.389074 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:41:42.389034 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:41:58.584335 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:41:58.584292 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:42:51.994691 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:42:51.994600 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:42:57.278506 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:42:57.278481 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:42:57.280270 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:42:57.280250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:43:02.100166 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:43:02.100128 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:43:18.499693 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:43:18.499652 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:43:26.991086 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:43:26.991045 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:43:43.186305 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:43:43.186268 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:43:51.395120 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:43:51.395085 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:44:24.793957 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:44:24.793868 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:44:32.789472 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:44:32.789421 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:44:41.697142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:44:41.697102 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:44:50.485187 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:44:50.485147 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:44:57.894457 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:44:57.894400 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:45:15.400226 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:45:15.400186 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:45:26.779567 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:45:26.779532 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:14.494336 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:14.494296 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:19.591638 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:19.591599 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:26.386688 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:26.386647 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:34.176228 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:34.176191 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:43.708212 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:43.708179 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:46:52.707086 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:46:52.707052 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:01.805115 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:01.805075 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:10.194343 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:10.194251 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:18.796220 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:18.796179 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:26.994284 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:26.994249 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:36.889132 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:36.889091 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:45.291738 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:45.291700 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:54.587812 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:54.587771 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:47:57.306305 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:57.306278 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:47:57.307690 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:47:57.307665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:48:02.388916 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:48:02.388886 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:48:10.792667 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:48:10.792632 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:48:19.590764 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:48:19.590725 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:48:29.383422 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:48:29.383383 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:48:36.386820 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:48:36.386783 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:50:53.890070 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:50:53.890030 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:50:59.289427 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:50:59.289394 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:51:24.492935 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:51:24.492899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:51:31.745069 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:51:31.745030 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:51:40.787492 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:51:40.787392 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:51:52.308310 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:51:52.308272 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:00.590589 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:00.590554 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:10.693955 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:10.693916 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:20.398210 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:20.398176 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:29.691624 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:29.691582 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:39.185217 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:39.185182 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:49.984366 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:49.984329 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:52:57.328159 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:57.328125 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:52:57.331647 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:57.331624 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:52:59.091362 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:52:59.091326 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:53:34.294562 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:53:34.294527 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:54:16.925164 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:54:16.925128 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:54:25.294018 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:54:25.293979 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:54:34.098323 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:54:34.098288 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:54:42.609129 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:54:42.609044 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:54:50.697574 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:54:50.697540 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:03.930927 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:03.930891 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:12.799651 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:12.799617 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:21.295630 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:21.295592 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:29.409171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:29.409137 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:38.014096 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:38.014060 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:46.191464 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:46.191405 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:55:56.590792 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:55:56.590753 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:56:14.701103 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:56:14.701026 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:56:22.996788 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:56:22.996747 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:56:31.115929 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:56:31.115886 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:56:39.529513 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:56:39.529472 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:56:56.399503 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:56:56.399465 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:04.746614 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:04.746577 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:13.798727 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:13.798692 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:22.390280 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:22.390243 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:32.027793 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:32.027753 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:40.423037 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:40.422947 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:49.095931 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:49.095895 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:57:57.350648 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:57.350617 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:57:57.356061 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:57:57.356034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 10:58:02.402095 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:02.402059 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:11.697142 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:11.697089 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:25.224045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:25.224006 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:33.499171 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:33.499135 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:40.698842 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:40.698806 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:50.502522 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:50.502484 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:58:58.697415 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:58:58.697379 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:59:14.300916 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:14.300827 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:59:23.193571 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:23.193526 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5pdld"] May 28 10:59:39.311278 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:39.311237 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-qnslx_6bfaad13-e84b-4636-8cb4-78b4fb43c5e4/manager/0.log" May 28 10:59:40.009728 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:40.009693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65df8896fb-r29c8_e572fe5d-14df-4e1d-bcb2-ac57950a0378/manager/0.log" May 28 10:59:41.587244 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:41.587211 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-gh6rg_b2ff83f3-fe17-45c2-badd-c3e8ce194188/manager/0.log" May 28 10:59:42.129048 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:42.129020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5pdld_5f6ed3b8-b368-48a8-acae-adde001130c3/limitador/0.log" May 28 10:59:42.702611 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:42.702577 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-x6fqc_b5ec4634-ea32-49f6-84f7-9f34698351cb/discovery/0.log" May 28 10:59:42.911498 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:42.911466 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df4974f78-l7g99_844ef598-d7b1-4301-873f-5b64afe42d13/kube-auth-proxy/0.log" May 28 10:59:43.260263 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:43.260232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f48bffccb-ttlfn_d6bf45d4-7a06-49e5-add6-5c52b3aafc37/router/0.log" May 28 10:59:44.106940 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:44.106899 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk_3d170f84-713a-45e7-9261-9b3f22a7fe9e/storage-initializer/0.log" May 28 10:59:44.116388 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:44.116345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-hz5lk_3d170f84-713a-45e7-9261-9b3f22a7fe9e/main/0.log" May 28 10:59:51.305325 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:51.305288 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fd7r5_bee8f54a-ce8a-4ea4-9abf-0cbb02fc58c3/global-pull-secret-syncer/0.log" May 28 10:59:51.451060 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:51.451028 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7ltqz_db5eab28-bc03-4a6d-9581-2a60eb5535f2/konnectivity-agent/0.log" May 28 10:59:51.558714 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:51.558620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-178.ec2.internal_9378f2db33647a17188b12c706cbe771/haproxy/0.log" May 28 10:59:56.392783 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:56.392742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-gh6rg_b2ff83f3-fe17-45c2-badd-c3e8ce194188/manager/0.log" May 28 10:59:56.646828 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:56.646747 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5pdld_5f6ed3b8-b368-48a8-acae-adde001130c3/limitador/0.log" May 28 10:59:58.393020 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:58.392986 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-x6wb6_ecc9809a-ded4-4014-8677-92aa621fcd51/cluster-monitoring-operator/0.log" May 28 10:59:58.561304 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:58.561275 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/node-exporter/0.log" May 28 10:59:58.587045 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:58.587014 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/kube-rbac-proxy/0.log" May 28 10:59:58.608788 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:58.608759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jzpn8_4e735108-ff94-4fb5-b656-330db0d456ec/init-textfile/0.log" May 28 10:59:59.087113 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:59.087083 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sbms5_63f1537c-08ae-44ab-a9f0-a8c5737c3ee5/prometheus-operator/0.log" May 28 10:59:59.110650 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:59.110622 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-sbms5_63f1537c-08ae-44ab-a9f0-a8c5737c3ee5/kube-rbac-proxy/0.log" May 28 10:59:59.146675 ip-10-0-141-178 kubenswrapper[2575]: I0528 10:59:59.146646 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-8sl6t_43bd528f-f386-473b-924b-e34b00eaf47e/prometheus-operator-admission-webhook/0.log" May 28 11:00:00.143902 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.143866 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666100-2cxzb"] May 28 11:00:00.147185 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.147166 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:00.149809 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.149790 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bsxkb\"" May 28 11:00:00.154811 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.154793 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666100-2cxzb"] May 28 11:00:00.163289 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.163263 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f"] May 28 11:00:00.167027 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.167003 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.170579 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.170555 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s5kmk\"/\"default-dockercfg-qc7ql\"" May 28 11:00:00.170684 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.170556 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5kmk\"/\"openshift-service-ca.crt\"" May 28 11:00:00.171470 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.171430 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5kmk\"/\"kube-root-ca.crt\"" May 28 11:00:00.179737 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-sys\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.179874 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-lib-modules\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.179874 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-proc\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.179874 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbsk\" (UniqueName: \"kubernetes.io/projected/03d147e7-42cd-4901-90d4-c5f671c0f543-kube-api-access-mjbsk\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.179874 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mb7\" (UniqueName: \"kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7\") pod \"maas-api-key-cleanup-29666100-2cxzb\" (UID: \"a9250338-fc8a-42b3-b2f5-591fb363368c\") " pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:00.180101 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.179902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-podres\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.188309 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.188279 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f"] May 28 11:00:00.280995 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.280956 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mb7\" (UniqueName: \"kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7\") pod \"maas-api-key-cleanup-29666100-2cxzb\" (UID: \"a9250338-fc8a-42b3-b2f5-591fb363368c\") " pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281019 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-podres\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281075 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-sys\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281102 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-lib-modules\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281168 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-proc\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281174 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-sys\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281205 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281191 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbsk\" (UniqueName: \"kubernetes.io/projected/03d147e7-42cd-4901-90d4-c5f671c0f543-kube-api-access-mjbsk\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281547 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-podres\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281547 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-proc\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.281547 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.281300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03d147e7-42cd-4901-90d4-c5f671c0f543-lib-modules\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.290593 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.290560 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbsk\" (UniqueName: \"kubernetes.io/projected/03d147e7-42cd-4901-90d4-c5f671c0f543-kube-api-access-mjbsk\") pod \"perf-node-gather-daemonset-t7n9f\" (UID: \"03d147e7-42cd-4901-90d4-c5f671c0f543\") " pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.290720 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.290635 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mb7\" (UniqueName: \"kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7\") pod \"maas-api-key-cleanup-29666100-2cxzb\" (UID: \"a9250338-fc8a-42b3-b2f5-591fb363368c\") " pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:00.457320 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.457228 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-8fmp6_575b7b1f-022c-40f7-bd5a-671842bd0538/networking-console-plugin/0.log" May 28 11:00:00.458021 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.458001 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:00.478844 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.478817 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.606206 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.606175 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666100-2cxzb"] May 28 11:00:00.609213 ip-10-0-141-178 kubenswrapper[2575]: W0528 11:00:00.609167 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9250338_fc8a_42b3_b2f5_591fb363368c.slice/crio-15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd WatchSource:0}: Error finding container 15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd: Status 404 returned error can't find the container with id 15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd May 28 11:00:00.611401 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.611384 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:00:00.630853 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.630829 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f"] May 28 11:00:00.632887 ip-10-0-141-178 kubenswrapper[2575]: W0528 11:00:00.632861 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03d147e7_42cd_4901_90d4_c5f671c0f543.slice/crio-edbc2aaaf77fe3dc9405eb1ec220ce25a8c28bda95dd84123bfabd36754d6abc WatchSource:0}: Error finding container edbc2aaaf77fe3dc9405eb1ec220ce25a8c28bda95dd84123bfabd36754d6abc: Status 404 returned error can't find the container with id edbc2aaaf77fe3dc9405eb1ec220ce25a8c28bda95dd84123bfabd36754d6abc May 28 11:00:00.983041 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.983005 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" event={"ID":"03d147e7-42cd-4901-90d4-c5f671c0f543","Type":"ContainerStarted","Data":"91baba9c2994b570118d75ed8e1b4987833e1f8f482f1efd4cb1a6a327638818"} May 28 11:00:00.983041 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.983048 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" event={"ID":"03d147e7-42cd-4901-90d4-c5f671c0f543","Type":"ContainerStarted","Data":"edbc2aaaf77fe3dc9405eb1ec220ce25a8c28bda95dd84123bfabd36754d6abc"} May 28 11:00:00.983284 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.983069 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:00.984120 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:00.984094 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" event={"ID":"a9250338-fc8a-42b3-b2f5-591fb363368c","Type":"ContainerStarted","Data":"15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd"} May 28 11:00:01.000771 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:01.000680 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" podStartSLOduration=1.000643459 podStartE2EDuration="1.000643459s" podCreationTimestamp="2026-05-28 11:00:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:00:00.999098956 +0000 UTC m=+1924.289542680" watchObservedRunningTime="2026-05-28 11:00:01.000643459 +0000 UTC m=+1924.291087193" May 28 11:00:01.047506 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:01.047482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/2.log" May 28 11:00:01.054843 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:01.054821 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-z2k2w_3f315ad3-baa1-4058-a8de-9cf1a5b3afb0/console-operator/3.log" May 28 11:00:02.078122 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:02.078087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-m6g9c_68ff2104-0252-468c-b74f-07c0e1c064a4/volume-data-source-validator/0.log" May 28 11:00:02.865226 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:02.865193 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fldd4_c83e193b-639f-4a1a-adf4-6aef5861673a/dns/0.log" May 28 11:00:02.887183 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:02.887151 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fldd4_c83e193b-639f-4a1a-adf4-6aef5861673a/kube-rbac-proxy/0.log" May 28 11:00:03.070893 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:03.070845 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p545l_0ccfbc4f-e1fe-4a6b-9803-9e5eff081c84/dns-node-resolver/0.log" May 28 11:00:03.638649 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:03.638620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q9cds_73176d5b-f86b-4085-ac7d-f21bc8ca8ca9/node-ca/0.log" May 28 11:00:04.686315 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:04.686286 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-x6fqc_b5ec4634-ea32-49f6-84f7-9f34698351cb/discovery/0.log" May 28 11:00:04.741420 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:04.741391 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df4974f78-l7g99_844ef598-d7b1-4301-873f-5b64afe42d13/kube-auth-proxy/0.log" May 28 11:00:04.948665 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:04.948561 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f48bffccb-ttlfn_d6bf45d4-7a06-49e5-add6-5c52b3aafc37/router/0.log" May 28 11:00:05.517518 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:05.517477 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p698z_10d98d32-e339-41e8-807a-7331f43e7659/serve-healthcheck-canary/0.log" May 28 11:00:06.060729 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:06.060697 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-gfcfd_fa0e5fd1-425c-4549-bd9a-4c51393ddc18/insights-operator/0.log" May 28 11:00:06.066493 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:06.066463 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-gfcfd_fa0e5fd1-425c-4549-bd9a-4c51393ddc18/insights-operator/1.log" May 28 11:00:06.175556 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:06.175516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cdj8x_c1549743-85f7-4beb-9647-743ec57ed3fe/kube-rbac-proxy/0.log" May 28 11:00:06.203432 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:06.203401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cdj8x_c1549743-85f7-4beb-9647-743ec57ed3fe/exporter/0.log" May 28 11:00:06.233208 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:06.233175 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cdj8x_c1549743-85f7-4beb-9647-743ec57ed3fe/extractor/0.log" May 28 11:00:07.003432 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:07.003407 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s5kmk/perf-node-gather-daemonset-t7n9f" May 28 11:00:07.013218 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:07.013182 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" event={"ID":"a9250338-fc8a-42b3-b2f5-591fb363368c","Type":"ContainerStarted","Data":"f25ff9e0313279ba81104a4a44c7fc98ca1cf1c205f9dd043e4f585dbcbd689b"} May 28 11:00:07.038891 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:07.038843 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" podStartSLOduration=1.291843452 podStartE2EDuration="7.038827414s" podCreationTimestamp="2026-05-28 11:00:00 +0000 UTC" firstStartedPulling="2026-05-28 11:00:00.611564503 +0000 UTC m=+1923.902008219" lastFinishedPulling="2026-05-28 11:00:06.358548467 +0000 UTC m=+1929.648992181" observedRunningTime="2026-05-28 11:00:07.038358378 +0000 UTC m=+1930.328802114" watchObservedRunningTime="2026-05-28 11:00:07.038827414 +0000 UTC m=+1930.329271148" May 28 11:00:08.018793 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:08.018756 2575 generic.go:358] "Generic (PLEG): container finished" podID="a9250338-fc8a-42b3-b2f5-591fb363368c" containerID="f25ff9e0313279ba81104a4a44c7fc98ca1cf1c205f9dd043e4f585dbcbd689b" exitCode=0 May 28 11:00:08.019187 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:08.018839 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" event={"ID":"a9250338-fc8a-42b3-b2f5-591fb363368c","Type":"ContainerDied","Data":"f25ff9e0313279ba81104a4a44c7fc98ca1cf1c205f9dd043e4f585dbcbd689b"} May 28 11:00:08.336349 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:08.336257 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-qnslx_6bfaad13-e84b-4636-8cb4-78b4fb43c5e4/manager/0.log" May 28 11:00:08.425462 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:08.425420 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666100-2cxzb_a9250338-fc8a-42b3-b2f5-591fb363368c/cleanup/0.log" May 28 11:00:08.664491 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:08.664460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65df8896fb-r29c8_e572fe5d-14df-4e1d-bcb2-ac57950a0378/manager/0.log" May 28 11:00:09.153296 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:09.153269 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:09.267663 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:09.267629 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7mb7\" (UniqueName: \"kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7\") pod \"a9250338-fc8a-42b3-b2f5-591fb363368c\" (UID: \"a9250338-fc8a-42b3-b2f5-591fb363368c\") " May 28 11:00:09.269808 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:09.269775 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7" (OuterVolumeSpecName: "kube-api-access-v7mb7") pod "a9250338-fc8a-42b3-b2f5-591fb363368c" (UID: "a9250338-fc8a-42b3-b2f5-591fb363368c"). InnerVolumeSpecName "kube-api-access-v7mb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 11:00:09.368630 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:09.368594 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7mb7\" (UniqueName: \"kubernetes.io/projected/a9250338-fc8a-42b3-b2f5-591fb363368c-kube-api-access-v7mb7\") on node \"ip-10-0-141-178.ec2.internal\" DevicePath \"\"" May 28 11:00:10.026361 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:10.026325 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" May 28 11:00:10.026550 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:10.026323 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666100-2cxzb" event={"ID":"a9250338-fc8a-42b3-b2f5-591fb363368c","Type":"ContainerDied","Data":"15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd"} May 28 11:00:10.026550 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:10.026431 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15644c221ace6236e66621bbcb8ca2810e69143fa2e63eb0abfc5a8912a324cd" May 28 11:00:14.807110 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:14.807069 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-l7h4b_4220d220-0a2e-4256-aaeb-b54997aa80fc/migrator/0.log" May 28 11:00:14.836301 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:14.836269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-l7h4b_4220d220-0a2e-4256-aaeb-b54997aa80fc/graceful-termination/0.log" May 28 11:00:15.224863 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:15.224783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-5w569_7e3c08e6-521f-4f1d-9634-bbc2f80725bd/kube-storage-version-migrator-operator/1.log" May 28 11:00:15.226623 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:15.226590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-5w569_7e3c08e6-521f-4f1d-9634-bbc2f80725bd/kube-storage-version-migrator-operator/0.log" May 28 11:00:16.290871 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.290843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vnv2_158c42b2-3c1d-4f9b-9c9c-1f1b4f2606d7/kube-multus/0.log" May 28 11:00:16.503328 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.503303 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/kube-multus-additional-cni-plugins/0.log" May 28 11:00:16.543196 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.543168 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/egress-router-binary-copy/0.log" May 28 11:00:16.576334 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.576297 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/cni-plugins/0.log" May 28 11:00:16.612377 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.612344 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/bond-cni-plugin/0.log" May 28 11:00:16.652339 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.652299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/routeoverride-cni/0.log" May 28 11:00:16.688393 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.688359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/whereabouts-cni-bincopy/0.log" May 28 11:00:16.729386 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:16.729357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9m72_f16c5677-e975-4784-9ae0-9a8ff8ba1c9d/whereabouts-cni/0.log" May 28 11:00:17.256070 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:17.256043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tb2q6_f78e8d15-bb0c-4ade-9152-cd547c8e9731/network-metrics-daemon/0.log" May 28 11:00:17.310401 ip-10-0-141-178 kubenswrapper[2575]: I0528 11:00:17.310370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tb2q6_f78e8d15-bb0c-4ade-9152-cd547c8e9731/kube-rbac-proxy/0.log"