May 20 14:04:24.071630 ip-10-0-137-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 14:04:24.071639 ip-10-0-137-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 14:04:24.071646 ip-10-0-137-228 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 14:04:24.071853 ip-10-0-137-228 systemd[1]: Failed to start Kubernetes Kubelet. May 20 14:04:34.219698 ip-10-0-137-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 14:04:34.219715 ip-10-0-137-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1586f0dd206d4f22bd752712f01afa49 -- May 20 14:06:50.967617 ip-10-0-137-228 systemd[1]: Starting Kubernetes Kubelet... May 20 14:06:51.475992 ip-10-0-137-228 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:51.475992 ip-10-0-137-228 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 14:06:51.475992 ip-10-0-137-228 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:51.475992 ip-10-0-137-228 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 14:06:51.475992 ip-10-0-137-228 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:06:51.479465 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.479330 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486701 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486722 2559 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486726 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486729 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486732 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486735 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486739 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486742 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486745 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:51.486733 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486748 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486750 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486753 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486756 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486759 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486762 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486764 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486767 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486770 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486772 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486775 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486778 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486780 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486790 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486793 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486796 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486799 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486801 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486804 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486806 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:51.487122 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486809 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486812 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486814 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486817 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486820 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486823 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486825 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486828 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486830 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486833 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486835 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486838 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486840 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486843 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486847 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486849 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486852 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486854 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486857 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486859 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:51.487643 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486862 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486865 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486868 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486870 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486873 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486875 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486878 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486881 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486883 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486886 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486888 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486897 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486899 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486902 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486905 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486908 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486912 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486917 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486920 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:51.488161 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486923 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486926 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486928 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486935 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486937 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486940 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486943 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486947 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486949 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486952 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486957 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486960 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486963 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486966 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486969 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486971 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486975 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.486980 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487422 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487430 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:51.488645 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487434 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487437 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487440 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487442 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487445 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487448 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487450 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487454 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487457 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487460 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487463 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487465 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487468 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487470 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487473 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487476 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487478 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487481 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487484 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487487 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:51.489127 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487489 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487492 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487495 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487498 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487500 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487503 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487505 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487508 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487510 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487513 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487515 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487517 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487520 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487522 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487525 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487528 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487530 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487533 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487535 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487538 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:51.489624 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487541 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487544 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487546 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487549 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487552 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487555 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487559 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487563 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487567 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487571 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487574 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487576 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487579 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487582 2559 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487584 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487587 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487589 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487592 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487594 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:51.490162 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487597 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487599 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487603 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487605 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487608 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487610 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487613 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487616 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487619 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487622 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487628 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487631 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487633 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487636 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487639 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487641 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487644 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487648 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487651 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487654 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:51.490653 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487659 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487662 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487664 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.487667 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488505 2559 flags.go:64] FLAG: --address="0.0.0.0" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488517 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488524 2559 flags.go:64] FLAG: --anonymous-auth="true" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488528 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488535 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488538 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488542 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488547 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488550 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488553 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488557 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488560 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488564 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488567 2559 flags.go:64] FLAG: --cgroup-root="" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488571 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488574 2559 flags.go:64] FLAG: --client-ca-file="" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488577 2559 flags.go:64] FLAG: --cloud-config="" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488580 2559 flags.go:64] FLAG: --cloud-provider="external" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488583 2559 flags.go:64] FLAG: --cluster-dns="[]" May 20 14:06:51.491143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488588 2559 flags.go:64] FLAG: --cluster-domain="" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488591 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488594 2559 flags.go:64] FLAG: --config-dir="" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488597 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488601 2559 flags.go:64] FLAG: --container-log-max-files="5" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488605 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488608 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488611 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488614 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488617 2559 flags.go:64] FLAG: --contention-profiling="false" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488620 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488623 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488626 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488629 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488633 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488636 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488639 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488642 2559 flags.go:64] FLAG: --enable-load-reader="false" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488646 2559 flags.go:64] FLAG: --enable-server="true" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488649 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488654 2559 flags.go:64] FLAG: --event-burst="100" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488658 2559 flags.go:64] FLAG: --event-qps="50" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488661 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488664 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488667 2559 flags.go:64] FLAG: --eviction-hard="" May 20 14:06:51.491765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488671 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488674 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488677 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488680 2559 flags.go:64] FLAG: --eviction-soft="" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488683 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488686 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488689 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488692 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488695 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488698 2559 flags.go:64] FLAG: --fail-swap-on="true" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488701 2559 flags.go:64] FLAG: --feature-gates="" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488705 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488708 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488711 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488715 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488718 2559 flags.go:64] FLAG: --healthz-port="10248" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488722 2559 flags.go:64] FLAG: --help="false" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488725 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-137-228.ec2.internal" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488728 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488731 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488734 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488737 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488740 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488743 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 14:06:51.492381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488746 2559 flags.go:64] FLAG: --image-service-endpoint="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488748 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488752 2559 flags.go:64] FLAG: --kube-api-burst="100" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488755 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488758 2559 flags.go:64] FLAG: --kube-api-qps="50" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488761 2559 flags.go:64] FLAG: --kube-reserved="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488764 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488767 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488770 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488773 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488776 2559 flags.go:64] FLAG: --lock-file="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488779 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488782 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488786 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488792 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488795 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488798 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488800 2559 flags.go:64] FLAG: --logging-format="text" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488803 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488807 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488810 2559 flags.go:64] FLAG: --manifest-url="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488812 2559 flags.go:64] FLAG: --manifest-url-header="" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488817 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488820 2559 flags.go:64] FLAG: --max-open-files="1000000" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488824 2559 flags.go:64] FLAG: --max-pods="110" May 20 14:06:51.492972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488827 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488830 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488833 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488836 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488839 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488842 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488845 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488853 2559 flags.go:64] FLAG: --node-status-max-images="50" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488856 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488859 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488863 2559 flags.go:64] FLAG: --pod-cidr="" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488866 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488872 2559 flags.go:64] FLAG: --pod-manifest-path="" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488875 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488878 2559 flags.go:64] FLAG: --pods-per-core="0" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488881 2559 flags.go:64] FLAG: --port="10250" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488884 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488887 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a999ce65477f9724" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488890 2559 flags.go:64] FLAG: --qos-reserved="" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488893 2559 flags.go:64] FLAG: --read-only-port="10255" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488896 2559 flags.go:64] FLAG: --register-node="true" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488899 2559 flags.go:64] FLAG: --register-schedulable="true" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488902 2559 flags.go:64] FLAG: --register-with-taints="" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488906 2559 flags.go:64] FLAG: --registry-burst="10" May 20 14:06:51.493577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488909 2559 flags.go:64] FLAG: --registry-qps="5" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488912 2559 flags.go:64] FLAG: --reserved-cpus="" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488914 2559 flags.go:64] FLAG: --reserved-memory="" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488918 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488921 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488924 2559 flags.go:64] FLAG: --rotate-certificates="false" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488927 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488930 2559 flags.go:64] FLAG: --runonce="false" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488932 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488935 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488938 2559 flags.go:64] FLAG: --seccomp-default="false" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488941 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488944 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488947 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488950 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488953 2559 flags.go:64] FLAG: --storage-driver-password="root" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488956 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488959 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488962 2559 flags.go:64] FLAG: --storage-driver-user="root" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488965 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488968 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488971 2559 flags.go:64] FLAG: --system-cgroups="" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488974 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488979 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488984 2559 flags.go:64] FLAG: --tls-cert-file="" May 20 14:06:51.494160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488987 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488992 2559 flags.go:64] FLAG: --tls-min-version="" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488995 2559 flags.go:64] FLAG: --tls-private-key-file="" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.488997 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489002 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489005 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489009 2559 flags.go:64] FLAG: --v="2" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489013 2559 flags.go:64] FLAG: --version="false" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489017 2559 flags.go:64] FLAG: --vmodule="" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489021 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.489024 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489138 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489144 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489148 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489151 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489154 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489156 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489159 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489161 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489164 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489167 2559 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489169 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:51.494776 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489172 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489175 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489177 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489181 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489185 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489189 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489192 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489195 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489197 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489202 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489205 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489208 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489210 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489213 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489217 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489220 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489223 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489225 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489228 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:51.495352 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489231 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489233 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489236 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489239 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489241 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489244 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489246 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489249 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489252 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489255 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489257 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489260 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489262 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489265 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489268 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489270 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489273 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489278 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489282 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:51.495851 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489284 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489287 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489291 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489307 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489310 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489313 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489315 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489319 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489322 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489325 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489327 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489330 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489333 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489335 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489338 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489341 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489344 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489346 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489349 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489352 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:51.496389 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489354 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489357 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489360 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489362 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489365 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489367 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489370 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489372 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489375 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489377 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489380 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489382 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489391 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489393 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489397 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:51.496873 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.489400 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:51.497243 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.490359 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:51.497471 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.497449 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.497472 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497523 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497528 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497531 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497535 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497538 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497541 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497544 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497547 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497550 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497553 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497556 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497558 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497561 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497564 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497567 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497570 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497572 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497575 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:51.497583 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497577 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497582 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497584 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497588 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497591 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497594 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497597 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497600 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497602 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497605 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497608 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497611 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497613 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497617 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497620 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497623 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497625 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497627 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497630 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497632 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:51.498071 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497635 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497638 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497640 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497643 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497646 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497651 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497653 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497656 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497659 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497661 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497664 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497667 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497669 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497672 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497675 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497678 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497681 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497683 2559 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497686 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497688 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:51.499427 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497691 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497694 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497696 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497699 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497701 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497704 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497712 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497715 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497717 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497720 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497722 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497725 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497727 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497731 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497735 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497738 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497741 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497743 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497746 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:51.499949 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497749 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497752 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497754 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497757 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497759 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497762 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497764 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497768 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497770 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.497776 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497890 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497894 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497897 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497900 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497903 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:06:51.500429 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497906 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497909 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497912 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497914 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497917 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497920 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497923 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497925 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497928 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497930 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497933 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497935 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497939 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497942 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497945 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497948 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497951 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497953 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497955 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497958 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:06:51.500802 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497960 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497963 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497966 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497968 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497970 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497973 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497976 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497978 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497981 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497983 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497986 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497988 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497991 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497993 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497996 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.497998 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498001 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498003 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498015 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:06:51.501289 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498020 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498023 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498025 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498028 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498031 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498033 2559 feature_gate.go:328] unrecognized feature gate: Example May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498036 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498038 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498041 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498044 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498046 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498049 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498051 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498054 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498056 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498059 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498062 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498065 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498067 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498070 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:06:51.501854 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498072 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498075 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498078 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498081 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498085 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498088 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498091 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498094 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498096 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498099 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498102 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498111 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498114 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498117 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498119 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498122 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498124 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498127 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498129 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:06:51.502363 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498132 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:51.498134 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.498139 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.498981 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.501396 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.502553 2559 server.go:1019] "Starting client certificate rotation" May 20 14:06:51.502919 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.502685 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:06:51.503577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.503562 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:06:51.531510 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.531478 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:06:51.535623 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.535598 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:06:51.554645 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.554628 2559 log.go:25] "Validated CRI v1 runtime API" May 20 14:06:51.561221 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.561205 2559 log.go:25] "Validated CRI v1 image API" May 20 14:06:51.564169 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.564133 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 14:06:51.567664 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.567644 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 93208537-07c7-481b-a30c-84d7255818a9:/dev/nvme0n1p4 bf836b65-125f-4aac-ae36-2dc7d474517e:/dev/nvme0n1p3] May 20 14:06:51.567731 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.567664 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 14:06:51.568238 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.568219 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:06:51.572423 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.572307 2559 manager.go:217] Machine: {Timestamp:2026-05-20 14:06:51.571769814 +0000 UTC m=+0.469012715 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103608 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec284083b94f6ef16895b51e580542ef SystemUUID:ec284083-b94f-6ef1-6895-b51e580542ef BootID:1586f0dd-206d-4f22-bd75-2712f01afa49 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:3d:38:dd:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:3d:38:dd:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:5a:39:55:49:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 14:06:51.573161 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.573150 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 14:06:51.573318 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.573290 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 14:06:51.578252 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.578222 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 14:06:51.578423 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.578254 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 14:06:51.578475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.578434 2559 topology_manager.go:138] "Creating topology manager with none policy" May 20 14:06:51.578475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.578443 2559 container_manager_linux.go:306] "Creating device plugin manager" May 20 14:06:51.578475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.578451 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:06:51.579352 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.579340 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:06:51.580962 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.580951 2559 state_mem.go:36] "Initialized new in-memory state store" May 20 14:06:51.581074 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.581065 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 14:06:51.583952 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.583941 2559 kubelet.go:491] "Attempting to sync node with API server" May 20 14:06:51.583988 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.583961 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 14:06:51.583988 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.583975 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 14:06:51.583988 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.583984 2559 kubelet.go:397] "Adding apiserver pod source" May 20 14:06:51.584119 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.583993 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 14:06:51.585207 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.585191 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:06:51.585312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.585210 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:06:51.587679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.587643 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-scqf7" May 20 14:06:51.588573 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.588556 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 14:06:51.590751 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.590734 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 14:06:51.593064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593049 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 14:06:51.593064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593067 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593073 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593080 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593090 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593097 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593103 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593109 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593115 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593122 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593142 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 14:06:51.593196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.593148 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 14:06:51.594178 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.594164 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 14:06:51.594178 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.594179 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 14:06:51.594695 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.594671 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 14:06:51.594741 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.594671 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 14:06:51.596548 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.596528 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-scqf7" May 20 14:06:51.597613 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.597599 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 14:06:51.597686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.597639 2559 server.go:1295] "Started kubelet" May 20 14:06:51.597765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.597716 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 14:06:51.597927 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.597883 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 14:06:51.597978 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.597949 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 14:06:51.600546 ip-10-0-137-228 systemd[1]: Started Kubernetes Kubelet. May 20 14:06:51.600765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.600583 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 14:06:51.602512 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.602494 2559 server.go:317] "Adding debug handlers to kubelet server" May 20 14:06:51.609670 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.609648 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 14:06:51.611307 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611281 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 14:06:51.611401 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611285 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 14:06:51.611401 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611356 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 14:06:51.611401 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611369 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 14:06:51.611557 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611513 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 14:06:51.611604 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611564 2559 reconstruct.go:97] "Volume reconstruction finished" May 20 14:06:51.611672 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.611572 2559 reconciler.go:26] "Reconciler: start to sync state" May 20 14:06:51.612240 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.612210 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:51.612362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612262 2559 factory.go:153] Registering CRI-O factory May 20 14:06:51.612362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612279 2559 factory.go:223] Registration of the crio container factory successfully May 20 14:06:51.612362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612346 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 14:06:51.612362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612356 2559 factory.go:55] Registering systemd factory May 20 14:06:51.612362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612363 2559 factory.go:223] Registration of the systemd container factory successfully May 20 14:06:51.612568 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612378 2559 factory.go:103] Registering Raw factory May 20 14:06:51.612568 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612404 2559 manager.go:1196] Started watching for new ooms in manager May 20 14:06:51.612834 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.612822 2559 manager.go:319] Starting recovery of all containers May 20 14:06:51.617024 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.616997 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:51.620168 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.620143 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-228.ec2.internal\" not found" node="ip-10-0-137-228.ec2.internal" May 20 14:06:51.622224 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.622202 2559 manager.go:324] Recovery completed May 20 14:06:51.624757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.624739 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-228.ec2.internal" not found May 20 14:06:51.626517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.626505 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.634344 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634328 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.634416 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634359 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.634416 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634370 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.634905 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634893 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 14:06:51.634905 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634904 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 14:06:51.634988 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.634931 2559 state_mem.go:36] "Initialized new in-memory state store" May 20 14:06:51.637908 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.637893 2559 policy_none.go:49] "None policy: Start" May 20 14:06:51.637963 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.637916 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 14:06:51.637963 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.637929 2559 state_mem.go:35] "Initializing new in-memory state store" May 20 14:06:51.642756 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.642740 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-228.ec2.internal" not found May 20 14:06:51.676904 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.676887 2559 manager.go:341] "Starting Device Plugin manager" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.676935 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.676947 2559 server.go:85] "Starting device plugin registration server" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.677238 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.677252 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.677341 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.677416 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.677422 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.677939 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 14:06:51.685884 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.677972 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:51.702197 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.702176 2559 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-228.ec2.internal" not found May 20 14:06:51.755911 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.755830 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 14:06:51.757105 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.757089 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 14:06:51.757192 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.757124 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 14:06:51.757192 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.757148 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 14:06:51.757192 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.757159 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 20 14:06:51.757334 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.757265 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 14:06:51.763190 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.763162 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:51.778423 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.778405 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.779424 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.779399 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.779526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.779444 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.779526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.779459 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.779526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.779492 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-228.ec2.internal" May 20 14:06:51.788319 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.788283 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-228.ec2.internal" May 20 14:06:51.788418 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.788330 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-228.ec2.internal\": node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:51.810739 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.810709 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:51.857994 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.857947 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal"] May 20 14:06:51.858063 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.858053 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.859052 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.859038 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.859108 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.859066 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.859108 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.859076 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.860405 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.860392 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.860580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.860563 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:51.860637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.860604 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.861360 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861342 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.861455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861342 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.861455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861371 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.861455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861381 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.861455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861390 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.861455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.861401 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.862678 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.862665 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:51.862728 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.862691 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:06:51.864195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.864180 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientMemory" May 20 14:06:51.864273 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.864205 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:06:51.864273 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.864214 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeHasSufficientPID" May 20 14:06:51.883144 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.883115 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-228.ec2.internal\" not found" node="ip-10-0-137-228.ec2.internal" May 20 14:06:51.887980 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.887963 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-228.ec2.internal\" not found" node="ip-10-0-137-228.ec2.internal" May 20 14:06:51.911103 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:51.911078 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:51.913330 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.913309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:51.913437 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.913339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1328fad5d3e6b09617c1ce056b41386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"d1328fad5d3e6b09617c1ce056b41386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:51.913437 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:51.913389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.012256 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.012180 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.014384 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014368 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.014433 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014393 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.014433 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014412 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1328fad5d3e6b09617c1ce056b41386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"d1328fad5d3e6b09617c1ce056b41386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:52.014496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014448 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1328fad5d3e6b09617c1ce056b41386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-228.ec2.internal\" (UID: \"d1328fad5d3e6b09617c1ce056b41386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:52.014496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.014496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.014487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ac7b9ac1d155aa41881d0c2c66c7a1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal\" (UID: \"3ac7b9ac1d155aa41881d0c2c66c7a1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.112907 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.112870 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.185129 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.185109 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.190792 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.190770 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:52.213385 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.213354 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.313915 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.313829 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.414356 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.414318 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.503765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.503737 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 14:06:52.504467 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.503905 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 14:06:52.504467 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.503953 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 14:06:52.515032 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.515017 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.601917 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.601748 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 14:01:51 +0000 UTC" deadline="2027-11-21 23:58:25.236993503 +0000 UTC" May 20 14:06:52.601917 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.601887 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13209h51m32.635110288s" May 20 14:06:52.611942 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.611924 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 14:06:52.615919 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:52.615896 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-228.ec2.internal\" not found" May 20 14:06:52.646745 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.646721 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:06:52.673925 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.673902 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpml4" May 20 14:06:52.685743 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.685722 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpml4" May 20 14:06:52.697390 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.697370 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:52.709381 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:52.709350 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1328fad5d3e6b09617c1ce056b41386.slice/crio-a1f1dfcfcaf7f9330132183f34db4bcfc0ae70e75061309f3e1d8a03fbf2edf0 WatchSource:0}: Error finding container a1f1dfcfcaf7f9330132183f34db4bcfc0ae70e75061309f3e1d8a03fbf2edf0: Status 404 returned error can't find the container with id a1f1dfcfcaf7f9330132183f34db4bcfc0ae70e75061309f3e1d8a03fbf2edf0 May 20 14:06:52.709597 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:52.709583 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac7b9ac1d155aa41881d0c2c66c7a1c.slice/crio-dfcb81f519c0b1052eb8e9cc1c5465934c3833968bbea27b025b1634106ed18e WatchSource:0}: Error finding container dfcb81f519c0b1052eb8e9cc1c5465934c3833968bbea27b025b1634106ed18e: Status 404 returned error can't find the container with id dfcb81f519c0b1052eb8e9cc1c5465934c3833968bbea27b025b1634106ed18e May 20 14:06:52.711712 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.711692 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" May 20 14:06:52.712924 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.712910 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:06:52.731631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.731614 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:06:52.733365 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.733353 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" May 20 14:06:52.748001 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.747984 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:06:52.759830 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.759795 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"3ac7b9ac1d155aa41881d0c2c66c7a1c","Type":"ContainerStarted","Data":"dfcb81f519c0b1052eb8e9cc1c5465934c3833968bbea27b025b1634106ed18e"} May 20 14:06:52.760765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:52.760746 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" event={"ID":"d1328fad5d3e6b09617c1ce056b41386","Type":"ContainerStarted","Data":"a1f1dfcfcaf7f9330132183f34db4bcfc0ae70e75061309f3e1d8a03fbf2edf0"} May 20 14:06:53.087178 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.087083 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:53.439570 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.439490 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:53.584834 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.584808 2559 apiserver.go:52] "Watching apiserver" May 20 14:06:53.596407 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.596374 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 14:06:53.597436 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.597407 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp","openshift-cluster-node-tuning-operator/tuned-f97vr","openshift-multus/multus-n2zxb","openshift-multus/network-metrics-daemon-kq8v7","openshift-network-diagnostics/network-check-target-jrzhm","openshift-ovn-kubernetes/ovnkube-node-cnh5s","kube-system/konnectivity-agent-47czl","openshift-dns/node-resolver-nz2ww","openshift-image-registry/node-ca-ss8jt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-tprj2","openshift-network-operator/iptables-alerter-bd6bf"] May 20 14:06:53.598904 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.598884 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.600068 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.599989 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.601079 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.601058 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.601567 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.601549 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 14:06:53.601702 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.601605 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4r4f2\"" May 20 14:06:53.602402 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.602382 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n2zxb" May 20 14:06:53.603064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.602915 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 14:06:53.603064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.602954 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 14:06:53.603064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603000 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 14:06:53.603064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603012 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 14:06:53.603064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.602968 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 14:06:53.603383 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.602918 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 14:06:53.603383 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603147 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 14:06:53.603383 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603384 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 14:06:53.603510 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603423 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f4qp9\"" May 20 14:06:53.603834 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.603818 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.603926 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.603895 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:06:53.604600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604448 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 14:06:53.604600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604487 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b9vcg\"" May 20 14:06:53.604600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604500 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 14:06:53.604955 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604935 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 14:06:53.604955 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604947 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 14:06:53.605113 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.604942 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 14:06:53.605352 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.605335 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:53.605438 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.605412 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:06:53.605697 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.605644 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 14:06:53.605799 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.605747 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pwldq\"" May 20 14:06:53.606670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.606649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.607857 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.607836 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.609096 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.609063 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 14:06:53.609200 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.609153 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.609464 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.609437 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 14:06:53.609575 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.609557 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mcch2\"" May 20 14:06:53.610138 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.610120 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 14:06:53.610414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.610397 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-plkpn\"" May 20 14:06:53.610414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.610411 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 14:06:53.610762 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.610744 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.611944 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.611791 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 14:06:53.611944 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.611808 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 14:06:53.611944 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.611808 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jcgjx\"" May 20 14:06:53.611944 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.611895 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 14:06:53.612653 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.612637 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.612970 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.612929 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 14:06:53.613212 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.613179 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6dkrb\"" May 20 14:06:53.613315 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.613258 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 14:06:53.615407 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.615120 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 14:06:53.615407 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.615137 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 14:06:53.615407 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.615152 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 14:06:53.617558 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.617539 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84h5q\"" May 20 14:06:53.621523 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np8nw\" (UniqueName: \"kubernetes.io/projected/9730e4c3-016c-4b7d-8289-785212527297-kube-api-access-np8nw\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.621596 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-os-release\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621596 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-socket-dir-parent\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-registration-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.621686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-bin\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.621686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-netns\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621797 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-daemon-config\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621797 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.621797 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysconfig\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.621797 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-k8s-cni-cncf-io\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621797 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-hostroot\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-binary-copy\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3610a0b-1037-408c-8e36-f09270b02f34-iptables-alerter-script\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-run\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-tmp\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cnibin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cni-binary-copy\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3157c08-3a64-4f76-94f3-dd568f37702c-hosts-file\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-socket-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-sys\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.621998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.621992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-netd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59r7t\" (UniqueName: \"kubernetes.io/projected/6b8a3398-8c10-42e5-8174-c02973b9dcbe-kube-api-access-59r7t\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-cnibin\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-kubernetes\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdgqq\" (UniqueName: \"kubernetes.io/projected/49dd36d9-c144-456e-8660-511749aedeb6-kube-api-access-fdgqq\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-config\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-script-lib\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-bin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-ovn\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-lib-modules\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-env-overrides\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-multus\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e60838f-a479-4e62-8504-2350dea17856-agent-certs\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-systemd-units\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-conf\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-systemd\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-system-cni-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3610a0b-1037-408c-8e36-f09270b02f34-host-slash\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-etc-kubernetes\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-os-release\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.622768 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-host\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwlq\" (UniqueName: \"kubernetes.io/projected/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-kube-api-access-jbwlq\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-systemd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-node-log\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-conf-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-multus-certs\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.622976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7chcg\" (UniqueName: \"kubernetes.io/projected/c3157c08-3a64-4f76-94f3-dd568f37702c-kube-api-access-7chcg\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9730e4c3-016c-4b7d-8289-785212527297-ovn-node-metrics-cert\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-device-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bpb\" (UniqueName: \"kubernetes.io/projected/2da66582-c0f7-476d-aba1-824ed50ee8eb-kube-api-access-w2bpb\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-kubelet\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.623312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3157c08-3a64-4f76-94f3-dd568f37702c-tmp-dir\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-log-socket\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flsgf\" (UniqueName: \"kubernetes.io/projected/539cf384-a6b6-45df-9597-af3dda9d5f49-kube-api-access-flsgf\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lb9s\" (UniqueName: \"kubernetes.io/projected/a3610a0b-1037-408c-8e36-f09270b02f34-kube-api-access-7lb9s\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-sys-fs\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-host\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-kubelet\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-netns\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-var-lib-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7h4r\" (UniqueName: \"kubernetes.io/projected/829a3a6c-13ab-44f3-8801-00d16894c694-kube-api-access-k7h4r\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-serviceca\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-slash\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-etc-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-system-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e60838f-a479-4e62-8504-2350dea17856-konnectivity-ca\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-etc-tuned\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.624011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.624638 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-modprobe-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.624638 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.623946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-var-lib-kubelet\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.687402 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.687356 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:01:52 +0000 UTC" deadline="2027-12-04 12:23:06.557150103 +0000 UTC" May 20 14:06:53.687402 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.687399 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13510h16m12.869756024s" May 20 14:06:53.712580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.712511 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 14:06:53.724307 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724265 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-systemd-units\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.724418 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-conf\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724418 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-systemd\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724418 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724363 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-system-cni-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.724418 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-systemd-units\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.724418 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724384 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3610a0b-1037-408c-8e36-f09270b02f34-host-slash\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-system-cni-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3610a0b-1037-408c-8e36-f09270b02f34-host-slash\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724451 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-etc-kubernetes\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724461 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-systemd\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-etc-kubernetes\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724492 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-os-release\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-host\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724537 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-os-release\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724550 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724572 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwlq\" (UniqueName: \"kubernetes.io/projected/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-kube-api-access-jbwlq\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-host\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-systemd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724616 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-node-log\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-conf\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.724675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-systemd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724780 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-conf-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-node-log\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-multus-certs\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-conf-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724873 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7chcg\" (UniqueName: \"kubernetes.io/projected/c3157c08-3a64-4f76-94f3-dd568f37702c-kube-api-access-7chcg\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724921 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9730e4c3-016c-4b7d-8289-785212527297-ovn-node-metrics-cert\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-multus-certs\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724952 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724959 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysctl-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.724996 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-device-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725065 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-device-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725099 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bpb\" (UniqueName: \"kubernetes.io/projected/2da66582-c0f7-476d-aba1-824ed50ee8eb-kube-api-access-w2bpb\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725126 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.725371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-kubelet\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725177 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3157c08-3a64-4f76-94f3-dd568f37702c-tmp-dir\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-kubelet\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.725252 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.725341 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:54.22531224 +0000 UTC m=+3.122555147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725356 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-log-socket\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725356 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725382 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flsgf\" (UniqueName: \"kubernetes.io/projected/539cf384-a6b6-45df-9597-af3dda9d5f49-kube-api-access-flsgf\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-log-socket\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3157c08-3a64-4f76-94f3-dd568f37702c-tmp-dir\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lb9s\" (UniqueName: \"kubernetes.io/projected/a3610a0b-1037-408c-8e36-f09270b02f34-kube-api-access-7lb9s\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725521 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-sys-fs\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-host\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725579 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-kubelet\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-sys-fs\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725603 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-netns\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725626 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-var-lib-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-kubelet\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725639 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-host\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-netns\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725643 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7h4r\" (UniqueName: \"kubernetes.io/projected/829a3a6c-13ab-44f3-8801-00d16894c694-kube-api-access-k7h4r\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-var-lib-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-serviceca\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725769 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-slash\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-slash\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725837 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-etc-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-system-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725900 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e60838f-a479-4e62-8504-2350dea17856-konnectivity-ca\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725925 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-etc-tuned\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-system-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-etc-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.725952 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726209 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-modprobe-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-serviceca\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.726755 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726239 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-var-lib-kubelet\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726265 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-np8nw\" (UniqueName: \"kubernetes.io/projected/9730e4c3-016c-4b7d-8289-785212527297-kube-api-access-np8nw\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726288 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-os-release\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726328 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-socket-dir-parent\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726355 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-registration-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726360 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-var-lib-kubelet\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-modprobe-d\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726396 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-bin\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-socket-dir-parent\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-registration-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726424 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-netns\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-netns\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-bin\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e60838f-a479-4e62-8504-2350dea17856-konnectivity-ca\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726484 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-os-release\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726470 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-daemon-config\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.727574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726525 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysconfig\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726586 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-k8s-cni-cncf-io\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-hostroot\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726636 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-binary-copy\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-sysconfig\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3610a0b-1037-408c-8e36-f09270b02f34-iptables-alerter-script\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-run-k8s-cni-cncf-io\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-hostroot\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-run\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726745 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-tmp\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-run\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cnibin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cni-binary-copy\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726869 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3157c08-3a64-4f76-94f3-dd568f37702c-hosts-file\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726895 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-socket-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726920 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-sys\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.728367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726946 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.726989 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727015 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-netd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727105 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59r7t\" (UniqueName: \"kubernetes.io/projected/6b8a3398-8c10-42e5-8174-c02973b9dcbe-kube-api-access-59r7t\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cnibin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727131 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-cnibin\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/539cf384-a6b6-45df-9597-af3dda9d5f49-cnibin\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-kubernetes\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727210 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdgqq\" (UniqueName: \"kubernetes.io/projected/49dd36d9-c144-456e-8660-511749aedeb6-kube-api-access-fdgqq\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3157c08-3a64-4f76-94f3-dd568f37702c-hosts-file\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727237 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-config\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-socket-dir\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727334 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-script-lib\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727363 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-sys\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727398 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-bin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-ovn\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-openvswitch\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727450 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727475 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-lib-modules\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727511 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-env-overrides\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-daemon-config\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727544 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-multus\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727571 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e60838f-a479-4e62-8504-2350dea17856-agent-certs\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/539cf384-a6b6-45df-9597-af3dda9d5f49-cni-binary-copy\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727674 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-host-cni-netd\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9730e4c3-016c-4b7d-8289-785212527297-run-ovn\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-multus-cni-dir\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727914 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-bin\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8a3398-8c10-42e5-8174-c02973b9dcbe-cni-binary-copy\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b8a3398-8c10-42e5-8174-c02973b9dcbe-host-var-lib-cni-multus\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.727960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-env-overrides\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.729852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-etc-kubernetes\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2da66582-c0f7-476d-aba1-824ed50ee8eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728147 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/829a3a6c-13ab-44f3-8801-00d16894c694-lib-modules\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-script-lib\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728523 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9730e4c3-016c-4b7d-8289-785212527297-ovnkube-config\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.728954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3610a0b-1037-408c-8e36-f09270b02f34-iptables-alerter-script\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.729261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-etc-tuned\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.729401 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9730e4c3-016c-4b7d-8289-785212527297-ovn-node-metrics-cert\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.730170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e60838f-a479-4e62-8504-2350dea17856-agent-certs\") pod \"konnectivity-agent-47czl\" (UID: \"5e60838f-a479-4e62-8504-2350dea17856\") " pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.730637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.730362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/829a3a6c-13ab-44f3-8801-00d16894c694-tmp\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.732928 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.732907 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:53.732928 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.732930 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:53.733078 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.732943 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:53.733078 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:53.733014 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:54.232996338 +0000 UTC m=+3.130239243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:53.734388 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.734317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7chcg\" (UniqueName: \"kubernetes.io/projected/c3157c08-3a64-4f76-94f3-dd568f37702c-kube-api-access-7chcg\") pod \"node-resolver-nz2ww\" (UID: \"c3157c08-3a64-4f76-94f3-dd568f37702c\") " pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.734708 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.734684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flsgf\" (UniqueName: \"kubernetes.io/projected/539cf384-a6b6-45df-9597-af3dda9d5f49-kube-api-access-flsgf\") pod \"multus-additional-cni-plugins-tprj2\" (UID: \"539cf384-a6b6-45df-9597-af3dda9d5f49\") " pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.735269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.735244 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwlq\" (UniqueName: \"kubernetes.io/projected/c981a7a1-1b2d-4b13-b765-d5e24c3e8e68-kube-api-access-jbwlq\") pod \"node-ca-ss8jt\" (UID: \"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68\") " pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.735727 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.735680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bpb\" (UniqueName: \"kubernetes.io/projected/2da66582-c0f7-476d-aba1-824ed50ee8eb-kube-api-access-w2bpb\") pod \"aws-ebs-csi-driver-node-87wsp\" (UID: \"2da66582-c0f7-476d-aba1-824ed50ee8eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.735823 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.735802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lb9s\" (UniqueName: \"kubernetes.io/projected/a3610a0b-1037-408c-8e36-f09270b02f34-kube-api-access-7lb9s\") pod \"iptables-alerter-bd6bf\" (UID: \"a3610a0b-1037-408c-8e36-f09270b02f34\") " pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:53.736631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.736610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np8nw\" (UniqueName: \"kubernetes.io/projected/9730e4c3-016c-4b7d-8289-785212527297-kube-api-access-np8nw\") pod \"ovnkube-node-cnh5s\" (UID: \"9730e4c3-016c-4b7d-8289-785212527297\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.737444 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.737400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7h4r\" (UniqueName: \"kubernetes.io/projected/829a3a6c-13ab-44f3-8801-00d16894c694-kube-api-access-k7h4r\") pod \"tuned-f97vr\" (UID: \"829a3a6c-13ab-44f3-8801-00d16894c694\") " pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.737566 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.737538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59r7t\" (UniqueName: \"kubernetes.io/projected/6b8a3398-8c10-42e5-8174-c02973b9dcbe-kube-api-access-59r7t\") pod \"multus-n2zxb\" (UID: \"6b8a3398-8c10-42e5-8174-c02973b9dcbe\") " pod="openshift-multus/multus-n2zxb" May 20 14:06:53.737763 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.737724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdgqq\" (UniqueName: \"kubernetes.io/projected/49dd36d9-c144-456e-8660-511749aedeb6-kube-api-access-fdgqq\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:53.911014 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.910976 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:06:53.920894 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.920869 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" May 20 14:06:53.928542 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.928515 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f97vr" May 20 14:06:53.934129 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.934112 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n2zxb" May 20 14:06:53.939624 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.939604 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:06:53.941758 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.941727 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47czl" May 20 14:06:53.949357 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.949336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nz2ww" May 20 14:06:53.955965 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.955943 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ss8jt" May 20 14:06:53.962475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.962459 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tprj2" May 20 14:06:53.967997 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:53.967978 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bd6bf" May 20 14:06:54.231363 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.231265 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:54.231541 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.231423 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:54.231541 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.231492 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:55.231473053 +0000 UTC m=+4.128715958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:54.331926 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.331891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:54.332104 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.332071 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:54.332104 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.332092 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:54.332104 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.332101 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:54.332258 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.332159 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:55.332142847 +0000 UTC m=+4.229385734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:54.357649 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.357598 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3157c08_3a64_4f76_94f3_dd568f37702c.slice/crio-efba65b51325189626cffb5250bd302feff8233abc5a1c118ead02c0e3a6f0b9 WatchSource:0}: Error finding container efba65b51325189626cffb5250bd302feff8233abc5a1c118ead02c0e3a6f0b9: Status 404 returned error can't find the container with id efba65b51325189626cffb5250bd302feff8233abc5a1c118ead02c0e3a6f0b9 May 20 14:06:54.360062 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.359897 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da66582_c0f7_476d_aba1_824ed50ee8eb.slice/crio-be645b77f7a44e0acca88c9c2060abe5e288d12762ebb9d1ba2c693d1c6a7d58 WatchSource:0}: Error finding container be645b77f7a44e0acca88c9c2060abe5e288d12762ebb9d1ba2c693d1c6a7d58: Status 404 returned error can't find the container with id be645b77f7a44e0acca88c9c2060abe5e288d12762ebb9d1ba2c693d1c6a7d58 May 20 14:06:54.362456 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.362431 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829a3a6c_13ab_44f3_8801_00d16894c694.slice/crio-77c3213d44911824867c17fb861343495ca2b1ff149b32ae81c9bd9ef42db601 WatchSource:0}: Error finding container 77c3213d44911824867c17fb861343495ca2b1ff149b32ae81c9bd9ef42db601: Status 404 returned error can't find the container with id 77c3213d44911824867c17fb861343495ca2b1ff149b32ae81c9bd9ef42db601 May 20 14:06:54.363546 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.363519 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539cf384_a6b6_45df_9597_af3dda9d5f49.slice/crio-556227d4162061206d04f31e96f32d86e9b799dbc22ea9b82aa48f6e1edff2ef WatchSource:0}: Error finding container 556227d4162061206d04f31e96f32d86e9b799dbc22ea9b82aa48f6e1edff2ef: Status 404 returned error can't find the container with id 556227d4162061206d04f31e96f32d86e9b799dbc22ea9b82aa48f6e1edff2ef May 20 14:06:54.364287 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.364228 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8a3398_8c10_42e5_8174_c02973b9dcbe.slice/crio-822db170f85ba5a24d81a851c6f930e3be0b240269d9949a6a2537564f5c01e2 WatchSource:0}: Error finding container 822db170f85ba5a24d81a851c6f930e3be0b240269d9949a6a2537564f5c01e2: Status 404 returned error can't find the container with id 822db170f85ba5a24d81a851c6f930e3be0b240269d9949a6a2537564f5c01e2 May 20 14:06:54.365408 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.365075 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc981a7a1_1b2d_4b13_b765_d5e24c3e8e68.slice/crio-2c197f03bc64ed20db03a1a8e62ed3d39a8fa4de46a2d355b01324766428cc10 WatchSource:0}: Error finding container 2c197f03bc64ed20db03a1a8e62ed3d39a8fa4de46a2d355b01324766428cc10: Status 404 returned error can't find the container with id 2c197f03bc64ed20db03a1a8e62ed3d39a8fa4de46a2d355b01324766428cc10 May 20 14:06:54.370795 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:06:54.370771 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9730e4c3_016c_4b7d_8289_785212527297.slice/crio-02d1ac3e882f8bd6c025afe0a5448677e7aaa83c80d7e964b1eae9076cae69cf WatchSource:0}: Error finding container 02d1ac3e882f8bd6c025afe0a5448677e7aaa83c80d7e964b1eae9076cae69cf: Status 404 returned error can't find the container with id 02d1ac3e882f8bd6c025afe0a5448677e7aaa83c80d7e964b1eae9076cae69cf May 20 14:06:54.687955 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.687921 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:01:52 +0000 UTC" deadline="2028-01-09 15:20:00.553565157 +0000 UTC" May 20 14:06:54.687955 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.687954 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14377h13m5.865613783s" May 20 14:06:54.757833 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.757384 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:54.757833 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:54.757499 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:06:54.769448 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.769409 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ss8jt" event={"ID":"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68","Type":"ContainerStarted","Data":"2c197f03bc64ed20db03a1a8e62ed3d39a8fa4de46a2d355b01324766428cc10"} May 20 14:06:54.771703 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.771649 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n2zxb" event={"ID":"6b8a3398-8c10-42e5-8174-c02973b9dcbe","Type":"ContainerStarted","Data":"822db170f85ba5a24d81a851c6f930e3be0b240269d9949a6a2537564f5c01e2"} May 20 14:06:54.773241 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.773187 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerStarted","Data":"556227d4162061206d04f31e96f32d86e9b799dbc22ea9b82aa48f6e1edff2ef"} May 20 14:06:54.775073 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.775028 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f97vr" event={"ID":"829a3a6c-13ab-44f3-8801-00d16894c694","Type":"ContainerStarted","Data":"77c3213d44911824867c17fb861343495ca2b1ff149b32ae81c9bd9ef42db601"} May 20 14:06:54.777017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.776921 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" event={"ID":"2da66582-c0f7-476d-aba1-824ed50ee8eb","Type":"ContainerStarted","Data":"be645b77f7a44e0acca88c9c2060abe5e288d12762ebb9d1ba2c693d1c6a7d58"} May 20 14:06:54.780569 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.780509 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nz2ww" event={"ID":"c3157c08-3a64-4f76-94f3-dd568f37702c","Type":"ContainerStarted","Data":"efba65b51325189626cffb5250bd302feff8233abc5a1c118ead02c0e3a6f0b9"} May 20 14:06:54.784335 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.784307 2559 generic.go:358] "Generic (PLEG): container finished" podID="3ac7b9ac1d155aa41881d0c2c66c7a1c" containerID="b8727c671058aa1650fbd8ceb460e4f7c2fe4ff35e6246de53e84d77021ce9e7" exitCode=0 May 20 14:06:54.784424 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.784390 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"3ac7b9ac1d155aa41881d0c2c66c7a1c","Type":"ContainerDied","Data":"b8727c671058aa1650fbd8ceb460e4f7c2fe4ff35e6246de53e84d77021ce9e7"} May 20 14:06:54.789015 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.788591 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" event={"ID":"d1328fad5d3e6b09617c1ce056b41386","Type":"ContainerStarted","Data":"67274f70e5bf7f641576d401c090b890991314a78241742ac2d9a05657f41ec6"} May 20 14:06:54.794133 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.794073 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"02d1ac3e882f8bd6c025afe0a5448677e7aaa83c80d7e964b1eae9076cae69cf"} May 20 14:06:54.799849 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.799810 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bd6bf" event={"ID":"a3610a0b-1037-408c-8e36-f09270b02f34","Type":"ContainerStarted","Data":"b77f2d069534e0b74544458e601c8c33e48e6d08af0ed58855a21b4f949a6b85"} May 20 14:06:54.808514 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:54.808489 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47czl" event={"ID":"5e60838f-a479-4e62-8504-2350dea17856","Type":"ContainerStarted","Data":"6b85227554b0db95d897f25dbae7f7de3931d8d571e088912023d221a8456d76"} May 20 14:06:55.239007 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.238924 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:55.239161 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.239104 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:55.239223 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.239175 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:57.239155641 +0000 UTC m=+6.136398544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:55.340159 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.339544 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:55.340159 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.339733 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:55.340159 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.339751 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:55.340159 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.339763 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:55.340159 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.339816 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:06:57.339798527 +0000 UTC m=+6.237041424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:55.759890 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.759858 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:55.760343 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:55.759997 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:06:55.857455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.857352 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" event={"ID":"3ac7b9ac1d155aa41881d0c2c66c7a1c","Type":"ContainerStarted","Data":"be16001807b0f460f87d3f984aa776f262e4964da7453051a56d559e7afeb73b"} May 20 14:06:55.876349 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.875825 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-228.ec2.internal" podStartSLOduration=3.875807665 podStartE2EDuration="3.875807665s" podCreationTimestamp="2026-05-20 14:06:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:06:55.874071633 +0000 UTC m=+4.771314549" watchObservedRunningTime="2026-05-20 14:06:55.875807665 +0000 UTC m=+4.773050576" May 20 14:06:55.876349 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:55.876080 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-228.ec2.internal" podStartSLOduration=3.8760708409999998 podStartE2EDuration="3.876070841s" podCreationTimestamp="2026-05-20 14:06:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:06:54.839119173 +0000 UTC m=+3.736362085" watchObservedRunningTime="2026-05-20 14:06:55.876070841 +0000 UTC m=+4.773313751" May 20 14:06:56.757480 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:56.757444 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:56.757672 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:56.757584 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:06:57.253822 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:57.253739 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:57.254262 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.253873 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:57.254262 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.253938 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:01.253918936 +0000 UTC m=+10.151161828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:06:57.354122 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:57.354083 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:57.354317 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.354279 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:06:57.354317 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.354317 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:06:57.354454 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.354330 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:57.354454 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.354395 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:01.354373309 +0000 UTC m=+10.251616220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:06:57.758195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:57.758165 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:57.758383 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:57.758331 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:06:58.757902 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:58.757630 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:06:58.757902 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:58.757763 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:06:59.758143 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:06:59.757844 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:06:59.758143 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:06:59.758055 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:00.758058 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:00.758023 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:00.758249 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:00.758160 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:01.285272 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:01.285232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:01.285488 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.285423 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:01.285552 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.285508 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:09.285486821 +0000 UTC m=+18.182729726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:01.385711 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:01.385640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:01.385905 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.385887 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:07:01.385969 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.385912 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:07:01.385969 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.385925 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:01.386101 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.385987 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:09.385968955 +0000 UTC m=+18.283211856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:01.760282 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:01.759468 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:01.760282 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:01.759837 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:02.758388 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:02.758350 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:02.758672 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:02.758479 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:03.758304 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:03.758261 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:03.758689 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:03.758417 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:04.758370 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:04.758336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:04.758846 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:04.758461 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:05.758364 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:05.758327 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:05.758539 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:05.758476 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:06.758269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:06.758234 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:06.758443 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:06.758364 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:07.758184 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:07.758101 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:07.758635 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:07.758247 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:08.758392 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:08.758355 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:08.758885 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:08.758475 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:09.351099 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:09.351062 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:09.351334 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.351226 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:09.351334 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.351322 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:25.351282471 +0000 UTC m=+34.248525372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:09.451853 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:09.451806 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:09.452033 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.451997 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:07:09.452033 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.452022 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:07:09.452033 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.452035 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:09.452192 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.452106 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:25.45208754 +0000 UTC m=+34.349330444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:09.758117 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:09.758025 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:09.758281 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:09.758174 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:10.757596 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:10.757565 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:10.758077 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:10.757667 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:11.758268 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:11.758242 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:11.758586 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:11.758355 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:12.757996 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.757793 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:12.758125 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:12.758085 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:12.891786 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.891624 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="ece99ae3afe525afe21c9b7169139d77df2d4bf9234d4c20a18829b5d9201897" exitCode=0 May 20 14:07:12.892379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.891708 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"ece99ae3afe525afe21c9b7169139d77df2d4bf9234d4c20a18829b5d9201897"} May 20 14:07:12.893191 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.893169 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f97vr" event={"ID":"829a3a6c-13ab-44f3-8801-00d16894c694","Type":"ContainerStarted","Data":"2b89a8d7ad9da31077d9e72ccab9f6d6515474dc71be4ac13e0f0432a958eacc"} May 20 14:07:12.895043 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.895021 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" event={"ID":"2da66582-c0f7-476d-aba1-824ed50ee8eb","Type":"ContainerStarted","Data":"5684eed88565b76d1f49cef3f07f2fb3e5c89d19e77a0c4c8e3a9e206ecbe291"} May 20 14:07:12.897023 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.897003 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nz2ww" event={"ID":"c3157c08-3a64-4f76-94f3-dd568f37702c","Type":"ContainerStarted","Data":"72151428fed016c60249d6f5c0ebf1862305dd85d92293e28d93ea74364dc6e2"} May 20 14:07:12.899279 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899261 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:07:12.899588 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899572 2559 generic.go:358] "Generic (PLEG): container finished" podID="9730e4c3-016c-4b7d-8289-785212527297" containerID="02ec339f8ec9e4047b3d5082a0b555ac4fc01777086dae4337d78d5d60ba721f" exitCode=1 May 20 14:07:12.899655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899627 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"e7a4d32a22f2abf08a4f5793fd600dacbc7aad0aa0099d44db6450cf805c0f05"} May 20 14:07:12.899655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899643 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"e8a439bd44b8a9d466e0d34144a3128dc62883fc5d99350c3ad2927e6cf663c6"} May 20 14:07:12.899655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899653 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"51058dad17ae9aa833ca10d44e36b634b146adc4f340ff5beec3f234b1fe9132"} May 20 14:07:12.899760 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899661 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"a9d80ef26341e915c5ae8d376bff11d092c7d2aa40349dc9fd6519acd3a1953a"} May 20 14:07:12.899760 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899670 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerDied","Data":"02ec339f8ec9e4047b3d5082a0b555ac4fc01777086dae4337d78d5d60ba721f"} May 20 14:07:12.899760 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.899683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"81f312f8d6a265688f5004b2e70bdf8d4b372c85e5ed8b4bdac146e47dac8a20"} May 20 14:07:12.900828 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.900811 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47czl" event={"ID":"5e60838f-a479-4e62-8504-2350dea17856","Type":"ContainerStarted","Data":"3391b9a0a5848f13f44fb4a0b683c1487294505f81a79acb7e0e002f0a59076e"} May 20 14:07:12.901933 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.901913 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ss8jt" event={"ID":"c981a7a1-1b2d-4b13-b765-d5e24c3e8e68","Type":"ContainerStarted","Data":"80a297e39cd6fea7c767add0b6fc2dcdb7c3e67e727423922cccef31f8f36bc4"} May 20 14:07:12.902922 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.902904 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n2zxb" event={"ID":"6b8a3398-8c10-42e5-8174-c02973b9dcbe","Type":"ContainerStarted","Data":"f199a9b01be7f2448205e7174355aa22a933915e91cf237fff187d5fe027095c"} May 20 14:07:12.956836 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.956789 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-47czl" podStartSLOduration=4.535503233 podStartE2EDuration="21.956773543s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.370906585 +0000 UTC m=+3.268149475" lastFinishedPulling="2026-05-20 14:07:11.792176882 +0000 UTC m=+20.689419785" observedRunningTime="2026-05-20 14:07:12.938337823 +0000 UTC m=+21.835580745" watchObservedRunningTime="2026-05-20 14:07:12.956773543 +0000 UTC m=+21.854016453" May 20 14:07:12.981546 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:12.981507 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f97vr" podStartSLOduration=4.553961548 podStartE2EDuration="21.981492857s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.364610799 +0000 UTC m=+3.261853701" lastFinishedPulling="2026-05-20 14:07:11.792142116 +0000 UTC m=+20.689385010" observedRunningTime="2026-05-20 14:07:12.956634165 +0000 UTC m=+21.853877074" watchObservedRunningTime="2026-05-20 14:07:12.981492857 +0000 UTC m=+21.878735766" May 20 14:07:13.000452 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.000408 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nz2ww" podStartSLOduration=4.590814819 podStartE2EDuration="22.000397985s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.359704932 +0000 UTC m=+3.256947842" lastFinishedPulling="2026-05-20 14:07:11.769288117 +0000 UTC m=+20.666531008" observedRunningTime="2026-05-20 14:07:13.000154562 +0000 UTC m=+21.897397493" watchObservedRunningTime="2026-05-20 14:07:13.000397985 +0000 UTC m=+21.897640895" May 20 14:07:13.000784 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.000760 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n2zxb" podStartSLOduration=4.562854963 podStartE2EDuration="22.000753876s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.367547902 +0000 UTC m=+3.264790791" lastFinishedPulling="2026-05-20 14:07:11.805446813 +0000 UTC m=+20.702689704" observedRunningTime="2026-05-20 14:07:12.981630274 +0000 UTC m=+21.878873166" watchObservedRunningTime="2026-05-20 14:07:13.000753876 +0000 UTC m=+21.897996821" May 20 14:07:13.533626 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.533603 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 14:07:13.690722 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.690612 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T14:07:13.53362447Z","UUID":"6ecf4db7-4532-4441-99cf-9c7a9b89e16e","Handler":null,"Name":"","Endpoint":""} May 20 14:07:13.692362 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.692341 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 14:07:13.692471 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.692368 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 14:07:13.758219 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.758189 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:13.758394 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:13.758358 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:13.906782 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.906744 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" event={"ID":"2da66582-c0f7-476d-aba1-824ed50ee8eb","Type":"ContainerStarted","Data":"404f73b1a79ba073a98671361089791612ad8ca246a5b60ebff81702d96a96e8"} May 20 14:07:13.908488 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.908409 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bd6bf" event={"ID":"a3610a0b-1037-408c-8e36-f09270b02f34","Type":"ContainerStarted","Data":"6056998572cf00bc5091144aaf4975d90d562a94cd949fa7227b3858ffc2e9de"} May 20 14:07:13.929827 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.929779 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ss8jt" podStartSLOduration=5.593053781 podStartE2EDuration="22.929766756s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.368150483 +0000 UTC m=+3.265393374" lastFinishedPulling="2026-05-20 14:07:11.70486346 +0000 UTC m=+20.602106349" observedRunningTime="2026-05-20 14:07:13.020754016 +0000 UTC m=+21.917996928" watchObservedRunningTime="2026-05-20 14:07:13.929766756 +0000 UTC m=+22.827009666" May 20 14:07:13.929993 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:13.929964 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bd6bf" podStartSLOduration=5.259544987 podStartE2EDuration="22.92995836s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.369612276 +0000 UTC m=+3.266855169" lastFinishedPulling="2026-05-20 14:07:12.040025654 +0000 UTC m=+20.937268542" observedRunningTime="2026-05-20 14:07:13.929396373 +0000 UTC m=+22.826639283" watchObservedRunningTime="2026-05-20 14:07:13.92995836 +0000 UTC m=+22.827201270" May 20 14:07:14.758241 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:14.758210 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:14.758398 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:14.758374 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:14.912639 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:14.912598 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" event={"ID":"2da66582-c0f7-476d-aba1-824ed50ee8eb","Type":"ContainerStarted","Data":"5e06d6a0afc5790429d6057fadadd18cb52327d3d98fc002324769388455ca42"} May 20 14:07:14.916080 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:14.916059 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:07:14.916679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:14.916509 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"143acb4511e4bd3352bc109fd006a56323aa54e5979842d288923e35b5d91539"} May 20 14:07:14.955483 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:14.955406 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87wsp" podStartSLOduration=3.6251045189999997 podStartE2EDuration="23.955379035s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.361893493 +0000 UTC m=+3.259136395" lastFinishedPulling="2026-05-20 14:07:14.692168018 +0000 UTC m=+23.589410911" observedRunningTime="2026-05-20 14:07:14.955057936 +0000 UTC m=+23.852300847" watchObservedRunningTime="2026-05-20 14:07:14.955379035 +0000 UTC m=+23.852621943" May 20 14:07:15.145866 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:15.145835 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-47czl" May 20 14:07:15.146662 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:15.146638 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-47czl" May 20 14:07:15.758318 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:15.758269 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:15.758501 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:15.758406 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:15.919098 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:15.919068 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-47czl" May 20 14:07:15.919632 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:15.919441 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-47czl" May 20 14:07:16.757480 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:16.757449 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:16.757678 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:16.757570 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:17.757721 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.757544 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:17.758184 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:17.757793 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:17.923602 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.923571 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="76ee8c55981772c4894b8b6ddafbfd2521a01ea51096c2555ebf7e525a593377" exitCode=0 May 20 14:07:17.923730 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.923662 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"76ee8c55981772c4894b8b6ddafbfd2521a01ea51096c2555ebf7e525a593377"} May 20 14:07:17.929398 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.929382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:07:17.929705 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.929681 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"bbc6ffb01134a91d32327cf276b36870ceb8ab2181e71ba79f4d67b2f2916636"} May 20 14:07:17.930121 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:17.930103 2559 scope.go:117] "RemoveContainer" containerID="02ec339f8ec9e4047b3d5082a0b555ac4fc01777086dae4337d78d5d60ba721f" May 20 14:07:18.757896 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.757731 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:18.758232 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:18.757950 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:18.927127 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.927093 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kq8v7"] May 20 14:07:18.927290 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.927276 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:18.927473 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:18.927437 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:18.930655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.930632 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrzhm"] May 20 14:07:18.935540 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.935524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:07:18.935937 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.935902 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" event={"ID":"9730e4c3-016c-4b7d-8289-785212527297","Type":"ContainerStarted","Data":"c01f90afd82857228640fd8d66df3cff6c9f0140d0a03e8861dbd79fab91d3a5"} May 20 14:07:18.936141 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.936110 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:18.936236 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.936213 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:18.936236 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.936243 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:18.938439 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.938406 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="606d01d1554b97108204e3867340c42e6c2b7803cdf010fd42c84f90fc4c882f" exitCode=0 May 20 14:07:18.938566 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.938472 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:18.938566 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.938498 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"606d01d1554b97108204e3867340c42e6c2b7803cdf010fd42c84f90fc4c882f"} May 20 14:07:18.938669 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:18.938567 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:18.954168 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.954145 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:18.954275 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.954215 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:18.990912 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:18.990863 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" podStartSLOduration=10.253734929 podStartE2EDuration="27.990847763s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.373015701 +0000 UTC m=+3.270258592" lastFinishedPulling="2026-05-20 14:07:12.110128522 +0000 UTC m=+21.007371426" observedRunningTime="2026-05-20 14:07:18.989216347 +0000 UTC m=+27.886459257" watchObservedRunningTime="2026-05-20 14:07:18.990847763 +0000 UTC m=+27.888090667" May 20 14:07:19.942654 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:19.942620 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="9334066a0fd6c122ac52ea86468559acc28586af032bed5b2ac0cea6dba90cac" exitCode=0 May 20 14:07:19.943183 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:19.942702 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"9334066a0fd6c122ac52ea86468559acc28586af032bed5b2ac0cea6dba90cac"} May 20 14:07:20.758160 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:20.758125 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:20.758363 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:20.758248 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:20.758363 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:20.758319 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:20.758502 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:20.758442 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:22.757860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:22.757828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:22.758548 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:22.757828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:22.758548 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:22.757959 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:22.758548 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:22.758020 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:24.757992 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.757697 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:24.757992 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.757697 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:24.758455 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:24.758054 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzhm" podUID="9c57d738-6eef-4714-ab04-125259f994b1" May 20 14:07:24.758455 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:24.758100 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kq8v7" podUID="49dd36d9-c144-456e-8660-511749aedeb6" May 20 14:07:24.880723 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.880693 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-228.ec2.internal" event="NodeReady" May 20 14:07:24.880885 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.880834 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 14:07:24.937100 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.937069 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gxsvt"] May 20 14:07:24.948586 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.948557 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wvxg9"] May 20 14:07:24.948741 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.948718 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxsvt" May 20 14:07:24.951549 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.951527 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 14:07:24.951549 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.951592 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9jh8\"" May 20 14:07:24.952262 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.951931 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 14:07:24.956473 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.956452 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wvxg9"] May 20 14:07:24.956473 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.956478 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxsvt"] May 20 14:07:24.956626 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.956581 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:24.960968 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.960308 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 14:07:24.960968 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.960594 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 14:07:24.960968 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.960909 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 14:07:24.962016 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:24.961994 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g69fg\"" May 20 14:07:25.069385 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gqh9\" (UniqueName: \"kubernetes.io/projected/8c62a9bf-0dac-4d9c-841e-08760541e5b8-kube-api-access-6gqh9\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.069385 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fmr9\" (UniqueName: \"kubernetes.io/projected/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-kube-api-access-2fmr9\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.069608 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c62a9bf-0dac-4d9c-841e-08760541e5b8-config-volume\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.069608 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c62a9bf-0dac-4d9c-841e-08760541e5b8-tmp-dir\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.069608 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.069608 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.069546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.170844 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.170807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c62a9bf-0dac-4d9c-841e-08760541e5b8-config-volume\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.170844 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.170856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c62a9bf-0dac-4d9c-841e-08760541e5b8-tmp-dir\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.171062 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.171232 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.171197 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:25.171373 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.171262 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:25.171373 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c62a9bf-0dac-4d9c-841e-08760541e5b8-tmp-dir\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.171373 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.171285 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:25.671264595 +0000 UTC m=+34.568507502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:25.171373 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.171373 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.171329 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:25.671317076 +0000 UTC m=+34.568559978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:25.171605 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqh9\" (UniqueName: \"kubernetes.io/projected/8c62a9bf-0dac-4d9c-841e-08760541e5b8-kube-api-access-6gqh9\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.171605 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171435 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fmr9\" (UniqueName: \"kubernetes.io/projected/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-kube-api-access-2fmr9\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.171605 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.171500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c62a9bf-0dac-4d9c-841e-08760541e5b8-config-volume\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.182623 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.182594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqh9\" (UniqueName: \"kubernetes.io/projected/8c62a9bf-0dac-4d9c-841e-08760541e5b8-kube-api-access-6gqh9\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.182840 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.182817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fmr9\" (UniqueName: \"kubernetes.io/projected/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-kube-api-access-2fmr9\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.373946 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.373872 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:25.374078 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.373983 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:25.374078 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.374045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:57.374031491 +0000 UTC m=+66.271274379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:07:25.474905 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.474876 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:25.475064 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.475044 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:07:25.475105 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.475069 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:07:25.475105 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.475080 2559 projected.go:194] Error preparing data for projected volume kube-api-access-r7z68 for pod openshift-network-diagnostics/network-check-target-jrzhm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:25.475165 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.475130 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68 podName:9c57d738-6eef-4714-ab04-125259f994b1 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:57.475115382 +0000 UTC m=+66.372358270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7z68" (UniqueName: "kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68") pod "network-check-target-jrzhm" (UID: "9c57d738-6eef-4714-ab04-125259f994b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:07:25.676541 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.676509 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:25.676638 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.676575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:25.676698 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.676659 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:25.676698 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.676671 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:25.676772 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.676714 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:26.676700035 +0000 UTC m=+35.573942922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:25.676772 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:25.676727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:26.676721551 +0000 UTC m=+35.573964439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:25.955870 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.955842 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="6799860b14c1468cf498d7b38350d6b9ddc993ba9242aa70934f972ebfe208ac" exitCode=0 May 20 14:07:25.956204 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:25.955899 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"6799860b14c1468cf498d7b38350d6b9ddc993ba9242aa70934f972ebfe208ac"} May 20 14:07:26.683208 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.683166 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:26.683440 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.683221 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:26.683440 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:26.683268 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:26.683440 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:26.683330 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:26.683440 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:26.683349 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:28.6833343 +0000 UTC m=+37.580577192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:26.683440 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:26.683370 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:28.68335841 +0000 UTC m=+37.580601298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:26.757614 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.757586 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:26.757614 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.757600 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:26.760567 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.760542 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:07:26.761835 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.761815 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:07:26.761932 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.761814 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:07:26.761932 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.761853 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rhhv\"" May 20 14:07:26.761932 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.761854 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88x2p\"" May 20 14:07:26.961342 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.961230 2559 generic.go:358] "Generic (PLEG): container finished" podID="539cf384-a6b6-45df-9597-af3dda9d5f49" containerID="e47ad14b7409aded2aeea5aa81a2e7daa3517b9eeccc6e5265be77ac0ee7a53e" exitCode=0 May 20 14:07:26.961342 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:26.961291 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerDied","Data":"e47ad14b7409aded2aeea5aa81a2e7daa3517b9eeccc6e5265be77ac0ee7a53e"} May 20 14:07:27.966173 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:27.966132 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tprj2" event={"ID":"539cf384-a6b6-45df-9597-af3dda9d5f49","Type":"ContainerStarted","Data":"db19eba6fe8d0c8e00874aaa6bc34ca70863d31cebe70fcc13f3f33499982994"} May 20 14:07:27.996861 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:27.996817 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tprj2" podStartSLOduration=5.851998322 podStartE2EDuration="36.996803241s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:06:54.366215968 +0000 UTC m=+3.263458871" lastFinishedPulling="2026-05-20 14:07:25.511020888 +0000 UTC m=+34.408263790" observedRunningTime="2026-05-20 14:07:27.996095537 +0000 UTC m=+36.893338446" watchObservedRunningTime="2026-05-20 14:07:27.996803241 +0000 UTC m=+36.894046151" May 20 14:07:28.697866 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:28.697828 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:28.698040 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:28.697901 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:28.698040 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:28.697978 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:28.698040 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:28.697992 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:28.698201 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:28.698056 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:32.698034095 +0000 UTC m=+41.595276997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:28.698201 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:28.698073 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:32.698064098 +0000 UTC m=+41.595306989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:32.722472 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:32.722436 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:32.722854 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:32.722527 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:32.722854 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:32.722585 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:32.722854 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:32.722603 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:32.722854 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:32.722648 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:40.722630666 +0000 UTC m=+49.619873560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:32.722854 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:32.722666 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:40.722657914 +0000 UTC m=+49.619900818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:40.771311 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:40.771252 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:40.771909 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:40.771328 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:40.771909 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:40.771434 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:40.771909 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:40.771435 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:40.771909 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:40.771486 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:56.771473194 +0000 UTC m=+65.668716081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:40.771909 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:40.771573 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:07:56.771553962 +0000 UTC m=+65.668796866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:50.954634 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:50.954597 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnh5s" May 20 14:07:56.774776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:56.774744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:07:56.775234 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:56.774804 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:07:56.775234 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:56.774882 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 14:07:56.775234 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:56.774940 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls podName:8c62a9bf-0dac-4d9c-841e-08760541e5b8 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:28.77492452 +0000 UTC m=+97.672167407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls") pod "dns-default-gxsvt" (UID: "8c62a9bf-0dac-4d9c-841e-08760541e5b8") : secret "dns-default-metrics-tls" not found May 20 14:07:56.775234 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:56.774885 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 14:07:56.775234 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:56.775010 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert podName:2b1476c0-d49e-462a-a67b-7e98f1e0faf0 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:28.774998303 +0000 UTC m=+97.672241191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert") pod "ingress-canary-wvxg9" (UID: "2b1476c0-d49e-462a-a67b-7e98f1e0faf0") : secret "canary-serving-cert" not found May 20 14:07:57.378252 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.378220 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:07:57.381401 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.381385 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:07:57.389041 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:57.389023 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 14:07:57.389091 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:07:57.389076 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs podName:49dd36d9-c144-456e-8660-511749aedeb6 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:01.389060933 +0000 UTC m=+130.286303821 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs") pod "network-metrics-daemon-kq8v7" (UID: "49dd36d9-c144-456e-8660-511749aedeb6") : secret "metrics-daemon-secret" not found May 20 14:07:57.479360 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.479337 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:57.482194 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.482178 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:07:57.492380 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.492362 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:07:57.503281 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.503248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7z68\" (UniqueName: \"kubernetes.io/projected/9c57d738-6eef-4714-ab04-125259f994b1-kube-api-access-r7z68\") pod \"network-check-target-jrzhm\" (UID: \"9c57d738-6eef-4714-ab04-125259f994b1\") " pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:57.670667 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.670642 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88x2p\"" May 20 14:07:57.678235 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.678215 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:07:57.808790 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:57.808761 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrzhm"] May 20 14:07:57.813672 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:07:57.813649 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c57d738_6eef_4714_ab04_125259f994b1.slice/crio-d159d12b694a623c061b2c20c5b40fe437a13f32f3ae031cc71930cbf91add6f WatchSource:0}: Error finding container d159d12b694a623c061b2c20c5b40fe437a13f32f3ae031cc71930cbf91add6f: Status 404 returned error can't find the container with id d159d12b694a623c061b2c20c5b40fe437a13f32f3ae031cc71930cbf91add6f May 20 14:07:58.020763 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:07:58.020699 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrzhm" event={"ID":"9c57d738-6eef-4714-ab04-125259f994b1","Type":"ContainerStarted","Data":"d159d12b694a623c061b2c20c5b40fe437a13f32f3ae031cc71930cbf91add6f"} May 20 14:08:01.030558 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:01.030526 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrzhm" event={"ID":"9c57d738-6eef-4714-ab04-125259f994b1","Type":"ContainerStarted","Data":"82b769e59e3e3d3466f52cdb67d7c37ef71dc99e35c33a134bdee05b97c35bc2"} May 20 14:08:01.030886 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:01.030672 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:08:01.054148 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:01.054108 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrzhm" podStartSLOduration=67.031633751 podStartE2EDuration="1m10.054096091s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:07:57.815336963 +0000 UTC m=+66.712579851" lastFinishedPulling="2026-05-20 14:08:00.837799284 +0000 UTC m=+69.735042191" observedRunningTime="2026-05-20 14:08:01.053769158 +0000 UTC m=+69.951012068" watchObservedRunningTime="2026-05-20 14:08:01.054096091 +0000 UTC m=+69.951339002" May 20 14:08:05.468970 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.468934 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2"] May 20 14:08:05.470694 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.470678 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" May 20 14:08:05.474229 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.474197 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 20 14:08:05.475451 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.475422 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 20 14:08:05.475451 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.475428 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4qjjj\"" May 20 14:08:05.499722 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.499702 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2"] May 20 14:08:05.515221 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.515201 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bqvj7"] May 20 14:08:05.516679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.516662 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-77c656b884-rzkd9"] May 20 14:08:05.516814 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.516798 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.518227 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.518208 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.523046 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.522976 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 20 14:08:05.523046 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523024 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 14:08:05.523189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523076 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xfhph\"" May 20 14:08:05.523189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523082 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h5ns8\"" May 20 14:08:05.523189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523026 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 20 14:08:05.523189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523086 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 20 14:08:05.523189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.522975 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 20 14:08:05.523445 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.523374 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 20 14:08:05.524194 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.524165 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 14:08:05.524287 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.524231 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 14:08:05.524406 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.524391 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 20 14:08:05.524470 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.524449 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 14:08:05.528895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.528765 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 20 14:08:05.536945 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.536912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.536945 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.536949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.536968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-snapshots\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.536984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd9g\" (UniqueName: \"kubernetes.io/projected/a3b912a9-6865-46f4-bf8a-5b2151647e69-kube-api-access-mcd9g\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537161 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-stats-auth\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.537161 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vtd\" (UniqueName: \"kubernetes.io/projected/f4a3e708-52e4-49c6-ace5-221329cd3263-kube-api-access-h4vtd\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.537161 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-default-certificate\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.537249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98p82\" (UniqueName: \"kubernetes.io/projected/182abc85-b0ba-4a04-bf6d-83dec4d83006-kube-api-access-98p82\") pod \"volume-data-source-validator-5cf8c89d64-zvng2\" (UID: \"182abc85-b0ba-4a04-bf6d-83dec4d83006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" May 20 14:08:05.537249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-tmp\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3b912a9-6865-46f4-bf8a-5b2151647e69-serving-cert\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.537249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.537234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.543073 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.543050 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bqvj7"] May 20 14:08:05.543700 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.543680 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77c656b884-rzkd9"] May 20 14:08:05.574763 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.574733 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r"] May 20 14:08:05.576442 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.576424 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" May 20 14:08:05.579107 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.579090 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nxn4b\"" May 20 14:08:05.592709 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.592686 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9"] May 20 14:08:05.595786 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.595766 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r"] May 20 14:08:05.595918 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.595904 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.599075 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.599054 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 20 14:08:05.599170 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.599101 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zkvfb\"" May 20 14:08:05.600011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.599994 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 20 14:08:05.600091 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.600026 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 20 14:08:05.600129 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.600101 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 20 14:08:05.614903 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.614883 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9"] May 20 14:08:05.638378 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638351 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-snapshots\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.638477 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638387 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.638477 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638414 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd9g\" (UniqueName: \"kubernetes.io/projected/a3b912a9-6865-46f4-bf8a-5b2151647e69-kube-api-access-mcd9g\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.638477 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638464 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-stats-auth\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.638636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638488 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vtd\" (UniqueName: \"kubernetes.io/projected/f4a3e708-52e4-49c6-ace5-221329cd3263-kube-api-access-h4vtd\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.638636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638519 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-default-certificate\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.638636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638543 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98p82\" (UniqueName: \"kubernetes.io/projected/182abc85-b0ba-4a04-bf6d-83dec4d83006-kube-api-access-98p82\") pod \"volume-data-source-validator-5cf8c89d64-zvng2\" (UID: \"182abc85-b0ba-4a04-bf6d-83dec4d83006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" May 20 14:08:05.638636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638574 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-tmp\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.638636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638600 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3b912a9-6865-46f4-bf8a-5b2151647e69-serving-cert\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.638874 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/1db15b3f-2004-45de-a6a3-ceb5067df016-kube-api-access-9m6wn\") pod \"network-check-source-7f44b6dd87-9mv7r\" (UID: \"1db15b3f-2004-45de-a6a3-ceb5067df016\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" May 20 14:08:05.638874 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638671 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.638874 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.638700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75583376-5a48-45d0-8828-a96c320c782b-config\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.639027 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:05.639013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:06.138987163 +0000 UTC m=+75.036230077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : configmap references non-existent config key: service-ca.crt May 20 14:08:05.639165 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-snapshots\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.639254 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dj4r\" (UniqueName: \"kubernetes.io/projected/75583376-5a48-45d0-8828-a96c320c782b-kube-api-access-8dj4r\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.639254 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b912a9-6865-46f4-bf8a-5b2151647e69-tmp\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.639428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639252 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.639428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639279 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.639428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75583376-5a48-45d0-8828-a96c320c782b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.639428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.639397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-service-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.639639 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:05.639443 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 14:08:05.639639 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:05.639522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:06.139501941 +0000 UTC m=+75.036744847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : secret "router-metrics-certs-default" not found May 20 14:08:05.640046 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.640025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b912a9-6865-46f4-bf8a-5b2151647e69-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.641037 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.641017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-stats-auth\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.641127 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.641057 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3b912a9-6865-46f4-bf8a-5b2151647e69-serving-cert\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.641168 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.641139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-default-certificate\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.665556 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.665534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vtd\" (UniqueName: \"kubernetes.io/projected/f4a3e708-52e4-49c6-ace5-221329cd3263-kube-api-access-h4vtd\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:05.667044 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.667019 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd9g\" (UniqueName: \"kubernetes.io/projected/a3b912a9-6865-46f4-bf8a-5b2151647e69-kube-api-access-mcd9g\") pod \"insights-operator-78bdfb888c-bqvj7\" (UID: \"a3b912a9-6865-46f4-bf8a-5b2151647e69\") " pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.675775 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.675750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98p82\" (UniqueName: \"kubernetes.io/projected/182abc85-b0ba-4a04-bf6d-83dec4d83006-kube-api-access-98p82\") pod \"volume-data-source-validator-5cf8c89d64-zvng2\" (UID: \"182abc85-b0ba-4a04-bf6d-83dec4d83006\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" May 20 14:08:05.739808 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.739756 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/1db15b3f-2004-45de-a6a3-ceb5067df016-kube-api-access-9m6wn\") pod \"network-check-source-7f44b6dd87-9mv7r\" (UID: \"1db15b3f-2004-45de-a6a3-ceb5067df016\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" May 20 14:08:05.739808 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.739793 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75583376-5a48-45d0-8828-a96c320c782b-config\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.739925 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.739811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dj4r\" (UniqueName: \"kubernetes.io/projected/75583376-5a48-45d0-8828-a96c320c782b-kube-api-access-8dj4r\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.739925 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.739877 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75583376-5a48-45d0-8828-a96c320c782b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.740343 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.740326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75583376-5a48-45d0-8828-a96c320c782b-config\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.741758 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.741740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75583376-5a48-45d0-8828-a96c320c782b-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.751961 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.751939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dj4r\" (UniqueName: \"kubernetes.io/projected/75583376-5a48-45d0-8828-a96c320c782b-kube-api-access-8dj4r\") pod \"kube-storage-version-migrator-operator-565644f49-br4s9\" (UID: \"75583376-5a48-45d0-8828-a96c320c782b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.752158 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.752142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6wn\" (UniqueName: \"kubernetes.io/projected/1db15b3f-2004-45de-a6a3-ceb5067df016-kube-api-access-9m6wn\") pod \"network-check-source-7f44b6dd87-9mv7r\" (UID: \"1db15b3f-2004-45de-a6a3-ceb5067df016\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" May 20 14:08:05.778850 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.778823 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" May 20 14:08:05.826566 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.826535 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" May 20 14:08:05.884979 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.884953 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" May 20 14:08:05.904611 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.904583 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" May 20 14:08:05.908259 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.908235 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2"] May 20 14:08:05.915276 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:05.915244 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182abc85_b0ba_4a04_bf6d_83dec4d83006.slice/crio-8f0c7c901baf898a82297b57dd8617b67c0dbb234ca80618201e19fdba42219c WatchSource:0}: Error finding container 8f0c7c901baf898a82297b57dd8617b67c0dbb234ca80618201e19fdba42219c: Status 404 returned error can't find the container with id 8f0c7c901baf898a82297b57dd8617b67c0dbb234ca80618201e19fdba42219c May 20 14:08:05.958396 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:05.958337 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-bqvj7"] May 20 14:08:05.963457 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:05.963385 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b912a9_6865_46f4_bf8a_5b2151647e69.slice/crio-1b3a3e3eae4d898c2f4331b968ae02439b4321b60f8bac5e69bf3de34a19f4a3 WatchSource:0}: Error finding container 1b3a3e3eae4d898c2f4331b968ae02439b4321b60f8bac5e69bf3de34a19f4a3: Status 404 returned error can't find the container with id 1b3a3e3eae4d898c2f4331b968ae02439b4321b60f8bac5e69bf3de34a19f4a3 May 20 14:08:06.018188 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.018107 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r"] May 20 14:08:06.021497 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:06.021468 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db15b3f_2004_45de_a6a3_ceb5067df016.slice/crio-c549662026c9b04884426c2de296b49a9bf39f1b731d472fc6e80e0b9b1b6832 WatchSource:0}: Error finding container c549662026c9b04884426c2de296b49a9bf39f1b731d472fc6e80e0b9b1b6832: Status 404 returned error can't find the container with id c549662026c9b04884426c2de296b49a9bf39f1b731d472fc6e80e0b9b1b6832 May 20 14:08:06.039010 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.038976 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9"] May 20 14:08:06.041461 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:06.041439 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75583376_5a48_45d0_8828_a96c320c782b.slice/crio-6590e17501225de31243dbb9d54f4cb788fd3a786c9cebcf2b9d6a80a1ef726d WatchSource:0}: Error finding container 6590e17501225de31243dbb9d54f4cb788fd3a786c9cebcf2b9d6a80a1ef726d: Status 404 returned error can't find the container with id 6590e17501225de31243dbb9d54f4cb788fd3a786c9cebcf2b9d6a80a1ef726d May 20 14:08:06.041532 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.041473 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" event={"ID":"1db15b3f-2004-45de-a6a3-ceb5067df016","Type":"ContainerStarted","Data":"c549662026c9b04884426c2de296b49a9bf39f1b731d472fc6e80e0b9b1b6832"} May 20 14:08:06.042476 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.042375 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" event={"ID":"a3b912a9-6865-46f4-bf8a-5b2151647e69","Type":"ContainerStarted","Data":"1b3a3e3eae4d898c2f4331b968ae02439b4321b60f8bac5e69bf3de34a19f4a3"} May 20 14:08:06.043443 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.043412 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" event={"ID":"182abc85-b0ba-4a04-bf6d-83dec4d83006","Type":"ContainerStarted","Data":"8f0c7c901baf898a82297b57dd8617b67c0dbb234ca80618201e19fdba42219c"} May 20 14:08:06.142540 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.142510 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:06.142698 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:06.142612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:06.142698 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:06.142664 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 14:08:06.142798 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:06.142736 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:07.142716918 +0000 UTC m=+76.039959826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : secret "router-metrics-certs-default" not found May 20 14:08:06.142798 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:06.142763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:07.142748925 +0000 UTC m=+76.039991812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : configmap references non-existent config key: service-ca.crt May 20 14:08:07.047071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:07.047029 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" event={"ID":"75583376-5a48-45d0-8828-a96c320c782b","Type":"ContainerStarted","Data":"6590e17501225de31243dbb9d54f4cb788fd3a786c9cebcf2b9d6a80a1ef726d"} May 20 14:08:07.049230 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:07.049177 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" event={"ID":"1db15b3f-2004-45de-a6a3-ceb5067df016","Type":"ContainerStarted","Data":"d8bc599bf1e595732fc5116365cecc3147247a3eafb0bc5a82cdb6fdcdd14066"} May 20 14:08:07.070893 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:07.070822 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-9mv7r" podStartSLOduration=2.070803804 podStartE2EDuration="2.070803804s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:08:07.069639945 +0000 UTC m=+75.966882856" watchObservedRunningTime="2026-05-20 14:08:07.070803804 +0000 UTC m=+75.968046723" May 20 14:08:07.150291 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:07.150256 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:07.150469 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:07.150383 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:07.150536 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:07.150523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:09.150504123 +0000 UTC m=+78.047747014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : configmap references non-existent config key: service-ca.crt May 20 14:08:07.151355 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:07.150908 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 14:08:07.151355 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:07.150959 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:09.150942777 +0000 UTC m=+78.048185671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : secret "router-metrics-certs-default" not found May 20 14:08:08.052844 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:08.052807 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" event={"ID":"182abc85-b0ba-4a04-bf6d-83dec4d83006","Type":"ContainerStarted","Data":"01435ac1b882e04f0c80b1af9faee225216237daf865640b8056436fb58fbb80"} May 20 14:08:08.073831 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:08.073787 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-zvng2" podStartSLOduration=1.721094439 podStartE2EDuration="3.073773393s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="2026-05-20 14:08:05.917826397 +0000 UTC m=+74.815069306" lastFinishedPulling="2026-05-20 14:08:07.270505365 +0000 UTC m=+76.167748260" observedRunningTime="2026-05-20 14:08:08.072441753 +0000 UTC m=+76.969684699" watchObservedRunningTime="2026-05-20 14:08:08.073773393 +0000 UTC m=+76.971016302" May 20 14:08:09.057242 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.057206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" event={"ID":"75583376-5a48-45d0-8828-a96c320c782b","Type":"ContainerStarted","Data":"fa943ca9cae3b84c1b09be4ac43d548d310b30478ced07054ac37aaa20b19ff1"} May 20 14:08:09.058592 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.058562 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" event={"ID":"a3b912a9-6865-46f4-bf8a-5b2151647e69","Type":"ContainerStarted","Data":"cf82bf6518226216bdf2ae5e97eb2dc0b28cd3c9583f960f570ae6c053713228"} May 20 14:08:09.080782 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.080732 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" podStartSLOduration=1.638478729 podStartE2EDuration="4.080716472s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="2026-05-20 14:08:06.043621128 +0000 UTC m=+74.940864018" lastFinishedPulling="2026-05-20 14:08:08.485858858 +0000 UTC m=+77.383101761" observedRunningTime="2026-05-20 14:08:09.080507339 +0000 UTC m=+77.977750251" watchObservedRunningTime="2026-05-20 14:08:09.080716472 +0000 UTC m=+77.977959384" May 20 14:08:09.132921 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.132880 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" podStartSLOduration=1.6161806570000001 podStartE2EDuration="4.132867168s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="2026-05-20 14:08:05.966893913 +0000 UTC m=+74.864136812" lastFinishedPulling="2026-05-20 14:08:08.48358042 +0000 UTC m=+77.380823323" observedRunningTime="2026-05-20 14:08:09.131472762 +0000 UTC m=+78.028715674" watchObservedRunningTime="2026-05-20 14:08:09.132867168 +0000 UTC m=+78.030110077" May 20 14:08:09.166475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.166450 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:09.166637 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:09.166617 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:13.16659595 +0000 UTC m=+82.063838841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : configmap references non-existent config key: service-ca.crt May 20 14:08:09.167233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:09.166814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:09.167233 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:09.166930 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 14:08:09.167233 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:09.166982 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:13.166966049 +0000 UTC m=+82.064208944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : secret "router-metrics-certs-default" not found May 20 14:08:11.348734 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:11.348707 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nz2ww_c3157c08-3a64-4f76-94f3-dd568f37702c/dns-node-resolver/0.log" May 20 14:08:12.760677 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:12.760648 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ss8jt_c981a7a1-1b2d-4b13-b765-d5e24c3e8e68/node-ca/0.log" May 20 14:08:13.197760 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:13.197721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:13.197930 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:13.197778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:13.197930 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:13.197872 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 14:08:13.197930 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:13.197890 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:21.197871182 +0000 UTC m=+90.095114070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : configmap references non-existent config key: service-ca.crt May 20 14:08:13.197930 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:13.197929 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs podName:f4a3e708-52e4-49c6-ace5-221329cd3263 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:21.197917452 +0000 UTC m=+90.095160340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs") pod "router-default-77c656b884-rzkd9" (UID: "f4a3e708-52e4-49c6-ace5-221329cd3263") : secret "router-metrics-certs-default" not found May 20 14:08:21.259594 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.259559 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:21.259957 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.259612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:21.260124 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.260102 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4a3e708-52e4-49c6-ace5-221329cd3263-service-ca-bundle\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:21.261868 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.261851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a3e708-52e4-49c6-ace5-221329cd3263-metrics-certs\") pod \"router-default-77c656b884-rzkd9\" (UID: \"f4a3e708-52e4-49c6-ace5-221329cd3263\") " pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:21.431393 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.431347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:21.578522 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:21.578446 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77c656b884-rzkd9"] May 20 14:08:21.580979 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:21.580945 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a3e708_52e4_49c6_ace5_221329cd3263.slice/crio-be7e2e562d3bdbedc35f9dbd6ed19b9668362cfe696af81a6de50f386084e52b WatchSource:0}: Error finding container be7e2e562d3bdbedc35f9dbd6ed19b9668362cfe696af81a6de50f386084e52b: Status 404 returned error can't find the container with id be7e2e562d3bdbedc35f9dbd6ed19b9668362cfe696af81a6de50f386084e52b May 20 14:08:22.091958 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:22.091922 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77c656b884-rzkd9" event={"ID":"f4a3e708-52e4-49c6-ace5-221329cd3263","Type":"ContainerStarted","Data":"831fd6c90443393ba15a788e6d1896742654f8b51140a35c79397d22398009cf"} May 20 14:08:22.091958 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:22.091962 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77c656b884-rzkd9" event={"ID":"f4a3e708-52e4-49c6-ace5-221329cd3263","Type":"ContainerStarted","Data":"be7e2e562d3bdbedc35f9dbd6ed19b9668362cfe696af81a6de50f386084e52b"} May 20 14:08:22.126520 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:22.126483 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-77c656b884-rzkd9" podStartSLOduration=17.126470872 podStartE2EDuration="17.126470872s" podCreationTimestamp="2026-05-20 14:08:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:08:22.125889826 +0000 UTC m=+91.023132735" watchObservedRunningTime="2026-05-20 14:08:22.126470872 +0000 UTC m=+91.023713782" May 20 14:08:22.432529 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:22.432493 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:22.434998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:22.434974 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:23.094684 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:23.094656 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:23.095906 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:23.095886 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-77c656b884-rzkd9" May 20 14:08:28.815732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.815632 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:08:28.815732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.815690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:08:28.818008 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.817983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c62a9bf-0dac-4d9c-841e-08760541e5b8-metrics-tls\") pod \"dns-default-gxsvt\" (UID: \"8c62a9bf-0dac-4d9c-841e-08760541e5b8\") " pod="openshift-dns/dns-default-gxsvt" May 20 14:08:28.818122 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.818065 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b1476c0-d49e-462a-a67b-7e98f1e0faf0-cert\") pod \"ingress-canary-wvxg9\" (UID: \"2b1476c0-d49e-462a-a67b-7e98f1e0faf0\") " pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:08:28.866648 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.866623 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9jh8\"" May 20 14:08:28.874242 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.874223 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxsvt" May 20 14:08:28.874559 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.874538 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g69fg\"" May 20 14:08:28.882897 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:28.882874 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wvxg9" May 20 14:08:29.021993 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:29.021967 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxsvt"] May 20 14:08:29.024590 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:29.024561 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c62a9bf_0dac_4d9c_841e_08760541e5b8.slice/crio-25ca97432525f0de2f7adf4ec2ed94c128356cb6e54dfb86d6f5516126e0751e WatchSource:0}: Error finding container 25ca97432525f0de2f7adf4ec2ed94c128356cb6e54dfb86d6f5516126e0751e: Status 404 returned error can't find the container with id 25ca97432525f0de2f7adf4ec2ed94c128356cb6e54dfb86d6f5516126e0751e May 20 14:08:29.035321 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:29.035282 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wvxg9"] May 20 14:08:29.038508 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:29.038488 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1476c0_d49e_462a_a67b_7e98f1e0faf0.slice/crio-ae76d5ed914673cd04515cac50fd3c0834b5181af26f25932db211d1de1dde81 WatchSource:0}: Error finding container ae76d5ed914673cd04515cac50fd3c0834b5181af26f25932db211d1de1dde81: Status 404 returned error can't find the container with id ae76d5ed914673cd04515cac50fd3c0834b5181af26f25932db211d1de1dde81 May 20 14:08:29.112125 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:29.112057 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxsvt" event={"ID":"8c62a9bf-0dac-4d9c-841e-08760541e5b8","Type":"ContainerStarted","Data":"25ca97432525f0de2f7adf4ec2ed94c128356cb6e54dfb86d6f5516126e0751e"} May 20 14:08:29.112978 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:29.112958 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wvxg9" event={"ID":"2b1476c0-d49e-462a-a67b-7e98f1e0faf0","Type":"ContainerStarted","Data":"ae76d5ed914673cd04515cac50fd3c0834b5181af26f25932db211d1de1dde81"} May 20 14:08:31.119249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:31.119208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxsvt" event={"ID":"8c62a9bf-0dac-4d9c-841e-08760541e5b8","Type":"ContainerStarted","Data":"fbf1e14bb2d0ff469799a18607cdd06cfb5a8d34623355a6bfa7f29b6ae37ecf"} May 20 14:08:31.119249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:31.119255 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxsvt" event={"ID":"8c62a9bf-0dac-4d9c-841e-08760541e5b8","Type":"ContainerStarted","Data":"9f80271bc4d958174ef19f6595c5bc68d551d0d7588131dea656a63f1ce8aec6"} May 20 14:08:31.119757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:31.119435 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gxsvt" May 20 14:08:31.146402 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:31.146355 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gxsvt" podStartSLOduration=65.702385223 podStartE2EDuration="1m7.146340426s" podCreationTimestamp="2026-05-20 14:07:24 +0000 UTC" firstStartedPulling="2026-05-20 14:08:29.026371767 +0000 UTC m=+97.923614655" lastFinishedPulling="2026-05-20 14:08:30.470326962 +0000 UTC m=+99.367569858" observedRunningTime="2026-05-20 14:08:31.146028889 +0000 UTC m=+100.043271812" watchObservedRunningTime="2026-05-20 14:08:31.146340426 +0000 UTC m=+100.043583337" May 20 14:08:32.035805 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:32.035767 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrzhm" May 20 14:08:32.123364 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:32.123332 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wvxg9" event={"ID":"2b1476c0-d49e-462a-a67b-7e98f1e0faf0","Type":"ContainerStarted","Data":"81ea778cdbe1d8d61bf76e5fa64ae742ec37b00ec0539b88a964bccc042ec9f0"} May 20 14:08:32.142398 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:32.142346 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wvxg9" podStartSLOduration=65.894541752 podStartE2EDuration="1m8.142329834s" podCreationTimestamp="2026-05-20 14:07:24 +0000 UTC" firstStartedPulling="2026-05-20 14:08:29.040040094 +0000 UTC m=+97.937282982" lastFinishedPulling="2026-05-20 14:08:31.287828162 +0000 UTC m=+100.185071064" observedRunningTime="2026-05-20 14:08:32.142259313 +0000 UTC m=+101.039502223" watchObservedRunningTime="2026-05-20 14:08:32.142329834 +0000 UTC m=+101.039572745" May 20 14:08:34.692950 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.692916 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb"] May 20 14:08:34.696081 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.696064 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.698713 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.698688 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 20 14:08:34.700080 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.700047 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 20 14:08:34.700213 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.700113 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 20 14:08:34.700324 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.700309 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 20 14:08:34.705784 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.705764 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb"] May 20 14:08:34.762461 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.762430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b98425d-aece-4ac7-b42a-a24cbc485462-tmp\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.762461 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.762464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b98425d-aece-4ac7-b42a-a24cbc485462-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.762623 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.762494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh7s\" (UniqueName: \"kubernetes.io/projected/3b98425d-aece-4ac7-b42a-a24cbc485462-kube-api-access-nhh7s\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.812199 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.812169 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7gmdx"] May 20 14:08:34.814173 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.814156 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.817044 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.817024 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 14:08:34.817414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.817397 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 14:08:34.817414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.817404 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gv257\"" May 20 14:08:34.836791 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.836766 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gmdx"] May 20 14:08:34.837547 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.837526 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764"] May 20 14:08:34.839141 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.839124 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:34.842089 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.842071 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 20 14:08:34.842089 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.842085 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wc2sl\"" May 20 14:08:34.848221 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.848204 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-457qb"] May 20 14:08:34.849918 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.849905 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:34.852767 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.852736 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 20 14:08:34.852767 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.852766 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 20 14:08:34.852926 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.852770 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8nrm8\"" May 20 14:08:34.859334 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.859314 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764"] May 20 14:08:34.863710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.863690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b98425d-aece-4ac7-b42a-a24cbc485462-tmp\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.863803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.863721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b98425d-aece-4ac7-b42a-a24cbc485462-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.863803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.863765 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh7s\" (UniqueName: \"kubernetes.io/projected/3b98425d-aece-4ac7-b42a-a24cbc485462-kube-api-access-nhh7s\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.864107 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.864080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b98425d-aece-4ac7-b42a-a24cbc485462-tmp\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.866585 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.866564 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b98425d-aece-4ac7-b42a-a24cbc485462-klusterlet-config\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.871600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.871572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh7s\" (UniqueName: \"kubernetes.io/projected/3b98425d-aece-4ac7-b42a-a24cbc485462-kube-api-access-nhh7s\") pod \"klusterlet-addon-workmgr-76d8d4d769-2fgfb\" (UID: \"3b98425d-aece-4ac7-b42a-a24cbc485462\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:34.876033 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.876013 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-457qb"] May 20 14:08:34.950017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.949948 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bf8f5cb46-gzwpv"] May 20 14:08:34.951793 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.951778 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:34.954559 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.954527 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 14:08:34.954683 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.954618 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 14:08:34.954761 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.954742 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-js5jf\"" May 20 14:08:34.954915 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.954898 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 14:08:34.960182 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.960150 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 14:08:34.964951 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.964933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11894490-3f54-47db-9dd9-72a2b59631fc-data-volume\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.965012 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.964962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11894490-3f54-47db-9dd9-72a2b59631fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.965012 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.964982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11894490-3f54-47db-9dd9-72a2b59631fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.965012 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.965002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a327703-9cb6-4993-b496-fc3e32e75978-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:34.965106 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.965087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a327703-9cb6-4993-b496-fc3e32e75978-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:34.965138 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.965111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-h2764\" (UID: \"da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:34.965170 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.965154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6mg\" (UniqueName: \"kubernetes.io/projected/11894490-3f54-47db-9dd9-72a2b59631fc-kube-api-access-fc6mg\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.965223 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.965204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11894490-3f54-47db-9dd9-72a2b59631fc-crio-socket\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:34.967833 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:34.967798 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf8f5cb46-gzwpv"] May 20 14:08:35.004921 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.004898 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-image-registry-private-configuration\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-certificates\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067699 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11894490-3f54-47db-9dd9-72a2b59631fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-bound-sa-token\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067761 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11894490-3f54-47db-9dd9-72a2b59631fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067791 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a327703-9cb6-4993-b496-fc3e32e75978-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-installation-pull-secrets\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txn87\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-kube-api-access-txn87\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-trusted-ca\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e2cf472-5785-47c4-9f68-8d1e24285f4b-ca-trust-extracted\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.067979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a327703-9cb6-4993-b496-fc3e32e75978-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-h2764\" (UID: \"da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068076 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6mg\" (UniqueName: \"kubernetes.io/projected/11894490-3f54-47db-9dd9-72a2b59631fc-kube-api-access-fc6mg\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068103 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11894490-3f54-47db-9dd9-72a2b59631fc-crio-socket\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.069419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-tls\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.070235 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11894490-3f54-47db-9dd9-72a2b59631fc-data-volume\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.070235 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.068550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11894490-3f54-47db-9dd9-72a2b59631fc-data-volume\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.070235 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.069042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11894490-3f54-47db-9dd9-72a2b59631fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.072197 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.071408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a327703-9cb6-4993-b496-fc3e32e75978-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:35.072197 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.072139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11894490-3f54-47db-9dd9-72a2b59631fc-crio-socket\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.076414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.076366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-h2764\" (UID: \"da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:35.076897 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.076852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11894490-3f54-47db-9dd9-72a2b59631fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.079827 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.079781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6mg\" (UniqueName: \"kubernetes.io/projected/11894490-3f54-47db-9dd9-72a2b59631fc-kube-api-access-fc6mg\") pod \"insights-runtime-extractor-7gmdx\" (UID: \"11894490-3f54-47db-9dd9-72a2b59631fc\") " pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.082838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.082808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a327703-9cb6-4993-b496-fc3e32e75978-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-457qb\" (UID: \"9a327703-9cb6-4993-b496-fc3e32e75978\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:35.123489 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.123444 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7gmdx" May 20 14:08:35.148476 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.148448 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:35.156534 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.156513 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb"] May 20 14:08:35.159065 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.159037 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" May 20 14:08:35.159377 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:35.159348 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b98425d_aece_4ac7_b42a_a24cbc485462.slice/crio-8a1390211210f7a94d384ea9c6d832e8de528ef2f78b8f575de8e91ef4fcd94d WatchSource:0}: Error finding container 8a1390211210f7a94d384ea9c6d832e8de528ef2f78b8f575de8e91ef4fcd94d: Status 404 returned error can't find the container with id 8a1390211210f7a94d384ea9c6d832e8de528ef2f78b8f575de8e91ef4fcd94d May 20 14:08:35.169441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-installation-pull-secrets\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169551 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169461 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txn87\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-kube-api-access-txn87\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169551 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-trusted-ca\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169551 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e2cf472-5785-47c4-9f68-8d1e24285f4b-ca-trust-extracted\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169614 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-tls\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169652 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-image-registry-private-configuration\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169693 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-certificates\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.169869 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.169725 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-bound-sa-token\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.171202 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.171122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-trusted-ca\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.172996 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.172429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-certificates\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.172996 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.172953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5e2cf472-5785-47c4-9f68-8d1e24285f4b-ca-trust-extracted\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.175379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.175337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-image-registry-private-configuration\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.177523 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.177476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-registry-tls\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.178068 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.178030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5e2cf472-5785-47c4-9f68-8d1e24285f4b-installation-pull-secrets\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.179274 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.179253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txn87\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-kube-api-access-txn87\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.179986 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.179951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e2cf472-5785-47c4-9f68-8d1e24285f4b-bound-sa-token\") pod \"image-registry-bf8f5cb46-gzwpv\" (UID: \"5e2cf472-5785-47c4-9f68-8d1e24285f4b\") " pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.261228 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.261197 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:35.268495 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.268460 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7gmdx"] May 20 14:08:35.272716 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:35.272685 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11894490_3f54_47db_9dd9_72a2b59631fc.slice/crio-95b99de196c5e88fe3b9b66633c8383eba7164f887ea5caacddf1dc6e8b937bd WatchSource:0}: Error finding container 95b99de196c5e88fe3b9b66633c8383eba7164f887ea5caacddf1dc6e8b937bd: Status 404 returned error can't find the container with id 95b99de196c5e88fe3b9b66633c8383eba7164f887ea5caacddf1dc6e8b937bd May 20 14:08:35.298053 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.296562 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764"] May 20 14:08:35.302664 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:35.302560 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6cbe0a_a7c9_44b8_8b7c_564b74d49c1c.slice/crio-6e9b1df8ec8c16c925fea89189a424d10ebd7f223f70fdea9e8aaa0e8d1f0fff WatchSource:0}: Error finding container 6e9b1df8ec8c16c925fea89189a424d10ebd7f223f70fdea9e8aaa0e8d1f0fff: Status 404 returned error can't find the container with id 6e9b1df8ec8c16c925fea89189a424d10ebd7f223f70fdea9e8aaa0e8d1f0fff May 20 14:08:35.318103 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.318024 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-457qb"] May 20 14:08:35.320753 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:35.320728 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a327703_9cb6_4993_b496_fc3e32e75978.slice/crio-f31a41ab7e06ed75cd18bafff1b6d2fbebc5d02939bf0196977b3c157367b5ba WatchSource:0}: Error finding container f31a41ab7e06ed75cd18bafff1b6d2fbebc5d02939bf0196977b3c157367b5ba: Status 404 returned error can't find the container with id f31a41ab7e06ed75cd18bafff1b6d2fbebc5d02939bf0196977b3c157367b5ba May 20 14:08:35.402488 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:35.402434 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf8f5cb46-gzwpv"] May 20 14:08:35.405260 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:35.405238 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2cf472_5785_47c4_9f68_8d1e24285f4b.slice/crio-efd0c704815bf2676520117cfaab22498ac389c27aad28d9ff0381fdb498da1d WatchSource:0}: Error finding container efd0c704815bf2676520117cfaab22498ac389c27aad28d9ff0381fdb498da1d: Status 404 returned error can't find the container with id efd0c704815bf2676520117cfaab22498ac389c27aad28d9ff0381fdb498da1d May 20 14:08:36.139053 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.139009 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gmdx" event={"ID":"11894490-3f54-47db-9dd9-72a2b59631fc","Type":"ContainerStarted","Data":"b1a7ae8728f0ee6358b5f2fecb5e4f543ff49f27ff5c0290afd10f69587fbc21"} May 20 14:08:36.139053 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.139057 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gmdx" event={"ID":"11894490-3f54-47db-9dd9-72a2b59631fc","Type":"ContainerStarted","Data":"caac86c5e5114bc4318116f017cabcee9a53b24aded3dcbb517d49cf9a71b956"} May 20 14:08:36.139574 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.139073 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gmdx" event={"ID":"11894490-3f54-47db-9dd9-72a2b59631fc","Type":"ContainerStarted","Data":"95b99de196c5e88fe3b9b66633c8383eba7164f887ea5caacddf1dc6e8b937bd"} May 20 14:08:36.140455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.140427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" event={"ID":"3b98425d-aece-4ac7-b42a-a24cbc485462","Type":"ContainerStarted","Data":"8a1390211210f7a94d384ea9c6d832e8de528ef2f78b8f575de8e91ef4fcd94d"} May 20 14:08:36.142157 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.142135 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" event={"ID":"5e2cf472-5785-47c4-9f68-8d1e24285f4b","Type":"ContainerStarted","Data":"ba73582f1551877d07dd398454843db1d4d2889a4e1143b01cee801b71728f28"} May 20 14:08:36.142249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.142164 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" event={"ID":"5e2cf472-5785-47c4-9f68-8d1e24285f4b","Type":"ContainerStarted","Data":"efd0c704815bf2676520117cfaab22498ac389c27aad28d9ff0381fdb498da1d"} May 20 14:08:36.142328 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.142258 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:36.143310 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.143277 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" event={"ID":"9a327703-9cb6-4993-b496-fc3e32e75978","Type":"ContainerStarted","Data":"f31a41ab7e06ed75cd18bafff1b6d2fbebc5d02939bf0196977b3c157367b5ba"} May 20 14:08:36.144526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.144505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" event={"ID":"da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c","Type":"ContainerStarted","Data":"6e9b1df8ec8c16c925fea89189a424d10ebd7f223f70fdea9e8aaa0e8d1f0fff"} May 20 14:08:36.166027 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:36.165979 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" podStartSLOduration=2.165961179 podStartE2EDuration="2.165961179s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:08:36.16466719 +0000 UTC m=+105.061910113" watchObservedRunningTime="2026-05-20 14:08:36.165961179 +0000 UTC m=+105.063204090" May 20 14:08:40.159415 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.159377 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" event={"ID":"9a327703-9cb6-4993-b496-fc3e32e75978","Type":"ContainerStarted","Data":"63cbc1eecc962f7c5158630b8bb6c52150537679072fdd386d51ba0135190988"} May 20 14:08:40.160734 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.160706 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" event={"ID":"da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c","Type":"ContainerStarted","Data":"30f23812ce6cf13583f6ad9e71374f72347cd86b531d63ff336b11613469fa47"} May 20 14:08:40.160892 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.160862 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:40.162522 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.162497 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7gmdx" event={"ID":"11894490-3f54-47db-9dd9-72a2b59631fc","Type":"ContainerStarted","Data":"fdf1e0ba70293c7b37562f1b81d1a64581b47f485f2b7ae7b38fe9b63e13bd93"} May 20 14:08:40.163992 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.163964 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" event={"ID":"3b98425d-aece-4ac7-b42a-a24cbc485462","Type":"ContainerStarted","Data":"9b179d6c5949ea4a74f15f49c2e0128fff7d425d1d9303c5bb7f9f0ffe832c0f"} May 20 14:08:40.164234 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.164207 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:40.165548 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.165528 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" May 20 14:08:40.166655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.166640 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" May 20 14:08:40.187786 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.187737 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-457qb" podStartSLOduration=1.852746333 podStartE2EDuration="6.187724571s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.322651408 +0000 UTC m=+104.219894296" lastFinishedPulling="2026-05-20 14:08:39.657629643 +0000 UTC m=+108.554872534" observedRunningTime="2026-05-20 14:08:40.185908525 +0000 UTC m=+109.083151436" watchObservedRunningTime="2026-05-20 14:08:40.187724571 +0000 UTC m=+109.084967481" May 20 14:08:40.227059 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.226969 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76d8d4d769-2fgfb" podStartSLOduration=1.712184698 podStartE2EDuration="6.226954015s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.162941538 +0000 UTC m=+104.060184426" lastFinishedPulling="2026-05-20 14:08:39.677710851 +0000 UTC m=+108.574953743" observedRunningTime="2026-05-20 14:08:40.226797244 +0000 UTC m=+109.124040156" watchObservedRunningTime="2026-05-20 14:08:40.226954015 +0000 UTC m=+109.124196926" May 20 14:08:40.251534 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.251488 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7gmdx" podStartSLOduration=1.9250191559999998 podStartE2EDuration="6.251474014s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.336494639 +0000 UTC m=+104.233737526" lastFinishedPulling="2026-05-20 14:08:39.662949493 +0000 UTC m=+108.560192384" observedRunningTime="2026-05-20 14:08:40.250383574 +0000 UTC m=+109.147626485" watchObservedRunningTime="2026-05-20 14:08:40.251474014 +0000 UTC m=+109.148716924" May 20 14:08:40.269550 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:40.269504 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-h2764" podStartSLOduration=1.916662778 podStartE2EDuration="6.269493637s" podCreationTimestamp="2026-05-20 14:08:34 +0000 UTC" firstStartedPulling="2026-05-20 14:08:35.304800212 +0000 UTC m=+104.202043101" lastFinishedPulling="2026-05-20 14:08:39.657631072 +0000 UTC m=+108.554873960" observedRunningTime="2026-05-20 14:08:40.269190031 +0000 UTC m=+109.166432940" watchObservedRunningTime="2026-05-20 14:08:40.269493637 +0000 UTC m=+109.166736548" May 20 14:08:41.125559 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.125529 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gxsvt" May 20 14:08:41.256494 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.256460 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw"] May 20 14:08:41.259190 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.259174 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.262040 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262016 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 20 14:08:41.262189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262074 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 14:08:41.262189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262098 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 20 14:08:41.262189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262103 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 14:08:41.262189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262140 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 14:08:41.262437 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.262423 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kjqs8\"" May 20 14:08:41.268600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.268578 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw"] May 20 14:08:41.426898 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.426869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.427065 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.426927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.427065 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.426978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18588770-ee67-4103-940e-f2f9dc72f928-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.427065 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.427005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsdd\" (UniqueName: \"kubernetes.io/projected/18588770-ee67-4103-940e-f2f9dc72f928-kube-api-access-krsdd\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.527580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.527545 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krsdd\" (UniqueName: \"kubernetes.io/projected/18588770-ee67-4103-940e-f2f9dc72f928-kube-api-access-krsdd\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.527580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.527588 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.527845 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.527724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.527845 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.527800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18588770-ee67-4103-940e-f2f9dc72f928-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.528345 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.528325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18588770-ee67-4103-940e-f2f9dc72f928-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.529974 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.529943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.530147 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.530127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/18588770-ee67-4103-940e-f2f9dc72f928-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.536257 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.536233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsdd\" (UniqueName: \"kubernetes.io/projected/18588770-ee67-4103-940e-f2f9dc72f928-kube-api-access-krsdd\") pod \"prometheus-operator-7779bbdd78-9gwcw\" (UID: \"18588770-ee67-4103-940e-f2f9dc72f928\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.568088 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.568059 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" May 20 14:08:41.701093 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:41.701020 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw"] May 20 14:08:41.704880 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:41.704850 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18588770_ee67_4103_940e_f2f9dc72f928.slice/crio-a4c6b476503a62ebc76f67ff0db2f5cd19eec05c37e3404d7621c71b7ca2af1d WatchSource:0}: Error finding container a4c6b476503a62ebc76f67ff0db2f5cd19eec05c37e3404d7621c71b7ca2af1d: Status 404 returned error can't find the container with id a4c6b476503a62ebc76f67ff0db2f5cd19eec05c37e3404d7621c71b7ca2af1d May 20 14:08:42.170343 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:42.170285 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" event={"ID":"18588770-ee67-4103-940e-f2f9dc72f928","Type":"ContainerStarted","Data":"a4c6b476503a62ebc76f67ff0db2f5cd19eec05c37e3404d7621c71b7ca2af1d"} May 20 14:08:43.174123 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:43.174087 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" event={"ID":"18588770-ee67-4103-940e-f2f9dc72f928","Type":"ContainerStarted","Data":"8b23475ddcb14c18643316ae3a6adfa4cb6f8c96654dcf6d43b87ad4c7f2cfeb"} May 20 14:08:43.174123 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:43.174123 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" event={"ID":"18588770-ee67-4103-940e-f2f9dc72f928","Type":"ContainerStarted","Data":"13c00020070afa935838a3677cb1ed072cabd96670573c784dbe7f5d87030592"} May 20 14:08:43.213560 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:43.213518 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9gwcw" podStartSLOduration=1.134323107 podStartE2EDuration="2.213505294s" podCreationTimestamp="2026-05-20 14:08:41 +0000 UTC" firstStartedPulling="2026-05-20 14:08:41.706591397 +0000 UTC m=+110.603834285" lastFinishedPulling="2026-05-20 14:08:42.785773581 +0000 UTC m=+111.683016472" observedRunningTime="2026-05-20 14:08:43.211716489 +0000 UTC m=+112.108959400" watchObservedRunningTime="2026-05-20 14:08:43.213505294 +0000 UTC m=+112.110748225" May 20 14:08:45.616007 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.615972 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2"] May 20 14:08:45.617975 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.617960 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.621000 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.620980 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 20 14:08:45.621000 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.620992 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 20 14:08:45.621175 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.620986 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5x6q8\"" May 20 14:08:45.638157 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.638137 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2"] May 20 14:08:45.662642 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.662618 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ql8w6"] May 20 14:08:45.664596 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.664576 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.667189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.667168 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 14:08:45.667513 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.667241 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d7grx\"" May 20 14:08:45.667513 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.667259 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 14:08:45.667660 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.667531 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 14:08:45.763697 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.763860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.763860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-wtmp\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.763860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr2wm\" (UniqueName: \"kubernetes.io/projected/4670c9cf-c482-47fc-8da7-02ac804cd251-kube-api-access-sr2wm\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.763860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.763860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-textfile\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-metrics-client-ca\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21c7fac-f50e-49ac-988e-9e07562a9533-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79g5d\" (UniqueName: \"kubernetes.io/projected/d21c7fac-f50e-49ac-988e-9e07562a9533-kube-api-access-79g5d\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.763988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.764022 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.764007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-sys\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.764195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.764029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-root\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865325 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865381 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-wtmp\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865426 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr2wm\" (UniqueName: \"kubernetes.io/projected/4670c9cf-c482-47fc-8da7-02ac804cd251-kube-api-access-sr2wm\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865450 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-textfile\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:45.865525 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 20 14:08:45.865539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865539 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-metrics-client-ca\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865563 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:45.865594 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls podName:d21c7fac-f50e-49ac-988e-9e07562a9533 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:46.36557251 +0000 UTC m=+115.262815417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-m5nb2" (UID: "d21c7fac-f50e-49ac-988e-9e07562a9533") : secret "openshift-state-metrics-tls" not found May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-wtmp\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21c7fac-f50e-49ac-988e-9e07562a9533-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865677 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79g5d\" (UniqueName: \"kubernetes.io/projected/d21c7fac-f50e-49ac-988e-9e07562a9533-kube-api-access-79g5d\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865717 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865750 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-sys\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-root\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.865881 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-root\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.866373 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4670c9cf-c482-47fc-8da7-02ac804cd251-sys\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.866373 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:45.865911 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 14:08:45.866373 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:08:45.865960 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls podName:4670c9cf-c482-47fc-8da7-02ac804cd251 nodeName:}" failed. No retries permitted until 2026-05-20 14:08:46.365947057 +0000 UTC m=+115.263189945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls") pod "node-exporter-ql8w6" (UID: "4670c9cf-c482-47fc-8da7-02ac804cd251") : secret "node-exporter-tls" not found May 20 14:08:45.866373 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.865977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-textfile\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.866589 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.866417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.866589 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.866439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4670c9cf-c482-47fc-8da7-02ac804cd251-metrics-client-ca\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.866693 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.866643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21c7fac-f50e-49ac-988e-9e07562a9533-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.868190 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.868161 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.868312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.868224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:45.875023 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.874995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr2wm\" (UniqueName: \"kubernetes.io/projected/4670c9cf-c482-47fc-8da7-02ac804cd251-kube-api-access-sr2wm\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:45.875726 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:45.875697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79g5d\" (UniqueName: \"kubernetes.io/projected/d21c7fac-f50e-49ac-988e-9e07562a9533-kube-api-access-79g5d\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:46.369014 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.368981 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:46.369188 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.369032 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:46.371370 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.371331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4670c9cf-c482-47fc-8da7-02ac804cd251-node-exporter-tls\") pod \"node-exporter-ql8w6\" (UID: \"4670c9cf-c482-47fc-8da7-02ac804cd251\") " pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:46.371496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.371387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d21c7fac-f50e-49ac-988e-9e07562a9533-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-m5nb2\" (UID: \"d21c7fac-f50e-49ac-988e-9e07562a9533\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:46.527215 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.527189 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" May 20 14:08:46.573333 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.573284 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql8w6" May 20 14:08:46.583069 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:46.583029 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4670c9cf_c482_47fc_8da7_02ac804cd251.slice/crio-11755cfa631896b9aa6ff187461970643401b466d38ffb9f8fe00c842270efc6 WatchSource:0}: Error finding container 11755cfa631896b9aa6ff187461970643401b466d38ffb9f8fe00c842270efc6: Status 404 returned error can't find the container with id 11755cfa631896b9aa6ff187461970643401b466d38ffb9f8fe00c842270efc6 May 20 14:08:46.661428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:46.661403 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2"] May 20 14:08:46.663772 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:46.663749 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21c7fac_f50e_49ac_988e_9e07562a9533.slice/crio-b9b0bbfbfd6cde71548deb7af0a3170f480f65b843b05f31fd1b68070d1262eb WatchSource:0}: Error finding container b9b0bbfbfd6cde71548deb7af0a3170f480f65b843b05f31fd1b68070d1262eb: Status 404 returned error can't find the container with id b9b0bbfbfd6cde71548deb7af0a3170f480f65b843b05f31fd1b68070d1262eb May 20 14:08:47.185529 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:47.185494 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8w6" event={"ID":"4670c9cf-c482-47fc-8da7-02ac804cd251","Type":"ContainerStarted","Data":"11755cfa631896b9aa6ff187461970643401b466d38ffb9f8fe00c842270efc6"} May 20 14:08:47.186855 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:47.186829 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" event={"ID":"d21c7fac-f50e-49ac-988e-9e07562a9533","Type":"ContainerStarted","Data":"6ba19838eae579c5d7484473d3e5aae7692b51cffaa6bbfbf8cb1783df08f96a"} May 20 14:08:47.186968 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:47.186858 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" event={"ID":"d21c7fac-f50e-49ac-988e-9e07562a9533","Type":"ContainerStarted","Data":"9195f6405f774c15679ee38d812cf403e94d9858090b3ec4619b57856c2ca8ce"} May 20 14:08:47.186968 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:47.186868 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" event={"ID":"d21c7fac-f50e-49ac-988e-9e07562a9533","Type":"ContainerStarted","Data":"b9b0bbfbfd6cde71548deb7af0a3170f480f65b843b05f31fd1b68070d1262eb"} May 20 14:08:48.190460 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.190426 2559 generic.go:358] "Generic (PLEG): container finished" podID="4670c9cf-c482-47fc-8da7-02ac804cd251" containerID="43d669288c73e91cf8dcd06f1d0bb5bfeb9125e6a55b5a4973697982d8737e8c" exitCode=0 May 20 14:08:48.190879 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.190520 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8w6" event={"ID":"4670c9cf-c482-47fc-8da7-02ac804cd251","Type":"ContainerDied","Data":"43d669288c73e91cf8dcd06f1d0bb5bfeb9125e6a55b5a4973697982d8737e8c"} May 20 14:08:48.192420 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.192391 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" event={"ID":"d21c7fac-f50e-49ac-988e-9e07562a9533","Type":"ContainerStarted","Data":"2af6e2f4c08498ed297edfa0008501b63f04153dc9d52b93227173b7aa2bda90"} May 20 14:08:48.253611 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.253554 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-m5nb2" podStartSLOduration=2.269153327 podStartE2EDuration="3.253532833s" podCreationTimestamp="2026-05-20 14:08:45 +0000 UTC" firstStartedPulling="2026-05-20 14:08:46.788442673 +0000 UTC m=+115.685685563" lastFinishedPulling="2026-05-20 14:08:47.772822178 +0000 UTC m=+116.670065069" observedRunningTime="2026-05-20 14:08:48.250738646 +0000 UTC m=+117.147981559" watchObservedRunningTime="2026-05-20 14:08:48.253532833 +0000 UTC m=+117.150775743" May 20 14:08:48.716244 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.715696 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9"] May 20 14:08:48.722773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.722741 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.725481 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725458 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 20 14:08:48.725654 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725595 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 20 14:08:48.725654 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725603 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2jmeh10bkitjc\"" May 20 14:08:48.725803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725693 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 20 14:08:48.725803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725747 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 20 14:08:48.725903 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725890 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dnwfm\"" May 20 14:08:48.726023 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.725994 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 20 14:08:48.737415 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.737393 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9"] May 20 14:08:48.786942 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.786904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.786957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-metrics-client-ca\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-grpc-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787139 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4gn\" (UniqueName: \"kubernetes.io/projected/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-kube-api-access-7s4gn\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.787379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.787233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.887613 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887580 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.887613 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.887851 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.887851 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887801 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-metrics-client-ca\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.887851 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887846 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-grpc-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.888003 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.888003 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887929 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.888003 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.887973 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4gn\" (UniqueName: \"kubernetes.io/projected/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-kube-api-access-7s4gn\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.888753 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.888684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-metrics-client-ca\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.890641 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.890605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.890764 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.890707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.890764 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.890730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.890929 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.890906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.890987 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.890973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-grpc-tls\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.891116 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.891097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:48.897585 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:48.897562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4gn\" (UniqueName: \"kubernetes.io/projected/cb5d91bb-cf5c-4371-b2ee-0316c8b4471d-kube-api-access-7s4gn\") pod \"thanos-querier-5d457c4b9f-7pcw9\" (UID: \"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d\") " pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:49.032958 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.032864 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:49.169537 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.169494 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9"] May 20 14:08:49.171681 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:49.171646 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5d91bb_cf5c_4371_b2ee_0316c8b4471d.slice/crio-9d59a92d8c5347b8f070aa84fdb8714581943796717c5340be5af7745a36f428 WatchSource:0}: Error finding container 9d59a92d8c5347b8f070aa84fdb8714581943796717c5340be5af7745a36f428: Status 404 returned error can't find the container with id 9d59a92d8c5347b8f070aa84fdb8714581943796717c5340be5af7745a36f428 May 20 14:08:49.196492 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.196464 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8w6" event={"ID":"4670c9cf-c482-47fc-8da7-02ac804cd251","Type":"ContainerStarted","Data":"1c2042cc6386c24dddb67b9be57d4cda0849868ac6b9d5bae4bebd38d4e826bb"} May 20 14:08:49.196836 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.196498 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql8w6" event={"ID":"4670c9cf-c482-47fc-8da7-02ac804cd251","Type":"ContainerStarted","Data":"f71b22af8cf2be716c1c49edcddbb72484469ef02584304ec1c47b8a1adae74a"} May 20 14:08:49.197559 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.197538 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"9d59a92d8c5347b8f070aa84fdb8714581943796717c5340be5af7745a36f428"} May 20 14:08:49.220436 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:49.220387 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ql8w6" podStartSLOduration=3.034151809 podStartE2EDuration="4.220376105s" podCreationTimestamp="2026-05-20 14:08:45 +0000 UTC" firstStartedPulling="2026-05-20 14:08:46.585024745 +0000 UTC m=+115.482267642" lastFinishedPulling="2026-05-20 14:08:47.77124905 +0000 UTC m=+116.668491938" observedRunningTime="2026-05-20 14:08:49.219203798 +0000 UTC m=+118.116446705" watchObservedRunningTime="2026-05-20 14:08:49.220376105 +0000 UTC m=+118.117619015" May 20 14:08:50.880474 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.880440 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b76c84558-bz66c"] May 20 14:08:50.884958 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.884931 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.888087 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888039 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 20 14:08:50.888087 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888054 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 20 14:08:50.888327 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888059 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 20 14:08:50.888539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888433 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 20 14:08:50.888539 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888525 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r74fb\"" May 20 14:08:50.888796 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.888780 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 20 14:08:50.894141 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.893840 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 20 14:08:50.906601 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906711 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906711 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-federate-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpkvl\" (UniqueName: \"kubernetes.io/projected/171a5652-5bd4-4f16-a448-dad41546cbad-kube-api-access-gpkvl\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906803 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-metrics-client-ca\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906945 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.906945 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.906885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-serving-certs-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:50.915677 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:50.915654 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b76c84558-bz66c"] May 20 14:08:51.007650 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007622 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-serving-certs-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.007813 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007660 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.007813 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007713 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.007813 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007760 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.007976 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-federate-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.007976 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007965 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpkvl\" (UniqueName: \"kubernetes.io/projected/171a5652-5bd4-4f16-a448-dad41546cbad-kube-api-access-gpkvl\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.008075 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.007998 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-metrics-client-ca\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.008075 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.008019 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.008513 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.008485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-serving-certs-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.008719 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.008677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-metrics-client-ca\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.008834 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.008784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.010422 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.010394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.010517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.010454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-telemeter-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.010517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.010472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-secret-telemeter-client\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.010517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.010496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/171a5652-5bd4-4f16-a448-dad41546cbad-federate-client-tls\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.017189 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.017170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpkvl\" (UniqueName: \"kubernetes.io/projected/171a5652-5bd4-4f16-a448-dad41546cbad-kube-api-access-gpkvl\") pod \"telemeter-client-b76c84558-bz66c\" (UID: \"171a5652-5bd4-4f16-a448-dad41546cbad\") " pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.196912 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.196883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" May 20 14:08:51.205048 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.205021 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"e9e9809f7249b64ea58d3853098af1acc7234dfe8b177e28502aa708da6cf39f"} May 20 14:08:51.205153 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.205061 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"ba1ab563597e13b002c1b7f0e4ee2e286d8ad7b8c2f927be05383138df364911"} May 20 14:08:51.362737 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:51.362709 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b76c84558-bz66c"] May 20 14:08:51.366123 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:08:51.366096 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171a5652_5bd4_4f16_a448_dad41546cbad.slice/crio-968cc26852a29594d843ebfd727151e083f59d6e27f6c2fa0a730a522002d5f2 WatchSource:0}: Error finding container 968cc26852a29594d843ebfd727151e083f59d6e27f6c2fa0a730a522002d5f2: Status 404 returned error can't find the container with id 968cc26852a29594d843ebfd727151e083f59d6e27f6c2fa0a730a522002d5f2 May 20 14:08:52.213570 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:52.213449 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"a38700de57e8e524d99ce532846b90f1a13737c0bca6360bf82b866a6b55bc94"} May 20 14:08:52.213570 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:52.213497 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"eb4bc2314f8acfb5cff05dcbb245d9e7e674bed06d0d6d46dc700fcb0f4b9c40"} May 20 14:08:52.213570 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:52.213513 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"d2e5a21be58a4c741d05f1d58365dcb41f0baf562644c9b262474f749762b4eb"} May 20 14:08:52.215742 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:52.215711 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" event={"ID":"171a5652-5bd4-4f16-a448-dad41546cbad","Type":"ContainerStarted","Data":"968cc26852a29594d843ebfd727151e083f59d6e27f6c2fa0a730a522002d5f2"} May 20 14:08:53.224198 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:53.224159 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" event={"ID":"cb5d91bb-cf5c-4371-b2ee-0316c8b4471d","Type":"ContainerStarted","Data":"01b7b4e9a66b48ba9d4b335601031a14b8351d71f046c5c23695909efa19811c"} May 20 14:08:53.224591 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:53.224353 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:08:53.263176 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:53.263131 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" podStartSLOduration=2.441731636 podStartE2EDuration="5.263117365s" podCreationTimestamp="2026-05-20 14:08:48 +0000 UTC" firstStartedPulling="2026-05-20 14:08:49.173605404 +0000 UTC m=+118.070848292" lastFinishedPulling="2026-05-20 14:08:51.994991132 +0000 UTC m=+120.892234021" observedRunningTime="2026-05-20 14:08:53.262210404 +0000 UTC m=+122.159453313" watchObservedRunningTime="2026-05-20 14:08:53.263117365 +0000 UTC m=+122.160360274" May 20 14:08:54.228209 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:54.228183 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" event={"ID":"171a5652-5bd4-4f16-a448-dad41546cbad","Type":"ContainerStarted","Data":"2cc9c16048597eadc3e23f80612a58805660a87bbea64aa84549fd60233597ea"} May 20 14:08:55.232437 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:55.232406 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" event={"ID":"171a5652-5bd4-4f16-a448-dad41546cbad","Type":"ContainerStarted","Data":"844a87288bd1da5ab11cb8adbdb98a2b7abbc03eddf63434e8032f20a12e6157"} May 20 14:08:55.232437 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:55.232442 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" event={"ID":"171a5652-5bd4-4f16-a448-dad41546cbad","Type":"ContainerStarted","Data":"22d228b00c93753725ea2d9a231e28b79e9c41bbe5239bae59fb3c10bf52e4f4"} May 20 14:08:55.280224 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:55.280176 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b76c84558-bz66c" podStartSLOduration=2.447237306 podStartE2EDuration="5.280162661s" podCreationTimestamp="2026-05-20 14:08:50 +0000 UTC" firstStartedPulling="2026-05-20 14:08:51.368139159 +0000 UTC m=+120.265382047" lastFinishedPulling="2026-05-20 14:08:54.201064508 +0000 UTC m=+123.098307402" observedRunningTime="2026-05-20 14:08:55.278155682 +0000 UTC m=+124.175398596" watchObservedRunningTime="2026-05-20 14:08:55.280162661 +0000 UTC m=+124.177405571" May 20 14:08:57.153330 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:57.153282 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bf8f5cb46-gzwpv" May 20 14:08:59.234737 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:08:59.234711 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d457c4b9f-7pcw9" May 20 14:09:01.397206 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:01.397161 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:09:01.399580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:01.399555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49dd36d9-c144-456e-8660-511749aedeb6-metrics-certs\") pod \"network-metrics-daemon-kq8v7\" (UID: \"49dd36d9-c144-456e-8660-511749aedeb6\") " pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:09:01.575358 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:01.575324 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rhhv\"" May 20 14:09:01.581873 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:01.581850 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kq8v7" May 20 14:09:01.723205 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:01.723176 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kq8v7"] May 20 14:09:01.725801 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:09:01.725772 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49dd36d9_c144_456e_8660_511749aedeb6.slice/crio-ada17234270bb009dd893906dd94a6eab6429b16976963e7c44b6ea83e9390b8 WatchSource:0}: Error finding container ada17234270bb009dd893906dd94a6eab6429b16976963e7c44b6ea83e9390b8: Status 404 returned error can't find the container with id ada17234270bb009dd893906dd94a6eab6429b16976963e7c44b6ea83e9390b8 May 20 14:09:02.252266 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:02.252223 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kq8v7" event={"ID":"49dd36d9-c144-456e-8660-511749aedeb6","Type":"ContainerStarted","Data":"ada17234270bb009dd893906dd94a6eab6429b16976963e7c44b6ea83e9390b8"} May 20 14:09:03.256865 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:03.256834 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kq8v7" event={"ID":"49dd36d9-c144-456e-8660-511749aedeb6","Type":"ContainerStarted","Data":"46c488f1ea84ed23442d81ecdeb400a1d121055b71abb90bd8325b198c954f94"} May 20 14:09:03.256865 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:03.256867 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kq8v7" event={"ID":"49dd36d9-c144-456e-8660-511749aedeb6","Type":"ContainerStarted","Data":"c1a646f5a99a73604df18acb8fb5d0e94e37064f041ecfd0f4764a3feb3888cc"} May 20 14:09:03.280683 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:03.280643 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kq8v7" podStartSLOduration=131.239522078 podStartE2EDuration="2m12.280629269s" podCreationTimestamp="2026-05-20 14:06:51 +0000 UTC" firstStartedPulling="2026-05-20 14:09:01.727595934 +0000 UTC m=+130.624838822" lastFinishedPulling="2026-05-20 14:09:02.768703122 +0000 UTC m=+131.665946013" observedRunningTime="2026-05-20 14:09:03.279216894 +0000 UTC m=+132.176459803" watchObservedRunningTime="2026-05-20 14:09:03.280629269 +0000 UTC m=+132.177872178" May 20 14:09:14.290479 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:14.290441 2559 generic.go:358] "Generic (PLEG): container finished" podID="75583376-5a48-45d0-8828-a96c320c782b" containerID="fa943ca9cae3b84c1b09be4ac43d548d310b30478ced07054ac37aaa20b19ff1" exitCode=0 May 20 14:09:14.290902 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:14.290494 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" event={"ID":"75583376-5a48-45d0-8828-a96c320c782b","Type":"ContainerDied","Data":"fa943ca9cae3b84c1b09be4ac43d548d310b30478ced07054ac37aaa20b19ff1"} May 20 14:09:14.290902 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:14.290894 2559 scope.go:117] "RemoveContainer" containerID="fa943ca9cae3b84c1b09be4ac43d548d310b30478ced07054ac37aaa20b19ff1" May 20 14:09:15.089277 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.089241 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:09:15.113157 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.113127 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:09:15.113287 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.113231 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.116572 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.116550 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 20 14:09:15.117569 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.117548 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 20 14:09:15.117670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.117602 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 20 14:09:15.117670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.117618 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 20 14:09:15.117839 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.117823 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 14:09:15.117895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.117885 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 20 14:09:15.118210 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.118193 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 14:09:15.118252 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.118208 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbxwk\"" May 20 14:09:15.206090 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.206323 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65pww\" (UniqueName: \"kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.206323 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.206323 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.206323 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.206477 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.206327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.295021 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.294990 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-br4s9" event={"ID":"75583376-5a48-45d0-8828-a96c320c782b","Type":"ContainerStarted","Data":"f40d4373d33db3ef322e0206a728c5283d2a7346331d789dffd631de5280e7a5"} May 20 14:09:15.307226 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65pww\" (UniqueName: \"kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.307379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307243 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.307379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307260 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.307379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307316 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.307379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307345 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.307379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.307375 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.308077 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.308052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.308211 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.308095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.308211 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.308127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.309885 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.309858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.309885 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.309868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.315364 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.315334 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65pww\" (UniqueName: \"kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww\") pod \"console-647b7947b5-vh4nb\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.422965 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.422927 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:15.555883 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:15.555832 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:09:15.558018 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:09:15.557989 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37941738_ef55_4a0f_8984_2a2b7c78f23d.slice/crio-59eadb765d4f9107454b7c3009a8728102fc74aa41271837a4f0d00cfb6250c6 WatchSource:0}: Error finding container 59eadb765d4f9107454b7c3009a8728102fc74aa41271837a4f0d00cfb6250c6: Status 404 returned error can't find the container with id 59eadb765d4f9107454b7c3009a8728102fc74aa41271837a4f0d00cfb6250c6 May 20 14:09:16.299869 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:16.299830 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b7947b5-vh4nb" event={"ID":"37941738-ef55-4a0f-8984-2a2b7c78f23d","Type":"ContainerStarted","Data":"59eadb765d4f9107454b7c3009a8728102fc74aa41271837a4f0d00cfb6250c6"} May 20 14:09:18.307325 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:18.307125 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b7947b5-vh4nb" event={"ID":"37941738-ef55-4a0f-8984-2a2b7c78f23d","Type":"ContainerStarted","Data":"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22"} May 20 14:09:18.335371 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:18.335315 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-647b7947b5-vh4nb" podStartSLOduration=0.723404634 podStartE2EDuration="3.335278941s" podCreationTimestamp="2026-05-20 14:09:15 +0000 UTC" firstStartedPulling="2026-05-20 14:09:15.560032041 +0000 UTC m=+144.457274944" lastFinishedPulling="2026-05-20 14:09:18.17190636 +0000 UTC m=+147.069149251" observedRunningTime="2026-05-20 14:09:18.333562 +0000 UTC m=+147.230804909" watchObservedRunningTime="2026-05-20 14:09:18.335278941 +0000 UTC m=+147.232521852" May 20 14:09:19.311269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:19.311178 2559 generic.go:358] "Generic (PLEG): container finished" podID="a3b912a9-6865-46f4-bf8a-5b2151647e69" containerID="cf82bf6518226216bdf2ae5e97eb2dc0b28cd3c9583f960f570ae6c053713228" exitCode=0 May 20 14:09:19.311269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:19.311255 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" event={"ID":"a3b912a9-6865-46f4-bf8a-5b2151647e69","Type":"ContainerDied","Data":"cf82bf6518226216bdf2ae5e97eb2dc0b28cd3c9583f960f570ae6c053713228"} May 20 14:09:19.311784 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:19.311767 2559 scope.go:117] "RemoveContainer" containerID="cf82bf6518226216bdf2ae5e97eb2dc0b28cd3c9583f960f570ae6c053713228" May 20 14:09:20.315777 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:20.315740 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-bqvj7" event={"ID":"a3b912a9-6865-46f4-bf8a-5b2151647e69","Type":"ContainerStarted","Data":"1cfe80613e77589d3d69b4ce9381112bc3c10e9bdb8b5646e7a3cb5f97fade69"} May 20 14:09:25.423436 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:25.423407 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:25.423859 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:25.423735 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:25.428605 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:25.428569 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:26.337185 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:26.337154 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:09:35.973751 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:09:35.973671 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:10:00.993688 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:00.993651 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-647b7947b5-vh4nb" podUID="37941738-ef55-4a0f-8984-2a2b7c78f23d" containerName="console" containerID="cri-o://dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22" gracePeriod=15 May 20 14:10:01.244884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.244832 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-647b7947b5-vh4nb_37941738-ef55-4a0f-8984-2a2b7c78f23d/console/0.log" May 20 14:10:01.244980 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.244904 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:10:01.281901 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.281877 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.281941 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65pww\" (UniqueName: \"kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.281961 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.281980 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.282009 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282209 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.282030 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config\") pod \"37941738-ef55-4a0f-8984-2a2b7c78f23d\" (UID: \"37941738-ef55-4a0f-8984-2a2b7c78f23d\") " May 20 14:10:01.282395 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.282364 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca" (OuterVolumeSpecName: "service-ca") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:01.282523 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.282484 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config" (OuterVolumeSpecName: "console-config") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:01.282644 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.282622 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:01.284340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.284283 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:01.284448 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.284431 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:01.284518 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.284501 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww" (OuterVolumeSpecName: "kube-api-access-65pww") pod "37941738-ef55-4a0f-8984-2a2b7c78f23d" (UID: "37941738-ef55-4a0f-8984-2a2b7c78f23d"). InnerVolumeSpecName "kube-api-access-65pww". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:01.383522 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383479 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65pww\" (UniqueName: \"kubernetes.io/projected/37941738-ef55-4a0f-8984-2a2b7c78f23d-kube-api-access-65pww\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.383522 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383515 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-oauth-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.383522 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383528 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.383747 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383538 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.383747 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383547 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37941738-ef55-4a0f-8984-2a2b7c78f23d-console-oauth-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.383747 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.383556 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37941738-ef55-4a0f-8984-2a2b7c78f23d-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:10:01.436507 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436483 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-647b7947b5-vh4nb_37941738-ef55-4a0f-8984-2a2b7c78f23d/console/0.log" May 20 14:10:01.436679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436520 2559 generic.go:358] "Generic (PLEG): container finished" podID="37941738-ef55-4a0f-8984-2a2b7c78f23d" containerID="dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22" exitCode=2 May 20 14:10:01.436679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436596 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b7947b5-vh4nb" May 20 14:10:01.436679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436609 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b7947b5-vh4nb" event={"ID":"37941738-ef55-4a0f-8984-2a2b7c78f23d","Type":"ContainerDied","Data":"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22"} May 20 14:10:01.436679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436648 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b7947b5-vh4nb" event={"ID":"37941738-ef55-4a0f-8984-2a2b7c78f23d","Type":"ContainerDied","Data":"59eadb765d4f9107454b7c3009a8728102fc74aa41271837a4f0d00cfb6250c6"} May 20 14:10:01.436679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.436666 2559 scope.go:117] "RemoveContainer" containerID="dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22" May 20 14:10:01.446885 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.446863 2559 scope.go:117] "RemoveContainer" containerID="dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22" May 20 14:10:01.447180 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:10:01.447159 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22\": container with ID starting with dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22 not found: ID does not exist" containerID="dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22" May 20 14:10:01.447252 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.447194 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22"} err="failed to get container status \"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22\": rpc error: code = NotFound desc = could not find container \"dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22\": container with ID starting with dc57748d01ae80d0bf1f2c6360b3c976f9afaa19ba5e1ff16eb6292f27716a22 not found: ID does not exist" May 20 14:10:01.458801 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.458774 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:10:01.462043 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.462022 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-647b7947b5-vh4nb"] May 20 14:10:01.761684 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:01.761648 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37941738-ef55-4a0f-8984-2a2b7c78f23d" path="/var/lib/kubelet/pods/37941738-ef55-4a0f-8984-2a2b7c78f23d/volumes" May 20 14:10:04.632800 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.632765 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:10:04.633245 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.633201 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37941738-ef55-4a0f-8984-2a2b7c78f23d" containerName="console" May 20 14:10:04.633245 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.633220 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="37941738-ef55-4a0f-8984-2a2b7c78f23d" containerName="console" May 20 14:10:04.633390 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.633319 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="37941738-ef55-4a0f-8984-2a2b7c78f23d" containerName="console" May 20 14:10:04.637436 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.637415 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.646693 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.646676 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 20 14:10:04.647043 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.647029 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 20 14:10:04.648766 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:10:04.648737 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-serving-cert\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" May 20 14:10:04.648870 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:10:04.648818 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" May 20 14:10:04.651986 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.651972 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbxwk\"" May 20 14:10:04.652640 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.652622 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 14:10:04.652717 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.652703 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 14:10:04.653252 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.653241 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 20 14:10:04.693710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.693684 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 20 14:10:04.701934 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.701908 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:10:04.708397 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt4z6\" (UniqueName: \"kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.708670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.708555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809054 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809023 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809054 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809056 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809282 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809083 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809282 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809282 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809227 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809282 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809275 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809534 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809364 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt4z6\" (UniqueName: \"kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809896 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.809998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.809931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.810057 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.810030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.811405 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.811384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:04.819222 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:04.819202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt4z6\" (UniqueName: \"kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:05.458008 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:05.457977 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 20 14:10:05.461738 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:05.461716 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:05.809848 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:10:05.809772 2559 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: failed to sync configmap cache: timed out waiting for the condition May 20 14:10:05.809848 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:10:05.809849 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert podName:de28cc10-2178-4ea3-ae42-4d7d2a9d8497 nodeName:}" failed. No retries permitted until 2026-05-20 14:10:06.309831891 +0000 UTC m=+195.207074779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert") pod "console-d44765c8-x5f79" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497") : failed to sync configmap cache: timed out waiting for the condition May 20 14:10:05.913361 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:05.913331 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 20 14:10:06.321254 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:06.321219 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:06.321805 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:06.321784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") pod \"console-d44765c8-x5f79\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:06.446172 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:06.446139 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:06.570723 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:06.570688 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:10:06.573577 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:10:06.573556 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde28cc10_2178_4ea3_ae42_4d7d2a9d8497.slice/crio-ecf8053edaa4e2c26094ee530161f1c991bbac7df3bc8788ce833e42d00ff5cf WatchSource:0}: Error finding container ecf8053edaa4e2c26094ee530161f1c991bbac7df3bc8788ce833e42d00ff5cf: Status 404 returned error can't find the container with id ecf8053edaa4e2c26094ee530161f1c991bbac7df3bc8788ce833e42d00ff5cf May 20 14:10:07.457935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:07.457900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44765c8-x5f79" event={"ID":"de28cc10-2178-4ea3-ae42-4d7d2a9d8497","Type":"ContainerStarted","Data":"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87"} May 20 14:10:07.457935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:07.457938 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44765c8-x5f79" event={"ID":"de28cc10-2178-4ea3-ae42-4d7d2a9d8497","Type":"ContainerStarted","Data":"ecf8053edaa4e2c26094ee530161f1c991bbac7df3bc8788ce833e42d00ff5cf"} May 20 14:10:07.478964 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:07.478926 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d44765c8-x5f79" podStartSLOduration=3.478910889 podStartE2EDuration="3.478910889s" podCreationTimestamp="2026-05-20 14:10:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:10:07.47683966 +0000 UTC m=+196.374082570" watchObservedRunningTime="2026-05-20 14:10:07.478910889 +0000 UTC m=+196.376153798" May 20 14:10:16.446583 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:16.446543 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:16.447023 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:16.446634 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:16.451394 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:16.451376 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:16.488387 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:16.488365 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d44765c8-x5f79" May 20 14:10:46.174091 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.174055 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t8nvd"] May 20 14:10:46.177895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.177877 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.180569 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.180550 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 14:10:46.183635 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.183614 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nvd"] May 20 14:10:46.252151 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.252121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-original-pull-secret\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.252269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.252208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-kubelet-config\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.252269 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.252262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-dbus\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.353178 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.353149 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-original-pull-secret\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.353340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.353201 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-kubelet-config\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.353340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.353234 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-dbus\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.353419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.353365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-kubelet-config\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.353461 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.353417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-dbus\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.355478 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.355449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebcb9e0f-a0bc-4fb7-9990-05ca100df284-original-pull-secret\") pod \"global-pull-secret-syncer-t8nvd\" (UID: \"ebcb9e0f-a0bc-4fb7-9990-05ca100df284\") " pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.488969 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.488900 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nvd" May 20 14:10:46.614826 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:46.614668 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nvd"] May 20 14:10:46.617348 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:10:46.617319 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcb9e0f_a0bc_4fb7_9990_05ca100df284.slice/crio-40ddd1844e0079c7ce0c219f09d7d0f5a10dd44a6283d6f4d0e27948bc4f7438 WatchSource:0}: Error finding container 40ddd1844e0079c7ce0c219f09d7d0f5a10dd44a6283d6f4d0e27948bc4f7438: Status 404 returned error can't find the container with id 40ddd1844e0079c7ce0c219f09d7d0f5a10dd44a6283d6f4d0e27948bc4f7438 May 20 14:10:47.571560 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:47.571510 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nvd" event={"ID":"ebcb9e0f-a0bc-4fb7-9990-05ca100df284","Type":"ContainerStarted","Data":"40ddd1844e0079c7ce0c219f09d7d0f5a10dd44a6283d6f4d0e27948bc4f7438"} May 20 14:10:50.582255 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:50.582218 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nvd" event={"ID":"ebcb9e0f-a0bc-4fb7-9990-05ca100df284","Type":"ContainerStarted","Data":"9ecf3ef199edc060eed96c95c9e0646223f5f680178e3d5379577cc094656053"} May 20 14:10:50.600093 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:10:50.600038 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8nvd" podStartSLOduration=0.809782822 podStartE2EDuration="4.600021012s" podCreationTimestamp="2026-05-20 14:10:46 +0000 UTC" firstStartedPulling="2026-05-20 14:10:46.619324181 +0000 UTC m=+235.516567070" lastFinishedPulling="2026-05-20 14:10:50.409562369 +0000 UTC m=+239.306805260" observedRunningTime="2026-05-20 14:10:50.598972116 +0000 UTC m=+239.496215025" watchObservedRunningTime="2026-05-20 14:10:50.600021012 +0000 UTC m=+239.497263923" May 20 14:11:16.495147 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.495114 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc"] May 20 14:11:16.498895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.498878 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.502218 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.502196 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 14:11:16.503196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.503171 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 14:11:16.503671 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.503651 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vwlxn\"" May 20 14:11:16.508215 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.508187 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc"] May 20 14:11:16.592581 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.592552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.592725 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.592603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t44fh\" (UniqueName: \"kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.592725 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.592682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.693103 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.693074 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.693285 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.693124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t44fh\" (UniqueName: \"kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.693285 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.693162 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.693499 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.693479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.693567 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.693506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.703866 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.703838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t44fh\" (UniqueName: \"kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.811826 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.811765 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:16.942895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:16.942872 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc"] May 20 14:11:16.944693 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:11:16.944666 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d0d28e_aacc_4570_9be8_44e2e81b15cb.slice/crio-76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146 WatchSource:0}: Error finding container 76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146: Status 404 returned error can't find the container with id 76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146 May 20 14:11:17.663969 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:17.663931 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerStarted","Data":"76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146"} May 20 14:11:22.679483 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:22.679449 2559 generic.go:358] "Generic (PLEG): container finished" podID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerID="1063dae2840f431e8a0f9f77a4619ec0788e6bb3f53effd8da9fb2430471be6e" exitCode=0 May 20 14:11:22.679983 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:22.679493 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerDied","Data":"1063dae2840f431e8a0f9f77a4619ec0788e6bb3f53effd8da9fb2430471be6e"} May 20 14:11:28.699096 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:28.699060 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerStarted","Data":"90778ce2a8dd8240e94ba33026dd81b744cfb0d1c1a36b60c81e85414bb89573"} May 20 14:11:29.703934 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:29.703901 2559 generic.go:358] "Generic (PLEG): container finished" podID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerID="90778ce2a8dd8240e94ba33026dd81b744cfb0d1c1a36b60c81e85414bb89573" exitCode=0 May 20 14:11:29.704351 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:29.703983 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerDied","Data":"90778ce2a8dd8240e94ba33026dd81b744cfb0d1c1a36b60c81e85414bb89573"} May 20 14:11:35.725454 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:35.725370 2559 generic.go:358] "Generic (PLEG): container finished" podID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerID="37e29521e0866244ffc984d90b47687ee6089039c28b247c3fdc5c48040d6e74" exitCode=0 May 20 14:11:35.725790 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:35.725457 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerDied","Data":"37e29521e0866244ffc984d90b47687ee6089039c28b247c3fdc5c48040d6e74"} May 20 14:11:36.851842 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.851818 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:36.969727 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.969692 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle\") pod \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " May 20 14:11:36.969901 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.969775 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util\") pod \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " May 20 14:11:36.969901 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.969826 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t44fh\" (UniqueName: \"kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh\") pod \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\" (UID: \"25d0d28e-aacc-4570-9be8-44e2e81b15cb\") " May 20 14:11:36.970392 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.970364 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle" (OuterVolumeSpecName: "bundle") pod "25d0d28e-aacc-4570-9be8-44e2e81b15cb" (UID: "25d0d28e-aacc-4570-9be8-44e2e81b15cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:11:36.971975 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.971951 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh" (OuterVolumeSpecName: "kube-api-access-t44fh") pod "25d0d28e-aacc-4570-9be8-44e2e81b15cb" (UID: "25d0d28e-aacc-4570-9be8-44e2e81b15cb"). InnerVolumeSpecName "kube-api-access-t44fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:11:36.974205 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:36.974184 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util" (OuterVolumeSpecName: "util") pod "25d0d28e-aacc-4570-9be8-44e2e81b15cb" (UID: "25d0d28e-aacc-4570-9be8-44e2e81b15cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:11:37.071013 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.070922 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:11:37.071013 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.070952 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t44fh\" (UniqueName: \"kubernetes.io/projected/25d0d28e-aacc-4570-9be8-44e2e81b15cb-kube-api-access-t44fh\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:11:37.071013 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.070966 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25d0d28e-aacc-4570-9be8-44e2e81b15cb-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:11:37.733440 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.733407 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" event={"ID":"25d0d28e-aacc-4570-9be8-44e2e81b15cb","Type":"ContainerDied","Data":"76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146"} May 20 14:11:37.733440 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.733438 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76246c4cd2986d3a85c3acb7d90380bab05fb9aa613617be343113f2dfc1a146" May 20 14:11:37.733690 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:37.733545 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcv5qc" May 20 14:11:51.312456 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312420 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-67582"] May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312723 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="extract" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312733 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="extract" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312746 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="pull" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312751 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="pull" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312762 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="util" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312769 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="util" May 20 14:11:51.312838 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.312818 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="25d0d28e-aacc-4570-9be8-44e2e81b15cb" containerName="extract" May 20 14:11:51.348230 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.348206 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-67582"] May 20 14:11:51.348379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.348326 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.352235 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.352180 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g4d2m\"" May 20 14:11:51.352584 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.352569 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 14:11:51.353236 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.353219 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 14:11:51.382104 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.382073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.382224 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.382120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qnb\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-kube-api-access-g9qnb\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.482661 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.482624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.482811 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.482671 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qnb\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-kube-api-access-g9qnb\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.496274 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.496241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.497455 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.497439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qnb\" (UniqueName: \"kubernetes.io/projected/e36f0e98-2d0e-48c9-b794-4d896a17c592-kube-api-access-g9qnb\") pod \"cert-manager-webhook-587ccfb98-67582\" (UID: \"e36f0e98-2d0e-48c9-b794-4d896a17c592\") " pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:51.631173 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.631096 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:11:51.631173 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.631134 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:11:51.643041 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.643018 2559 kubelet.go:1628] "Image garbage collection succeeded" May 20 14:11:51.672481 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.672452 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g4d2m\"" May 20 14:11:51.679529 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.679418 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:52.051788 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:51.821556 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-67582"] May 20 14:11:52.051788 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:11:51.825727 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode36f0e98_2d0e_48c9_b794_4d896a17c592.slice/crio-08753a16404531baa262ab10985fd6585c653af65c2b698464bd1f250368c85c WatchSource:0}: Error finding container 08753a16404531baa262ab10985fd6585c653af65c2b698464bd1f250368c85c: Status 404 returned error can't find the container with id 08753a16404531baa262ab10985fd6585c653af65c2b698464bd1f250368c85c May 20 14:11:52.776424 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:52.776390 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" event={"ID":"e36f0e98-2d0e-48c9-b794-4d896a17c592","Type":"ContainerStarted","Data":"08753a16404531baa262ab10985fd6585c653af65c2b698464bd1f250368c85c"} May 20 14:11:54.783439 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:54.783409 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" event={"ID":"e36f0e98-2d0e-48c9-b794-4d896a17c592","Type":"ContainerStarted","Data":"3c407c08b2590f2f0f2dcbeabe1631ca29bdde3006aae8148af246696d9b658a"} May 20 14:11:54.783763 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:54.783533 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:11:54.804575 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:11:54.804520 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" podStartSLOduration=0.917495015 podStartE2EDuration="3.804504659s" podCreationTimestamp="2026-05-20 14:11:51 +0000 UTC" firstStartedPulling="2026-05-20 14:11:51.82758005 +0000 UTC m=+300.724822937" lastFinishedPulling="2026-05-20 14:11:54.71458969 +0000 UTC m=+303.611832581" observedRunningTime="2026-05-20 14:11:54.803040259 +0000 UTC m=+303.700283170" watchObservedRunningTime="2026-05-20 14:11:54.804504659 +0000 UTC m=+303.701747570" May 20 14:12:00.788077 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:00.788047 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-67582" May 20 14:12:17.683045 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.683010 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn"] May 20 14:12:17.685414 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.685396 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.688225 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.688206 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 14:12:17.688349 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.688269 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 14:12:17.689536 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.689519 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vwlxn\"" May 20 14:12:17.701397 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.701364 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn"] May 20 14:12:17.773540 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.773504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.773540 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.773537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.773752 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.773562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm8g5\" (UniqueName: \"kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.874429 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.874399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.874429 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.874430 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.874651 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.874451 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm8g5\" (UniqueName: \"kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.874783 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.874764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.874821 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.874790 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.889441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.889412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm8g5\" (UniqueName: \"kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:17.994416 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:17.994341 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:18.136312 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:18.136274 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn"] May 20 14:12:18.138349 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:12:18.138325 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2eb44c2_b7af_4e7a_b193_d9bba16553f7.slice/crio-10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a WatchSource:0}: Error finding container 10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a: Status 404 returned error can't find the container with id 10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a May 20 14:12:18.140086 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:18.140066 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:12:18.853991 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:18.853952 2559 generic.go:358] "Generic (PLEG): container finished" podID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerID="dd8d5787b8b2fd9eb11cfcb9f4cd4098c701503a0611ea964bf24a08879f740d" exitCode=0 May 20 14:12:18.854395 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:18.854001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" event={"ID":"e2eb44c2-b7af-4e7a-b193-d9bba16553f7","Type":"ContainerDied","Data":"dd8d5787b8b2fd9eb11cfcb9f4cd4098c701503a0611ea964bf24a08879f740d"} May 20 14:12:18.854395 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:18.854029 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" event={"ID":"e2eb44c2-b7af-4e7a-b193-d9bba16553f7","Type":"ContainerStarted","Data":"10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a"} May 20 14:12:19.857898 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:19.857808 2559 generic.go:358] "Generic (PLEG): container finished" podID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerID="17ee870a2877d69231ec7bb6a94e9cd90e6af26c93619b27ea47b147d822a745" exitCode=0 May 20 14:12:19.858357 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:19.857897 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" event={"ID":"e2eb44c2-b7af-4e7a-b193-d9bba16553f7","Type":"ContainerDied","Data":"17ee870a2877d69231ec7bb6a94e9cd90e6af26c93619b27ea47b147d822a745"} May 20 14:12:20.862441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:20.862402 2559 generic.go:358] "Generic (PLEG): container finished" podID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerID="fc927ebd8daa9c29e3b40300ee491e66d58f55a6423984b78f9d428ea5028970" exitCode=0 May 20 14:12:20.862824 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:20.862487 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" event={"ID":"e2eb44c2-b7af-4e7a-b193-d9bba16553f7","Type":"ContainerDied","Data":"fc927ebd8daa9c29e3b40300ee491e66d58f55a6423984b78f9d428ea5028970"} May 20 14:12:21.986794 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:21.986770 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:22.111341 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.111279 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle\") pod \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " May 20 14:12:22.111503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.111404 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util\") pod \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " May 20 14:12:22.111503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.111441 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm8g5\" (UniqueName: \"kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5\") pod \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\" (UID: \"e2eb44c2-b7af-4e7a-b193-d9bba16553f7\") " May 20 14:12:22.112159 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.112134 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle" (OuterVolumeSpecName: "bundle") pod "e2eb44c2-b7af-4e7a-b193-d9bba16553f7" (UID: "e2eb44c2-b7af-4e7a-b193-d9bba16553f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:12:22.113494 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.113458 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5" (OuterVolumeSpecName: "kube-api-access-vm8g5") pod "e2eb44c2-b7af-4e7a-b193-d9bba16553f7" (UID: "e2eb44c2-b7af-4e7a-b193-d9bba16553f7"). InnerVolumeSpecName "kube-api-access-vm8g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:12:22.117422 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.117375 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util" (OuterVolumeSpecName: "util") pod "e2eb44c2-b7af-4e7a-b193-d9bba16553f7" (UID: "e2eb44c2-b7af-4e7a-b193-d9bba16553f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:12:22.212376 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.212344 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:22.212376 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.212370 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm8g5\" (UniqueName: \"kubernetes.io/projected/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-kube-api-access-vm8g5\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:22.212376 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.212382 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2eb44c2-b7af-4e7a-b193-d9bba16553f7-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:22.870180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.870143 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" event={"ID":"e2eb44c2-b7af-4e7a-b193-d9bba16553f7","Type":"ContainerDied","Data":"10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a"} May 20 14:12:22.870180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.870177 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5bxkkn" May 20 14:12:22.870180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:22.870181 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10770998650cb46cf9567f9644eaf761a93117f0af9389b2b24a3232cceac30a" May 20 14:12:31.757175 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757072 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc"] May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757574 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="util" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757589 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="util" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757611 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="extract" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757620 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="extract" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757649 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="pull" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757656 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="pull" May 20 14:12:31.757773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.757730 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2eb44c2-b7af-4e7a-b193-d9bba16553f7" containerName="extract" May 20 14:12:31.771340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.771286 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.774365 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.774342 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4qpm2\"" May 20 14:12:31.774516 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.774398 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 14:12:31.775008 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.774986 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 14:12:31.775110 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.774985 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 14:12:31.775271 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.775246 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 14:12:31.785342 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.785322 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc"] May 20 14:12:31.891340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.891281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.891510 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.891364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9r2\" (UniqueName: \"kubernetes.io/projected/47e8a547-ca37-4eb0-8e18-0bae154330a1-kube-api-access-xn9r2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.891510 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.891399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.992393 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.992344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.992569 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.992406 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9r2\" (UniqueName: \"kubernetes.io/projected/47e8a547-ca37-4eb0-8e18-0bae154330a1-kube-api-access-xn9r2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.992615 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.992592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.994859 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.994838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:31.994973 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:31.994956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e8a547-ca37-4eb0-8e18-0bae154330a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:32.002017 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:32.001997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9r2\" (UniqueName: \"kubernetes.io/projected/47e8a547-ca37-4eb0-8e18-0bae154330a1-kube-api-access-xn9r2\") pod \"opendatahub-operator-controller-manager-74fcff7bc4-pl4nc\" (UID: \"47e8a547-ca37-4eb0-8e18-0bae154330a1\") " pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:32.083396 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:32.083333 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:32.220419 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:32.220342 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc"] May 20 14:12:32.223262 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:12:32.223230 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e8a547_ca37_4eb0_8e18_0bae154330a1.slice/crio-4b19cec7b19f116f238f202397beeacbe29d165b3f9fc820ac931848aafe75dd WatchSource:0}: Error finding container 4b19cec7b19f116f238f202397beeacbe29d165b3f9fc820ac931848aafe75dd: Status 404 returned error can't find the container with id 4b19cec7b19f116f238f202397beeacbe29d165b3f9fc820ac931848aafe75dd May 20 14:12:32.908378 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:32.908334 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" event={"ID":"47e8a547-ca37-4eb0-8e18-0bae154330a1","Type":"ContainerStarted","Data":"4b19cec7b19f116f238f202397beeacbe29d165b3f9fc820ac931848aafe75dd"} May 20 14:12:34.916533 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:34.916499 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" event={"ID":"47e8a547-ca37-4eb0-8e18-0bae154330a1","Type":"ContainerStarted","Data":"793e0f2c5fac4f23271109ac0d23db40a76a15598f6db0c902c13c64c3e38213"} May 20 14:12:34.916930 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:34.916759 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:34.976361 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:34.976291 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" podStartSLOduration=1.6072072579999999 podStartE2EDuration="3.976276422s" podCreationTimestamp="2026-05-20 14:12:31 +0000 UTC" firstStartedPulling="2026-05-20 14:12:32.225104753 +0000 UTC m=+341.122347641" lastFinishedPulling="2026-05-20 14:12:34.594173914 +0000 UTC m=+343.491416805" observedRunningTime="2026-05-20 14:12:34.969809105 +0000 UTC m=+343.867052016" watchObservedRunningTime="2026-05-20 14:12:34.976276422 +0000 UTC m=+343.873519332" May 20 14:12:45.921911 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:45.921882 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74fcff7bc4-pl4nc" May 20 14:12:49.742961 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.742923 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d"] May 20 14:12:49.745420 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.745399 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.748416 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.748395 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 14:12:49.749558 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.749536 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 14:12:49.749651 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.749536 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vwlxn\"" May 20 14:12:49.756980 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.756947 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d"] May 20 14:12:49.846284 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.846251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.846462 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.846332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.846462 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.846360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5r2\" (UniqueName: \"kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.947804 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.947771 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.947964 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.947828 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.947964 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.947855 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5r2\" (UniqueName: \"kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.948177 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.948158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.948215 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.948185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:49.965166 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:49.965140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5r2\" (UniqueName: \"kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:50.054956 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.054883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:50.208724 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.208697 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d"] May 20 14:12:50.210333 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:12:50.210278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2dea709_7b50_48f7_9233_32c008f1df4e.slice/crio-9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5 WatchSource:0}: Error finding container 9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5: Status 404 returned error can't find the container with id 9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5 May 20 14:12:50.943341 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.943307 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-pqplp"] May 20 14:12:50.945976 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.945954 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:50.950239 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.950217 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4pjz5\"" May 20 14:12:50.950370 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.950217 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 14:12:50.950370 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.950217 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 14:12:50.965740 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.965696 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-pqplp"] May 20 14:12:50.970137 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.970103 2559 generic.go:358] "Generic (PLEG): container finished" podID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerID="0f59a50989b946e95126f5d85787d4f7e1b7606a0e17da970bd3b89576fc98f7" exitCode=0 May 20 14:12:50.970240 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.970180 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" event={"ID":"d2dea709-7b50-48f7-9233-32c008f1df4e","Type":"ContainerDied","Data":"0f59a50989b946e95126f5d85787d4f7e1b7606a0e17da970bd3b89576fc98f7"} May 20 14:12:50.970240 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:50.970218 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" event={"ID":"d2dea709-7b50-48f7-9233-32c008f1df4e","Type":"ContainerStarted","Data":"9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5"} May 20 14:12:51.058231 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.058210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tmp\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.058368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.058242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tls-certs\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.058368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.058260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttt64\" (UniqueName: \"kubernetes.io/projected/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-kube-api-access-ttt64\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.159340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.159290 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tls-certs\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.159340 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.159344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttt64\" (UniqueName: \"kubernetes.io/projected/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-kube-api-access-ttt64\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.159519 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.159464 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tmp\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.161557 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.161529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tmp\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.161675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.161658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-tls-certs\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.168337 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.168286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttt64\" (UniqueName: \"kubernetes.io/projected/8dcea327-f12a-43f1-8bcb-7ff55dee3ef3-kube-api-access-ttt64\") pod \"kube-auth-proxy-587b5db545-pqplp\" (UID: \"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3\") " pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.256385 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.256271 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" May 20 14:12:51.402206 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:12:51.402175 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcea327_f12a_43f1_8bcb_7ff55dee3ef3.slice/crio-7dad3dbc562005732d174db253be9558f2140bd816f62c7f458a6a0bb574d0f7 WatchSource:0}: Error finding container 7dad3dbc562005732d174db253be9558f2140bd816f62c7f458a6a0bb574d0f7: Status 404 returned error can't find the container with id 7dad3dbc562005732d174db253be9558f2140bd816f62c7f458a6a0bb574d0f7 May 20 14:12:51.402341 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.402246 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-587b5db545-pqplp"] May 20 14:12:51.977707 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:51.977674 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" event={"ID":"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3","Type":"ContainerStarted","Data":"7dad3dbc562005732d174db253be9558f2140bd816f62c7f458a6a0bb574d0f7"} May 20 14:12:52.984054 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:52.984017 2559 generic.go:358] "Generic (PLEG): container finished" podID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerID="972b240e6c9f35840026a979f451afb7e23cae684927e0d876746e7ad4eec9fe" exitCode=0 May 20 14:12:52.984550 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:52.984084 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" event={"ID":"d2dea709-7b50-48f7-9233-32c008f1df4e","Type":"ContainerDied","Data":"972b240e6c9f35840026a979f451afb7e23cae684927e0d876746e7ad4eec9fe"} May 20 14:12:53.990099 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:53.990064 2559 generic.go:358] "Generic (PLEG): container finished" podID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerID="a33b76c972cc6f2c0728b793a3bd9343fabbef5a896407e46b4edb8948b05234" exitCode=0 May 20 14:12:53.990581 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:53.990139 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" event={"ID":"d2dea709-7b50-48f7-9233-32c008f1df4e","Type":"ContainerDied","Data":"a33b76c972cc6f2c0728b793a3bd9343fabbef5a896407e46b4edb8948b05234"} May 20 14:12:54.043479 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.043449 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rthjd"] May 20 14:12:54.046206 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.046181 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.048782 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.048758 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 20 14:12:54.048911 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.048864 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8nlp4\"" May 20 14:12:54.059377 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.059335 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rthjd"] May 20 14:12:54.085127 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.085102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.085253 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.085185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46b8\" (UniqueName: \"kubernetes.io/projected/823b9438-7878-4cb9-85e6-591652fa7688-kube-api-access-s46b8\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.186241 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.186198 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.186434 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.186326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s46b8\" (UniqueName: \"kubernetes.io/projected/823b9438-7878-4cb9-85e6-591652fa7688-kube-api-access-s46b8\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.186434 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:12:54.186386 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 20 14:12:54.186522 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:12:54.186468 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert podName:823b9438-7878-4cb9-85e6-591652fa7688 nodeName:}" failed. No retries permitted until 2026-05-20 14:12:54.686445968 +0000 UTC m=+363.583688870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert") pod "odh-model-controller-858dbf95b8-rthjd" (UID: "823b9438-7878-4cb9-85e6-591652fa7688") : secret "odh-model-controller-webhook-cert" not found May 20 14:12:54.196057 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.196025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46b8\" (UniqueName: \"kubernetes.io/projected/823b9438-7878-4cb9-85e6-591652fa7688-kube-api-access-s46b8\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.566067 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.566043 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 14:12:54.690490 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.690459 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:54.690700 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:12:54.690594 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 20 14:12:54.690700 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:12:54.690646 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert podName:823b9438-7878-4cb9-85e6-591652fa7688 nodeName:}" failed. No retries permitted until 2026-05-20 14:12:55.690631837 +0000 UTC m=+364.587874726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert") pod "odh-model-controller-858dbf95b8-rthjd" (UID: "823b9438-7878-4cb9-85e6-591652fa7688") : secret "odh-model-controller-webhook-cert" not found May 20 14:12:54.994956 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:54.994921 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" event={"ID":"8dcea327-f12a-43f1-8bcb-7ff55dee3ef3","Type":"ContainerStarted","Data":"6aeb866746dce554117d2772989eeb64ce7df93090ca4ec8b0dc9cfbfb328fa9"} May 20 14:12:55.014527 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.014482 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-587b5db545-pqplp" podStartSLOduration=1.8554813970000001 podStartE2EDuration="5.014467879s" podCreationTimestamp="2026-05-20 14:12:50 +0000 UTC" firstStartedPulling="2026-05-20 14:12:51.404018241 +0000 UTC m=+360.301261129" lastFinishedPulling="2026-05-20 14:12:54.563004707 +0000 UTC m=+363.460247611" observedRunningTime="2026-05-20 14:12:55.012442826 +0000 UTC m=+363.909685752" watchObservedRunningTime="2026-05-20 14:12:55.014467879 +0000 UTC m=+363.911710789" May 20 14:12:55.121195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.121171 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:55.194203 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.194176 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb5r2\" (UniqueName: \"kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2\") pod \"d2dea709-7b50-48f7-9233-32c008f1df4e\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " May 20 14:12:55.194396 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.194210 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util\") pod \"d2dea709-7b50-48f7-9233-32c008f1df4e\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " May 20 14:12:55.194396 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.194253 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle\") pod \"d2dea709-7b50-48f7-9233-32c008f1df4e\" (UID: \"d2dea709-7b50-48f7-9233-32c008f1df4e\") " May 20 14:12:55.195142 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.195117 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle" (OuterVolumeSpecName: "bundle") pod "d2dea709-7b50-48f7-9233-32c008f1df4e" (UID: "d2dea709-7b50-48f7-9233-32c008f1df4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:12:55.196266 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.196242 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2" (OuterVolumeSpecName: "kube-api-access-xb5r2") pod "d2dea709-7b50-48f7-9233-32c008f1df4e" (UID: "d2dea709-7b50-48f7-9233-32c008f1df4e"). InnerVolumeSpecName "kube-api-access-xb5r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:12:55.199608 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.199579 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util" (OuterVolumeSpecName: "util") pod "d2dea709-7b50-48f7-9233-32c008f1df4e" (UID: "d2dea709-7b50-48f7-9233-32c008f1df4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:12:55.295432 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.295360 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb5r2\" (UniqueName: \"kubernetes.io/projected/d2dea709-7b50-48f7-9233-32c008f1df4e-kube-api-access-xb5r2\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:55.295432 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.295384 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:55.295432 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.295394 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2dea709-7b50-48f7-9233-32c008f1df4e-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:12:55.697728 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.697693 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:55.700071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.700048 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/823b9438-7878-4cb9-85e6-591652fa7688-cert\") pod \"odh-model-controller-858dbf95b8-rthjd\" (UID: \"823b9438-7878-4cb9-85e6-591652fa7688\") " pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:55.858186 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:55.858155 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:12:56.001231 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:56.001152 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" May 20 14:12:56.001231 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:56.001175 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483572f2d" event={"ID":"d2dea709-7b50-48f7-9233-32c008f1df4e","Type":"ContainerDied","Data":"9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5"} May 20 14:12:56.001231 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:56.001213 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f8bf1556e7ea154e4d63f72341e6a65e4d5175ddeb4601b8af2ce801d016ad5" May 20 14:12:56.002234 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:56.002208 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rthjd"] May 20 14:12:56.006134 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:12:56.006111 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823b9438_7878_4cb9_85e6_591652fa7688.slice/crio-17b9eff3e9266162ce6b2aba0d6e14b372395011a2e7ba67175bf126a1ffe1ab WatchSource:0}: Error finding container 17b9eff3e9266162ce6b2aba0d6e14b372395011a2e7ba67175bf126a1ffe1ab: Status 404 returned error can't find the container with id 17b9eff3e9266162ce6b2aba0d6e14b372395011a2e7ba67175bf126a1ffe1ab May 20 14:12:57.007932 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:57.007892 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" event={"ID":"823b9438-7878-4cb9-85e6-591652fa7688","Type":"ContainerStarted","Data":"17b9eff3e9266162ce6b2aba0d6e14b372395011a2e7ba67175bf126a1ffe1ab"} May 20 14:12:59.015255 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:59.015173 2559 generic.go:358] "Generic (PLEG): container finished" podID="823b9438-7878-4cb9-85e6-591652fa7688" containerID="64e6d65721b5efdad4bb5de69017e7f47de51857a1de1b3284eebcd8beff2a8f" exitCode=1 May 20 14:12:59.015624 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:59.015260 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" event={"ID":"823b9438-7878-4cb9-85e6-591652fa7688","Type":"ContainerDied","Data":"64e6d65721b5efdad4bb5de69017e7f47de51857a1de1b3284eebcd8beff2a8f"} May 20 14:12:59.015624 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:12:59.015526 2559 scope.go:117] "RemoveContainer" containerID="64e6d65721b5efdad4bb5de69017e7f47de51857a1de1b3284eebcd8beff2a8f" May 20 14:13:00.020002 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.019972 2559 generic.go:358] "Generic (PLEG): container finished" podID="823b9438-7878-4cb9-85e6-591652fa7688" containerID="b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187" exitCode=1 May 20 14:13:00.020492 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.020008 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" event={"ID":"823b9438-7878-4cb9-85e6-591652fa7688","Type":"ContainerDied","Data":"b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187"} May 20 14:13:00.020492 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.020038 2559 scope.go:117] "RemoveContainer" containerID="64e6d65721b5efdad4bb5de69017e7f47de51857a1de1b3284eebcd8beff2a8f" May 20 14:13:00.020492 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.020269 2559 scope.go:117] "RemoveContainer" containerID="b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187" May 20 14:13:00.020632 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:13:00.020508 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rthjd_opendatahub(823b9438-7878-4cb9-85e6-591652fa7688)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" podUID="823b9438-7878-4cb9-85e6-591652fa7688" May 20 14:13:00.331588 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331493 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lm8c9"] May 20 14:13:00.331882 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331868 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="util" May 20 14:13:00.331935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331884 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="util" May 20 14:13:00.331935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331891 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="extract" May 20 14:13:00.331935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331897 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="extract" May 20 14:13:00.331935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331908 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="pull" May 20 14:13:00.331935 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331914 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="pull" May 20 14:13:00.332099 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.331965 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2dea709-7b50-48f7-9233-32c008f1df4e" containerName="extract" May 20 14:13:00.334342 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.334327 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:00.337159 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.337137 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 20 14:13:00.337671 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.337651 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zqfg5\"" May 20 14:13:00.358723 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.358698 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lm8c9"] May 20 14:13:00.432652 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.432620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw2h6\" (UniqueName: \"kubernetes.io/projected/63d93a13-3864-4fb5-be99-ebc89b37a120-kube-api-access-jw2h6\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:00.432784 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.432729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:00.533317 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.533263 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:00.533478 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.533349 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw2h6\" (UniqueName: \"kubernetes.io/projected/63d93a13-3864-4fb5-be99-ebc89b37a120-kube-api-access-jw2h6\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:00.533478 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:13:00.533426 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 20 14:13:00.533595 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:13:00.533506 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert podName:63d93a13-3864-4fb5-be99-ebc89b37a120 nodeName:}" failed. No retries permitted until 2026-05-20 14:13:01.03348313 +0000 UTC m=+369.930726024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert") pod "kserve-controller-manager-856948b99f-lm8c9" (UID: "63d93a13-3864-4fb5-be99-ebc89b37a120") : secret "kserve-webhook-server-cert" not found May 20 14:13:00.548177 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:00.548155 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw2h6\" (UniqueName: \"kubernetes.io/projected/63d93a13-3864-4fb5-be99-ebc89b37a120-kube-api-access-jw2h6\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:01.025316 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:01.025273 2559 scope.go:117] "RemoveContainer" containerID="b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187" May 20 14:13:01.025681 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:13:01.025508 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rthjd_opendatahub(823b9438-7878-4cb9-85e6-591652fa7688)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" podUID="823b9438-7878-4cb9-85e6-591652fa7688" May 20 14:13:01.036404 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:01.036383 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:01.038776 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:01.038750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63d93a13-3864-4fb5-be99-ebc89b37a120-cert\") pod \"kserve-controller-manager-856948b99f-lm8c9\" (UID: \"63d93a13-3864-4fb5-be99-ebc89b37a120\") " pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:01.246796 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:01.246745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:01.401217 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:01.401195 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lm8c9"] May 20 14:13:01.403353 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:13:01.403323 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d93a13_3864_4fb5_be99_ebc89b37a120.slice/crio-f0c4bfd1ab6b43adda977af6badbf00d35f790d8a288e53164d48e6a35b4d41b WatchSource:0}: Error finding container f0c4bfd1ab6b43adda977af6badbf00d35f790d8a288e53164d48e6a35b4d41b: Status 404 returned error can't find the container with id f0c4bfd1ab6b43adda977af6badbf00d35f790d8a288e53164d48e6a35b4d41b May 20 14:13:02.029019 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:02.028979 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" event={"ID":"63d93a13-3864-4fb5-be99-ebc89b37a120","Type":"ContainerStarted","Data":"f0c4bfd1ab6b43adda977af6badbf00d35f790d8a288e53164d48e6a35b4d41b"} May 20 14:13:04.036781 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.036745 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" event={"ID":"63d93a13-3864-4fb5-be99-ebc89b37a120","Type":"ContainerStarted","Data":"2dc0c6b50882de7a1def449a60a20c0c85ba991e0c91a306eda222fd0b351cde"} May 20 14:13:04.037138 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.036862 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:13:04.115993 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.111886 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" podStartSLOduration=1.689743586 podStartE2EDuration="4.111868031s" podCreationTimestamp="2026-05-20 14:13:00 +0000 UTC" firstStartedPulling="2026-05-20 14:13:01.404642526 +0000 UTC m=+370.301885415" lastFinishedPulling="2026-05-20 14:13:03.826766972 +0000 UTC m=+372.724009860" observedRunningTime="2026-05-20 14:13:04.110798377 +0000 UTC m=+373.008041289" watchObservedRunningTime="2026-05-20 14:13:04.111868031 +0000 UTC m=+373.009110941" May 20 14:13:04.547791 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.547760 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf"] May 20 14:13:04.550215 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.550199 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.553468 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.553445 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vwlxn\"" May 20 14:13:04.554011 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.553990 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 14:13:04.555361 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.555342 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 14:13:04.561119 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.561099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrt48\" (UniqueName: \"kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.561221 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.561158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.561221 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.561196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.568940 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.568920 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf"] May 20 14:13:04.661631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.661602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrt48\" (UniqueName: \"kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.661785 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.661657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.661785 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.661694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.662093 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.662076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.662137 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.662099 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.678440 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.678412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrt48\" (UniqueName: \"kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:04.860075 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:04.860002 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:05.026834 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:13:05.026794 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34eee35_be05_4805_b7ad_4ad60bc87e23.slice/crio-72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56 WatchSource:0}: Error finding container 72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56: Status 404 returned error can't find the container with id 72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56 May 20 14:13:05.032636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:05.032603 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf"] May 20 14:13:05.040785 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:05.040760 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" event={"ID":"a34eee35-be05-4805-b7ad-4ad60bc87e23","Type":"ContainerStarted","Data":"72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56"} May 20 14:13:05.858839 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:05.858812 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:13:05.859191 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:05.859178 2559 scope.go:117] "RemoveContainer" containerID="b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187" May 20 14:13:05.859408 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:13:05.859379 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rthjd_opendatahub(823b9438-7878-4cb9-85e6-591652fa7688)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" podUID="823b9438-7878-4cb9-85e6-591652fa7688" May 20 14:13:06.045770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.045737 2559 generic.go:358] "Generic (PLEG): container finished" podID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerID="1c7dd803bd8c57098109c02b01f22399581a34f178948a2d3a5e3c687077f1eb" exitCode=0 May 20 14:13:06.046122 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.045810 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" event={"ID":"a34eee35-be05-4805-b7ad-4ad60bc87e23","Type":"ContainerDied","Data":"1c7dd803bd8c57098109c02b01f22399581a34f178948a2d3a5e3c687077f1eb"} May 20 14:13:06.128279 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.128206 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm"] May 20 14:13:06.192212 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.192186 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm"] May 20 14:13:06.192376 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.192219 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.195428 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.195404 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 20 14:13:06.195913 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.195898 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-blrzr\"" May 20 14:13:06.196273 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.196257 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 20 14:13:06.274773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.274748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5468\" (UniqueName: \"kubernetes.io/projected/70038240-cb47-4674-8f0c-1b78246a2ef7-kube-api-access-s5468\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.274893 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.274825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/70038240-cb47-4674-8f0c-1b78246a2ef7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.376065 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.376038 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/70038240-cb47-4674-8f0c-1b78246a2ef7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.376231 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.376084 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5468\" (UniqueName: \"kubernetes.io/projected/70038240-cb47-4674-8f0c-1b78246a2ef7-kube-api-access-s5468\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.378557 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.378501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/70038240-cb47-4674-8f0c-1b78246a2ef7-operator-config\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.387787 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.387759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5468\" (UniqueName: \"kubernetes.io/projected/70038240-cb47-4674-8f0c-1b78246a2ef7-kube-api-access-s5468\") pod \"servicemesh-operator3-55f49c5f94-tfsdm\" (UID: \"70038240-cb47-4674-8f0c-1b78246a2ef7\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.501695 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.501662 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:06.659534 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:06.659510 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm"] May 20 14:13:06.661665 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:13:06.661637 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70038240_cb47_4674_8f0c_1b78246a2ef7.slice/crio-d67c9f72269a277e5a6a8095a468f2a2012f9ef8e21cb37e24d2a4fff6cdfc3f WatchSource:0}: Error finding container d67c9f72269a277e5a6a8095a468f2a2012f9ef8e21cb37e24d2a4fff6cdfc3f: Status 404 returned error can't find the container with id d67c9f72269a277e5a6a8095a468f2a2012f9ef8e21cb37e24d2a4fff6cdfc3f May 20 14:13:07.050259 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:07.050174 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" event={"ID":"70038240-cb47-4674-8f0c-1b78246a2ef7","Type":"ContainerStarted","Data":"d67c9f72269a277e5a6a8095a468f2a2012f9ef8e21cb37e24d2a4fff6cdfc3f"} May 20 14:13:08.055994 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:08.055957 2559 generic.go:358] "Generic (PLEG): container finished" podID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerID="d957b657a720573298757fa940264c985389462ae020e2fa52aa0d25cdb78684" exitCode=0 May 20 14:13:08.056368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:08.056043 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" event={"ID":"a34eee35-be05-4805-b7ad-4ad60bc87e23","Type":"ContainerDied","Data":"d957b657a720573298757fa940264c985389462ae020e2fa52aa0d25cdb78684"} May 20 14:13:09.066003 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:09.065963 2559 generic.go:358] "Generic (PLEG): container finished" podID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerID="34764cca044f4191a159e9d4006304a8b7e5b670d1554f6a601c7b4e9c9a9b03" exitCode=0 May 20 14:13:09.066420 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:09.066053 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" event={"ID":"a34eee35-be05-4805-b7ad-4ad60bc87e23","Type":"ContainerDied","Data":"34764cca044f4191a159e9d4006304a8b7e5b670d1554f6a601c7b4e9c9a9b03"} May 20 14:13:10.199916 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.199895 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:10.210025 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.210006 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util\") pod \"a34eee35-be05-4805-b7ad-4ad60bc87e23\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " May 20 14:13:10.210099 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.210046 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrt48\" (UniqueName: \"kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48\") pod \"a34eee35-be05-4805-b7ad-4ad60bc87e23\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " May 20 14:13:10.210099 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.210069 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle\") pod \"a34eee35-be05-4805-b7ad-4ad60bc87e23\" (UID: \"a34eee35-be05-4805-b7ad-4ad60bc87e23\") " May 20 14:13:10.210959 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.210930 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle" (OuterVolumeSpecName: "bundle") pod "a34eee35-be05-4805-b7ad-4ad60bc87e23" (UID: "a34eee35-be05-4805-b7ad-4ad60bc87e23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:13:10.212126 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.212102 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48" (OuterVolumeSpecName: "kube-api-access-zrt48") pod "a34eee35-be05-4805-b7ad-4ad60bc87e23" (UID: "a34eee35-be05-4805-b7ad-4ad60bc87e23"). InnerVolumeSpecName "kube-api-access-zrt48". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:13:10.217165 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.217139 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util" (OuterVolumeSpecName: "util") pod "a34eee35-be05-4805-b7ad-4ad60bc87e23" (UID: "a34eee35-be05-4805-b7ad-4ad60bc87e23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:13:10.311630 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.311600 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-util\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:13:10.311630 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.311626 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrt48\" (UniqueName: \"kubernetes.io/projected/a34eee35-be05-4805-b7ad-4ad60bc87e23-kube-api-access-zrt48\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:13:10.311630 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:10.311637 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a34eee35-be05-4805-b7ad-4ad60bc87e23-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:13:11.075983 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:11.075951 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" event={"ID":"a34eee35-be05-4805-b7ad-4ad60bc87e23","Type":"ContainerDied","Data":"72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56"} May 20 14:13:11.076156 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:11.075989 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72cc2cfac7fb237e2294e0f04da34f8466e0b30c41267e87382b209f4b1e5b56" May 20 14:13:11.076156 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:11.075966 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akr4gf" May 20 14:13:12.081368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:12.081331 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" event={"ID":"70038240-cb47-4674-8f0c-1b78246a2ef7","Type":"ContainerStarted","Data":"064fad5528e0c35a4595c81d20a1651545910c45c9576282342137252b7f7b49"} May 20 14:13:12.081679 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:12.081449 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:12.108116 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:12.108069 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" podStartSLOduration=0.757775971 podStartE2EDuration="6.108053826s" podCreationTimestamp="2026-05-20 14:13:06 +0000 UTC" firstStartedPulling="2026-05-20 14:13:06.664284274 +0000 UTC m=+375.561527166" lastFinishedPulling="2026-05-20 14:13:12.014562115 +0000 UTC m=+380.911805021" observedRunningTime="2026-05-20 14:13:12.105614369 +0000 UTC m=+381.002857278" watchObservedRunningTime="2026-05-20 14:13:12.108053826 +0000 UTC m=+381.005296736" May 20 14:13:13.002225 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002191 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv"] May 20 14:13:13.002631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002615 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="extract" May 20 14:13:13.002716 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002634 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="extract" May 20 14:13:13.002716 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002651 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="util" May 20 14:13:13.002716 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002659 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="util" May 20 14:13:13.002716 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002697 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="pull" May 20 14:13:13.002716 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002707 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="pull" May 20 14:13:13.002955 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.002793 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a34eee35-be05-4805-b7ad-4ad60bc87e23" containerName="extract" May 20 14:13:13.006093 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.006073 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.009000 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.008980 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 20 14:13:13.009120 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.008980 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 20 14:13:13.009439 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.009425 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nqqpn\"" May 20 14:13:13.009635 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.009613 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 20 14:13:13.009717 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.009613 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 20 14:13:13.023878 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.023858 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv"] May 20 14:13:13.035773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.035860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.035860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.035860 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.035972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.035972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.035953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrz2\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-kube-api-access-fmrz2\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.036059 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.036041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.136786 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136832 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136852 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136886 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136924 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137233 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.136985 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrz2\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-kube-api-access-fmrz2\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.137735 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.137711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.139191 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.139170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.139436 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.139413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.139621 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.139602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.139689 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.139631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.145613 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.145594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrz2\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-kube-api-access-fmrz2\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.145712 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.145685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac37d8fe-b952-42ad-b7a2-cc4aa6059866-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cz8sv\" (UID: \"ac37d8fe-b952-42ad-b7a2-cc4aa6059866\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.315325 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.315230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:13.463645 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:13.463620 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv"] May 20 14:13:13.466177 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:13:13.466150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac37d8fe_b952_42ad_b7a2_cc4aa6059866.slice/crio-f586a1b8c48695b80074f494e046d69c734112798320956dca1418232ef60897 WatchSource:0}: Error finding container f586a1b8c48695b80074f494e046d69c734112798320956dca1418232ef60897: Status 404 returned error can't find the container with id f586a1b8c48695b80074f494e046d69c734112798320956dca1418232ef60897 May 20 14:13:14.089113 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:14.089075 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" event={"ID":"ac37d8fe-b952-42ad-b7a2-cc4aa6059866","Type":"ContainerStarted","Data":"f586a1b8c48695b80074f494e046d69c734112798320956dca1418232ef60897"} May 20 14:13:15.858821 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:15.858788 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:13:15.859265 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:15.859251 2559 scope.go:117] "RemoveContainer" containerID="b563bca1d99b6798de369898c0a2750518a6bd7d29673626689db945138fa187" May 20 14:13:16.770607 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:16.770567 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 20 14:13:16.770703 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:16.770652 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 20 14:13:17.102088 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.102001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" event={"ID":"ac37d8fe-b952-42ad-b7a2-cc4aa6059866","Type":"ContainerStarted","Data":"a7c9cbec97327c5486c91bdd4b5b3e089f5b20a287f1435649e9cf9c424e607c"} May 20 14:13:17.102532 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.102177 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:17.103740 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.103717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" event={"ID":"823b9438-7878-4cb9-85e6-591652fa7688","Type":"ContainerStarted","Data":"6865887df590c720a6eb299c6846a9523c30ec61cc73ae92ff374fd5ae16c535"} May 20 14:13:17.103916 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.103893 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:13:17.104080 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.104059 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-cz8sv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 20 14:13:17.104138 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.104107 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" podUID="ac37d8fe-b952-42ad-b7a2-cc4aa6059866" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 14:13:17.175118 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.175063 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" podStartSLOduration=1.873437414 podStartE2EDuration="5.175049173s" podCreationTimestamp="2026-05-20 14:13:12 +0000 UTC" firstStartedPulling="2026-05-20 14:13:13.468642997 +0000 UTC m=+382.365885885" lastFinishedPulling="2026-05-20 14:13:16.770254756 +0000 UTC m=+385.667497644" observedRunningTime="2026-05-20 14:13:17.173537253 +0000 UTC m=+386.070780163" watchObservedRunningTime="2026-05-20 14:13:17.175049173 +0000 UTC m=+386.072292083" May 20 14:13:17.226725 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:17.226660 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" podStartSLOduration=2.4636402889999998 podStartE2EDuration="23.226644223s" podCreationTimestamp="2026-05-20 14:12:54 +0000 UTC" firstStartedPulling="2026-05-20 14:12:56.007274465 +0000 UTC m=+364.904517353" lastFinishedPulling="2026-05-20 14:13:16.770278387 +0000 UTC m=+385.667521287" observedRunningTime="2026-05-20 14:13:17.221827058 +0000 UTC m=+386.119069970" watchObservedRunningTime="2026-05-20 14:13:17.226644223 +0000 UTC m=+386.123887133" May 20 14:13:18.107896 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:18.107863 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cz8sv" May 20 14:13:23.087476 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:23.087444 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-tfsdm" May 20 14:13:28.109225 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:28.109186 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-rthjd" May 20 14:13:35.045986 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:13:35.045954 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-lm8c9" May 20 14:14:26.890813 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.890783 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-7992p"] May 20 14:14:26.894192 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.894174 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:26.896992 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.896970 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 14:14:26.897096 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.897082 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pnh9z\"" May 20 14:14:26.897170 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.897109 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 14:14:26.913009 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.912982 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-7992p"] May 20 14:14:26.993369 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:26.993326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp86z\" (UniqueName: \"kubernetes.io/projected/a687ee3f-d828-4b75-b141-443a4dfc8200-kube-api-access-vp86z\") pod \"authorino-operator-657f44b778-7992p\" (UID: \"a687ee3f-d828-4b75-b141-443a4dfc8200\") " pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:27.093987 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:27.093951 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp86z\" (UniqueName: \"kubernetes.io/projected/a687ee3f-d828-4b75-b141-443a4dfc8200-kube-api-access-vp86z\") pod \"authorino-operator-657f44b778-7992p\" (UID: \"a687ee3f-d828-4b75-b141-443a4dfc8200\") " pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:27.103236 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:27.103211 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp86z\" (UniqueName: \"kubernetes.io/projected/a687ee3f-d828-4b75-b141-443a4dfc8200-kube-api-access-vp86z\") pod \"authorino-operator-657f44b778-7992p\" (UID: \"a687ee3f-d828-4b75-b141-443a4dfc8200\") " pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:27.205172 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:27.205138 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:27.341610 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:27.341586 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-7992p"] May 20 14:14:27.343751 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:14:27.343720 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda687ee3f_d828_4b75_b141_443a4dfc8200.slice/crio-0cb4da20ac8e96db9bae5ae7636b4f98839eeb96f18f8658f0e7958ca230a648 WatchSource:0}: Error finding container 0cb4da20ac8e96db9bae5ae7636b4f98839eeb96f18f8658f0e7958ca230a648: Status 404 returned error can't find the container with id 0cb4da20ac8e96db9bae5ae7636b4f98839eeb96f18f8658f0e7958ca230a648 May 20 14:14:28.354208 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:28.354164 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-7992p" event={"ID":"a687ee3f-d828-4b75-b141-443a4dfc8200","Type":"ContainerStarted","Data":"0cb4da20ac8e96db9bae5ae7636b4f98839eeb96f18f8658f0e7958ca230a648"} May 20 14:14:29.363475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:29.363434 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-7992p" event={"ID":"a687ee3f-d828-4b75-b141-443a4dfc8200","Type":"ContainerStarted","Data":"ace558c71bec6f10ef5d9c1d186712b2a798680c3a6c6246db68f2089fd02044"} May 20 14:14:29.364030 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:29.363563 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:29.392503 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:29.392455 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-7992p" podStartSLOduration=1.593242347 podStartE2EDuration="3.392441695s" podCreationTimestamp="2026-05-20 14:14:26 +0000 UTC" firstStartedPulling="2026-05-20 14:14:27.348463562 +0000 UTC m=+456.245706465" lastFinishedPulling="2026-05-20 14:14:29.147662923 +0000 UTC m=+458.044905813" observedRunningTime="2026-05-20 14:14:29.389078035 +0000 UTC m=+458.286320945" watchObservedRunningTime="2026-05-20 14:14:29.392441695 +0000 UTC m=+458.289684604" May 20 14:14:31.891085 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:31.891046 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:14:35.330646 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.330613 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j"] May 20 14:14:35.334025 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.334008 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.338171 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.338152 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ndnpv\"" May 20 14:14:35.347287 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.347260 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j"] May 20 14:14:35.465567 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.465533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59jjf\" (UniqueName: \"kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.465749 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.465581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.566390 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.566344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59jjf\" (UniqueName: \"kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.566552 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.566406 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.566765 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.566747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.575856 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.575829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59jjf\" (UniqueName: \"kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.644439 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.644349 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:35.775762 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:35.775738 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j"] May 20 14:14:35.777982 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:14:35.777951 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ccd4dc_dca0_4553_b16b_afc211597b29.slice/crio-4eaed3f3f2ee8f273eac80bdf07afe3ed65176d42b1032ca522b707be6e769fa WatchSource:0}: Error finding container 4eaed3f3f2ee8f273eac80bdf07afe3ed65176d42b1032ca522b707be6e769fa: Status 404 returned error can't find the container with id 4eaed3f3f2ee8f273eac80bdf07afe3ed65176d42b1032ca522b707be6e769fa May 20 14:14:36.390446 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:36.390407 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" event={"ID":"a9ccd4dc-dca0-4553-b16b-afc211597b29","Type":"ContainerStarted","Data":"4eaed3f3f2ee8f273eac80bdf07afe3ed65176d42b1032ca522b707be6e769fa"} May 20 14:14:40.369814 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:40.369778 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-7992p" May 20 14:14:41.414146 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:41.414113 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" event={"ID":"a9ccd4dc-dca0-4553-b16b-afc211597b29","Type":"ContainerStarted","Data":"bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95"} May 20 14:14:41.414538 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:41.414177 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:41.440051 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:41.440004 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" podStartSLOduration=0.973438472 podStartE2EDuration="6.439989096s" podCreationTimestamp="2026-05-20 14:14:35 +0000 UTC" firstStartedPulling="2026-05-20 14:14:35.780151808 +0000 UTC m=+464.677394696" lastFinishedPulling="2026-05-20 14:14:41.246702429 +0000 UTC m=+470.143945320" observedRunningTime="2026-05-20 14:14:41.438130924 +0000 UTC m=+470.335373836" watchObservedRunningTime="2026-05-20 14:14:41.439989096 +0000 UTC m=+470.337232007" May 20 14:14:52.420103 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:52.420065 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:54.087114 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.087078 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j"] May 20 14:14:54.087604 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.087322 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" containerName="manager" containerID="cri-o://bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95" gracePeriod=2 May 20 14:14:54.094697 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.094669 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j"] May 20 14:14:54.114670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.114638 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:14:54.115165 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.115143 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" containerName="manager" May 20 14:14:54.115165 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.115166 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" containerName="manager" May 20 14:14:54.115289 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.115261 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" containerName="manager" May 20 14:14:54.119623 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.119602 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.122857 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.122832 2559 status_manager.go:895] "Failed to get status for pod" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" May 20 14:14:54.141287 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.141259 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:14:54.235582 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.235511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8g7w\" (UniqueName: \"kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.235876 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.235853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.324379 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.324353 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:54.326852 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.326826 2559 status_manager.go:895] "Failed to get status for pod" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" May 20 14:14:54.337481 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.337425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.337561 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.337531 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8g7w\" (UniqueName: \"kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.337757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.337739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.346831 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.346809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8g7w\" (UniqueName: \"kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xjm6f\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.438641 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.438614 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59jjf\" (UniqueName: \"kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf\") pod \"a9ccd4dc-dca0-4553-b16b-afc211597b29\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " May 20 14:14:54.438824 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.438694 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume\") pod \"a9ccd4dc-dca0-4553-b16b-afc211597b29\" (UID: \"a9ccd4dc-dca0-4553-b16b-afc211597b29\") " May 20 14:14:54.439079 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.439055 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a9ccd4dc-dca0-4553-b16b-afc211597b29" (UID: "a9ccd4dc-dca0-4553-b16b-afc211597b29"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:14:54.440873 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.440846 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf" (OuterVolumeSpecName: "kube-api-access-59jjf") pod "a9ccd4dc-dca0-4553-b16b-afc211597b29" (UID: "a9ccd4dc-dca0-4553-b16b-afc211597b29"). InnerVolumeSpecName "kube-api-access-59jjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:14:54.460266 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.460238 2559 generic.go:358] "Generic (PLEG): container finished" podID="a9ccd4dc-dca0-4553-b16b-afc211597b29" containerID="bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95" exitCode=0 May 20 14:14:54.460377 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.460290 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" May 20 14:14:54.460425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.460316 2559 scope.go:117] "RemoveContainer" containerID="bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95" May 20 14:14:54.462909 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.462881 2559 status_manager.go:895] "Failed to get status for pod" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" May 20 14:14:54.466606 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.466573 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:54.469121 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.469099 2559 scope.go:117] "RemoveContainer" containerID="bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95" May 20 14:14:54.469390 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:14:54.469370 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95\": container with ID starting with bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95 not found: ID does not exist" containerID="bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95" May 20 14:14:54.469445 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.469398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95"} err="failed to get container status \"bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95\": rpc error: code = NotFound desc = could not find container \"bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95\": container with ID starting with bb8173295f6c641dc90dbe44c8a4f2e7fe6e0c80cae82c1ea214cda4681c3a95 not found: ID does not exist" May 20 14:14:54.471071 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.471050 2559 status_manager.go:895] "Failed to get status for pod" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" May 20 14:14:54.539779 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.539743 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59jjf\" (UniqueName: \"kubernetes.io/projected/a9ccd4dc-dca0-4553-b16b-afc211597b29-kube-api-access-59jjf\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:54.539779 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.539770 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9ccd4dc-dca0-4553-b16b-afc211597b29-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:54.609668 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:54.609634 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:14:54.611256 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:14:54.611232 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3daf77_5672_4521_a20a_a0ca578e5578.slice/crio-6a0821d3488add4c0eabe7724f6b4c03f3f8f7824be1c036597e1d556036ac4f WatchSource:0}: Error finding container 6a0821d3488add4c0eabe7724f6b4c03f3f8f7824be1c036597e1d556036ac4f: Status 404 returned error can't find the container with id 6a0821d3488add4c0eabe7724f6b4c03f3f8f7824be1c036597e1d556036ac4f May 20 14:14:55.466125 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.466089 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" event={"ID":"3b3daf77-5672-4521-a20a-a0ca578e5578","Type":"ContainerStarted","Data":"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49"} May 20 14:14:55.466526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.466130 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" event={"ID":"3b3daf77-5672-4521-a20a-a0ca578e5578","Type":"ContainerStarted","Data":"6a0821d3488add4c0eabe7724f6b4c03f3f8f7824be1c036597e1d556036ac4f"} May 20 14:14:55.466526 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.466204 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:14:55.468906 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.468884 2559 status_manager.go:895] "Failed to get status for pod" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xww2j" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xww2j\" is forbidden: User \"system:node:ip-10-0-137-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-228.ec2.internal' and this object" May 20 14:14:55.506972 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.506916 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" podStartSLOduration=1.506899456 podStartE2EDuration="1.506899456s" podCreationTimestamp="2026-05-20 14:14:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:14:55.505620631 +0000 UTC m=+484.402863543" watchObservedRunningTime="2026-05-20 14:14:55.506899456 +0000 UTC m=+484.404142367" May 20 14:14:55.762228 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:55.762138 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ccd4dc-dca0-4553-b16b-afc211597b29" path="/var/lib/kubelet/pods/a9ccd4dc-dca0-4553-b16b-afc211597b29/volumes" May 20 14:14:56.911261 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:56.911216 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d44765c8-x5f79" podUID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" containerName="console" containerID="cri-o://a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87" gracePeriod=15 May 20 14:14:57.159353 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.159334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d44765c8-x5f79_de28cc10-2178-4ea3-ae42-4d7d2a9d8497/console/0.log" May 20 14:14:57.159469 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.159409 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44765c8-x5f79" May 20 14:14:57.266179 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266095 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266179 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266157 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266202 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266249 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266378 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266441 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266431 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266642 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266463 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt4z6\" (UniqueName: \"kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6\") pod \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\" (UID: \"de28cc10-2178-4ea3-ae42-4d7d2a9d8497\") " May 20 14:14:57.266705 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266680 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config" (OuterVolumeSpecName: "console-config") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:14:57.266757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266712 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:14:57.266757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266719 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca" (OuterVolumeSpecName: "service-ca") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:14:57.266846 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266762 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:14:57.266846 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266798 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-trusted-ca-bundle\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.266846 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.266818 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.268482 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.268460 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:14:57.268757 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.268724 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:14:57.268855 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.268765 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6" (OuterVolumeSpecName: "kube-api-access-bt4z6") pod "de28cc10-2178-4ea3-ae42-4d7d2a9d8497" (UID: "de28cc10-2178-4ea3-ae42-4d7d2a9d8497"). InnerVolumeSpecName "kube-api-access-bt4z6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:14:57.367979 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.367943 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-oauth-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.367979 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.367972 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-serving-cert\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.367979 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.367983 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt4z6\" (UniqueName: \"kubernetes.io/projected/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-kube-api-access-bt4z6\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.368216 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.367993 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-console-oauth-config\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.368216 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.368002 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de28cc10-2178-4ea3-ae42-4d7d2a9d8497-service-ca\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:14:57.476613 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d44765c8-x5f79_de28cc10-2178-4ea3-ae42-4d7d2a9d8497/console/0.log" May 20 14:14:57.476770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476629 2559 generic.go:358] "Generic (PLEG): container finished" podID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" containerID="a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87" exitCode=2 May 20 14:14:57.476770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476700 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44765c8-x5f79" event={"ID":"de28cc10-2178-4ea3-ae42-4d7d2a9d8497","Type":"ContainerDied","Data":"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87"} May 20 14:14:57.476770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476723 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d44765c8-x5f79" May 20 14:14:57.476770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476734 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d44765c8-x5f79" event={"ID":"de28cc10-2178-4ea3-ae42-4d7d2a9d8497","Type":"ContainerDied","Data":"ecf8053edaa4e2c26094ee530161f1c991bbac7df3bc8788ce833e42d00ff5cf"} May 20 14:14:57.476770 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.476754 2559 scope.go:117] "RemoveContainer" containerID="a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87" May 20 14:14:57.485450 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.485433 2559 scope.go:117] "RemoveContainer" containerID="a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87" May 20 14:14:57.485713 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:14:57.485693 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87\": container with ID starting with a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87 not found: ID does not exist" containerID="a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87" May 20 14:14:57.485759 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.485722 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87"} err="failed to get container status \"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87\": rpc error: code = NotFound desc = could not find container \"a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87\": container with ID starting with a5ef2f54328afb20ff479a1c6a8c45415f91d8f91266b25e03bd7c023a7c1f87 not found: ID does not exist" May 20 14:14:57.506560 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.506532 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:14:57.508600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.508581 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d44765c8-x5f79"] May 20 14:14:57.763520 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:14:57.763488 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" path="/var/lib/kubelet/pods/de28cc10-2178-4ea3-ae42-4d7d2a9d8497/volumes" May 20 14:15:06.471744 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:06.471713 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:15:24.055871 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.055833 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:15:24.056270 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.056102 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" podUID="3b3daf77-5672-4521-a20a-a0ca578e5578" containerName="manager" containerID="cri-o://dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49" gracePeriod=10 May 20 14:15:24.308739 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.308681 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:15:24.394902 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.394877 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume\") pod \"3b3daf77-5672-4521-a20a-a0ca578e5578\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " May 20 14:15:24.395027 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.394917 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8g7w\" (UniqueName: \"kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w\") pod \"3b3daf77-5672-4521-a20a-a0ca578e5578\" (UID: \"3b3daf77-5672-4521-a20a-a0ca578e5578\") " May 20 14:15:24.395236 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.395216 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b3daf77-5672-4521-a20a-a0ca578e5578" (UID: "3b3daf77-5672-4521-a20a-a0ca578e5578"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:15:24.396980 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.396958 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w" (OuterVolumeSpecName: "kube-api-access-j8g7w") pod "3b3daf77-5672-4521-a20a-a0ca578e5578" (UID: "3b3daf77-5672-4521-a20a-a0ca578e5578"). InnerVolumeSpecName "kube-api-access-j8g7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:15:24.496453 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.496421 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b3daf77-5672-4521-a20a-a0ca578e5578-extensions-socket-volume\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:15:24.496453 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.496449 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8g7w\" (UniqueName: \"kubernetes.io/projected/3b3daf77-5672-4521-a20a-a0ca578e5578-kube-api-access-j8g7w\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:15:24.576348 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.576260 2559 generic.go:358] "Generic (PLEG): container finished" podID="3b3daf77-5672-4521-a20a-a0ca578e5578" containerID="dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49" exitCode=0 May 20 14:15:24.576348 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.576337 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" event={"ID":"3b3daf77-5672-4521-a20a-a0ca578e5578","Type":"ContainerDied","Data":"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49"} May 20 14:15:24.576488 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.576375 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" event={"ID":"3b3daf77-5672-4521-a20a-a0ca578e5578","Type":"ContainerDied","Data":"6a0821d3488add4c0eabe7724f6b4c03f3f8f7824be1c036597e1d556036ac4f"} May 20 14:15:24.576488 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.576392 2559 scope.go:117] "RemoveContainer" containerID="dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49" May 20 14:15:24.576488 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.576347 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f" May 20 14:15:24.585125 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.585112 2559 scope.go:117] "RemoveContainer" containerID="dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49" May 20 14:15:24.585415 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:15:24.585399 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49\": container with ID starting with dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49 not found: ID does not exist" containerID="dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49" May 20 14:15:24.585459 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.585424 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49"} err="failed to get container status \"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49\": rpc error: code = NotFound desc = could not find container \"dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49\": container with ID starting with dce41c5760ce0746249fcee25a044d1d98d06e93f77a3b371a049a7d3e9c7f49 not found: ID does not exist" May 20 14:15:24.606857 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.606835 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:15:24.610780 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:24.610754 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xjm6f"] May 20 14:15:25.762938 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:25.762908 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b3daf77-5672-4521-a20a-a0ca578e5578" path="/var/lib/kubelet/pods/3b3daf77-5672-4521-a20a-a0ca578e5578/volumes" May 20 14:15:40.292756 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.292679 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph"] May 20 14:15:40.293290 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293254 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" containerName="console" May 20 14:15:40.293290 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293309 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" containerName="console" May 20 14:15:40.293473 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3daf77-5672-4521-a20a-a0ca578e5578" containerName="manager" May 20 14:15:40.293473 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293346 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3daf77-5672-4521-a20a-a0ca578e5578" containerName="manager" May 20 14:15:40.293576 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293490 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b3daf77-5672-4521-a20a-a0ca578e5578" containerName="manager" May 20 14:15:40.293576 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.293508 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="de28cc10-2178-4ea3-ae42-4d7d2a9d8497" containerName="console" May 20 14:15:40.296875 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.296849 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.300477 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.300247 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dn8th\"" May 20 14:15:40.309595 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.309519 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph"] May 20 14:15:40.327400 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327644 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htr5\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-kube-api-access-6htr5\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327644 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327748 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327748 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327748 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.327748 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.327743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428633 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428633 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428633 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428675 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428703 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428751 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428794 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6htr5\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-kube-api-access-6htr5\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428826 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.428877 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.428884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.429030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429249 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.429167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429446 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.429429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429558 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.429539 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.429616 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.429556 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.430904 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.430884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.431128 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.431110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.441473 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.441443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.441783 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.441763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htr5\" (UniqueName: \"kubernetes.io/projected/93d43237-b59c-4f95-a6ef-2f5d5de2f3ef-kube-api-access-6htr5\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fnhph\" (UID: \"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.612585 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.612496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:40.772875 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:40.772663 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph"] May 20 14:15:40.775313 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:15:40.775264 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d43237_b59c_4f95_a6ef_2f5d5de2f3ef.slice/crio-aaae8cdb0aa6fd1066272775816b9975ce494d406e25653d9ae9818518df3432 WatchSource:0}: Error finding container aaae8cdb0aa6fd1066272775816b9975ce494d406e25653d9ae9818518df3432: Status 404 returned error can't find the container with id aaae8cdb0aa6fd1066272775816b9975ce494d406e25653d9ae9818518df3432 May 20 14:15:41.639314 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:41.639256 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" event={"ID":"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef","Type":"ContainerStarted","Data":"aaae8cdb0aa6fd1066272775816b9975ce494d406e25653d9ae9818518df3432"} May 20 14:15:43.348331 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:43.348273 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 20 14:15:43.348581 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:43.348372 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 20 14:15:43.348581 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:43.348402 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 20 14:15:43.650469 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:43.650377 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" event={"ID":"93d43237-b59c-4f95-a6ef-2f5d5de2f3ef","Type":"ContainerStarted","Data":"201e97321a5a7894fe47c1147397137be2a7010ef33fe92668af2bcb0d5aa441"} May 20 14:15:43.682967 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:43.682924 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" podStartSLOduration=1.112245256 podStartE2EDuration="3.682911195s" podCreationTimestamp="2026-05-20 14:15:40 +0000 UTC" firstStartedPulling="2026-05-20 14:15:40.777306466 +0000 UTC m=+529.674549369" lastFinishedPulling="2026-05-20 14:15:43.347972404 +0000 UTC m=+532.245215308" observedRunningTime="2026-05-20 14:15:43.681481878 +0000 UTC m=+532.578724789" watchObservedRunningTime="2026-05-20 14:15:43.682911195 +0000 UTC m=+532.580154103" May 20 14:15:44.613374 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.613336 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:44.618187 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.618157 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:44.654745 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.654722 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:44.655457 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.655438 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fnhph" May 20 14:15:44.829861 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.829828 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:15:44.833367 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.833352 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:44.836267 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.836241 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 20 14:15:44.836413 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.836303 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g4gh\"" May 20 14:15:44.845487 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.845464 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:15:44.923737 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.923702 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:15:44.975769 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.975678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:44.975769 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:44.975740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545jh\" (UniqueName: \"kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.076677 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.076639 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-545jh\" (UniqueName: \"kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.076858 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.076755 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.077384 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.077361 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.085723 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.085699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-545jh\" (UniqueName: \"kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh\") pod \"limitador-limitador-7d549b5b-sgh6d\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.143782 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.143760 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:45.272652 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.272629 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:15:45.274581 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:15:45.274554 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff2e76b_c632_4bbb_a4c9_307513b928ad.slice/crio-903e8c6fa2cb8c4b1b888e03b2eeba1603a8f01aeac57e4bb3f59d98aa21eaaf WatchSource:0}: Error finding container 903e8c6fa2cb8c4b1b888e03b2eeba1603a8f01aeac57e4bb3f59d98aa21eaaf: Status 404 returned error can't find the container with id 903e8c6fa2cb8c4b1b888e03b2eeba1603a8f01aeac57e4bb3f59d98aa21eaaf May 20 14:15:45.659265 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:45.659230 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" event={"ID":"4ff2e76b-c632-4bbb-a4c9-307513b928ad","Type":"ContainerStarted","Data":"903e8c6fa2cb8c4b1b888e03b2eeba1603a8f01aeac57e4bb3f59d98aa21eaaf"} May 20 14:15:48.672483 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:48.672446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" event={"ID":"4ff2e76b-c632-4bbb-a4c9-307513b928ad","Type":"ContainerStarted","Data":"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42"} May 20 14:15:48.672833 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:48.672530 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:15:48.694196 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:48.694136 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" podStartSLOduration=2.095204164 podStartE2EDuration="4.694122766s" podCreationTimestamp="2026-05-20 14:15:44 +0000 UTC" firstStartedPulling="2026-05-20 14:15:45.276366798 +0000 UTC m=+534.173609686" lastFinishedPulling="2026-05-20 14:15:47.875285391 +0000 UTC m=+536.772528288" observedRunningTime="2026-05-20 14:15:48.69228989 +0000 UTC m=+537.589532812" watchObservedRunningTime="2026-05-20 14:15:48.694122766 +0000 UTC m=+537.591365675" May 20 14:15:59.677523 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:15:59.677490 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:16:01.420318 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:01.420265 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:16:01.420707 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:01.420478 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" podUID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" containerName="limitador" containerID="cri-o://5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42" gracePeriod=30 May 20 14:16:01.977173 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:01.977142 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:16:02.120714 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.120620 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file\") pod \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " May 20 14:16:02.120714 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.120667 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-545jh\" (UniqueName: \"kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh\") pod \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\" (UID: \"4ff2e76b-c632-4bbb-a4c9-307513b928ad\") " May 20 14:16:02.121008 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.120979 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file" (OuterVolumeSpecName: "config-file") pod "4ff2e76b-c632-4bbb-a4c9-307513b928ad" (UID: "4ff2e76b-c632-4bbb-a4c9-307513b928ad"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:16:02.122930 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.122899 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh" (OuterVolumeSpecName: "kube-api-access-545jh") pod "4ff2e76b-c632-4bbb-a4c9-307513b928ad" (UID: "4ff2e76b-c632-4bbb-a4c9-307513b928ad"). InnerVolumeSpecName "kube-api-access-545jh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:16:02.221352 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.221318 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ff2e76b-c632-4bbb-a4c9-307513b928ad-config-file\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:16:02.221352 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.221350 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-545jh\" (UniqueName: \"kubernetes.io/projected/4ff2e76b-c632-4bbb-a4c9-307513b928ad-kube-api-access-545jh\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:16:02.724262 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.724224 2559 generic.go:358] "Generic (PLEG): container finished" podID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" containerID="5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42" exitCode=0 May 20 14:16:02.724732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.724288 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" May 20 14:16:02.724732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.724326 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" event={"ID":"4ff2e76b-c632-4bbb-a4c9-307513b928ad","Type":"ContainerDied","Data":"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42"} May 20 14:16:02.724732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.724367 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgh6d" event={"ID":"4ff2e76b-c632-4bbb-a4c9-307513b928ad","Type":"ContainerDied","Data":"903e8c6fa2cb8c4b1b888e03b2eeba1603a8f01aeac57e4bb3f59d98aa21eaaf"} May 20 14:16:02.724732 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.724385 2559 scope.go:117] "RemoveContainer" containerID="5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42" May 20 14:16:02.732952 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.732931 2559 scope.go:117] "RemoveContainer" containerID="5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42" May 20 14:16:02.733206 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:16:02.733187 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42\": container with ID starting with 5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42 not found: ID does not exist" containerID="5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42" May 20 14:16:02.733257 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.733215 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42"} err="failed to get container status \"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42\": rpc error: code = NotFound desc = could not find container \"5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42\": container with ID starting with 5e3db3e6e9611f7cd39a36f8f9ceca8e6fa61655ba102b550cb08676d88fdf42 not found: ID does not exist" May 20 14:16:02.747470 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.747445 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:16:02.752291 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:02.752270 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgh6d"] May 20 14:16:03.762290 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:03.762255 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" path="/var/lib/kubelet/pods/4ff2e76b-c632-4bbb-a4c9-307513b928ad/volumes" May 20 14:16:06.107580 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.107547 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5fdjv"] May 20 14:16:06.108048 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.107921 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" containerName="limitador" May 20 14:16:06.108048 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.107933 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" containerName="limitador" May 20 14:16:06.108048 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.108024 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ff2e76b-c632-4bbb-a4c9-307513b928ad" containerName="limitador" May 20 14:16:06.111937 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.111917 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.116064 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.116046 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 20 14:16:06.116172 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.116152 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7d2p\"" May 20 14:16:06.127320 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.127278 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5fdjv"] May 20 14:16:06.256959 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.256925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-data\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.257135 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.256974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2fjm\" (UniqueName: \"kubernetes.io/projected/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-kube-api-access-b2fjm\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.358195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.358116 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-data\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.358195 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.358175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2fjm\" (UniqueName: \"kubernetes.io/projected/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-kube-api-access-b2fjm\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.358595 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.358571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-data\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.372288 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.372260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2fjm\" (UniqueName: \"kubernetes.io/projected/8b6d8d22-b126-4a7e-9c94-d63013c14ce6-kube-api-access-b2fjm\") pod \"postgres-68c4fbbd6f-5fdjv\" (UID: \"8b6d8d22-b126-4a7e-9c94-d63013c14ce6\") " pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.421943 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.421921 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:06.551555 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.551521 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5fdjv"] May 20 14:16:06.553819 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:16:06.553794 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6d8d22_b126_4a7e_9c94_d63013c14ce6.slice/crio-f8271ec0af213da93597f80f8ac2d8b38f43d1309aa838103dd14b4cf6de8710 WatchSource:0}: Error finding container f8271ec0af213da93597f80f8ac2d8b38f43d1309aa838103dd14b4cf6de8710: Status 404 returned error can't find the container with id f8271ec0af213da93597f80f8ac2d8b38f43d1309aa838103dd14b4cf6de8710 May 20 14:16:06.740415 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:06.740378 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" event={"ID":"8b6d8d22-b126-4a7e-9c94-d63013c14ce6","Type":"ContainerStarted","Data":"f8271ec0af213da93597f80f8ac2d8b38f43d1309aa838103dd14b4cf6de8710"} May 20 14:16:11.762637 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:11.762603 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" event={"ID":"8b6d8d22-b126-4a7e-9c94-d63013c14ce6","Type":"ContainerStarted","Data":"37db7ceb66e5887d9000cfdb74c66ef08b95bf96bf6f17adb5dc2172287bad02"} May 20 14:16:11.762962 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:11.762659 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:11.816475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:11.816427 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" podStartSLOduration=0.693290308 podStartE2EDuration="5.816414385s" podCreationTimestamp="2026-05-20 14:16:06 +0000 UTC" firstStartedPulling="2026-05-20 14:16:06.555123847 +0000 UTC m=+555.452366735" lastFinishedPulling="2026-05-20 14:16:11.678247908 +0000 UTC m=+560.575490812" observedRunningTime="2026-05-20 14:16:11.815143528 +0000 UTC m=+560.712386438" watchObservedRunningTime="2026-05-20 14:16:11.816414385 +0000 UTC m=+560.713657294" May 20 14:16:17.792499 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:17.792465 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-5fdjv" May 20 14:16:23.730614 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.730577 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:23.737921 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.737897 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:23.741356 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.741333 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 14:16:23.741980 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.741964 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vpvqv\"" May 20 14:16:23.752832 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.752806 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:23.809239 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.809209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tjc9\" (UniqueName: \"kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9\") pod \"maas-controller-68fb5d86bc-mdd5d\" (UID: \"b061e942-374a-40bf-8150-936c883586bf\") " pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:23.903804 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.903768 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55844b54bf-k4mgx"] May 20 14:16:23.906368 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.906352 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:23.909799 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.909781 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tjc9\" (UniqueName: \"kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9\") pod \"maas-controller-68fb5d86bc-mdd5d\" (UID: \"b061e942-374a-40bf-8150-936c883586bf\") " pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:23.916879 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.916858 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55844b54bf-k4mgx"] May 20 14:16:23.920978 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:23.920957 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tjc9\" (UniqueName: \"kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9\") pod \"maas-controller-68fb5d86bc-mdd5d\" (UID: \"b061e942-374a-40bf-8150-936c883586bf\") " pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:24.010775 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.010698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwsk\" (UniqueName: \"kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk\") pod \"maas-controller-55844b54bf-k4mgx\" (UID: \"b930f6ae-554b-40b8-9778-e95f8d69b8a5\") " pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:24.030640 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.030609 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55844b54bf-k4mgx"] May 20 14:16:24.030871 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:16:24.030850 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-phwsk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-55844b54bf-k4mgx" podUID="b930f6ae-554b-40b8-9778-e95f8d69b8a5" May 20 14:16:24.047720 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.047695 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:24.111553 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.111497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phwsk\" (UniqueName: \"kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk\") pod \"maas-controller-55844b54bf-k4mgx\" (UID: \"b930f6ae-554b-40b8-9778-e95f8d69b8a5\") " pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:24.121833 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.121798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwsk\" (UniqueName: \"kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk\") pod \"maas-controller-55844b54bf-k4mgx\" (UID: \"b930f6ae-554b-40b8-9778-e95f8d69b8a5\") " pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:24.183633 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.183609 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:24.185568 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:16:24.185540 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb061e942_374a_40bf_8150_936c883586bf.slice/crio-9fade8248e583c6a4e5de036af3961464de68a9d9df84dcce3a96544755b40ec WatchSource:0}: Error finding container 9fade8248e583c6a4e5de036af3961464de68a9d9df84dcce3a96544755b40ec: Status 404 returned error can't find the container with id 9fade8248e583c6a4e5de036af3961464de68a9d9df84dcce3a96544755b40ec May 20 14:16:24.806927 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.806886 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" event={"ID":"b061e942-374a-40bf-8150-936c883586bf","Type":"ContainerStarted","Data":"9fade8248e583c6a4e5de036af3961464de68a9d9df84dcce3a96544755b40ec"} May 20 14:16:24.806927 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.806899 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:24.813617 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.813597 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:24.919643 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.919599 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phwsk\" (UniqueName: \"kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk\") pod \"b930f6ae-554b-40b8-9778-e95f8d69b8a5\" (UID: \"b930f6ae-554b-40b8-9778-e95f8d69b8a5\") " May 20 14:16:24.922224 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:24.922193 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk" (OuterVolumeSpecName: "kube-api-access-phwsk") pod "b930f6ae-554b-40b8-9778-e95f8d69b8a5" (UID: "b930f6ae-554b-40b8-9778-e95f8d69b8a5"). InnerVolumeSpecName "kube-api-access-phwsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:16:25.021016 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:25.020975 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phwsk\" (UniqueName: \"kubernetes.io/projected/b930f6ae-554b-40b8-9778-e95f8d69b8a5-kube-api-access-phwsk\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:16:25.810989 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:25.810958 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55844b54bf-k4mgx" May 20 14:16:25.854647 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:25.854608 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55844b54bf-k4mgx"] May 20 14:16:25.862081 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:25.862052 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55844b54bf-k4mgx"] May 20 14:16:26.816271 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:26.816181 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" event={"ID":"b061e942-374a-40bf-8150-936c883586bf","Type":"ContainerStarted","Data":"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda"} May 20 14:16:26.816690 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:26.816399 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:26.840239 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:26.840196 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" podStartSLOduration=1.5390411 podStartE2EDuration="3.840183547s" podCreationTimestamp="2026-05-20 14:16:23 +0000 UTC" firstStartedPulling="2026-05-20 14:16:24.186821197 +0000 UTC m=+573.084064088" lastFinishedPulling="2026-05-20 14:16:26.487963646 +0000 UTC m=+575.385206535" observedRunningTime="2026-05-20 14:16:26.837942941 +0000 UTC m=+575.735185852" watchObservedRunningTime="2026-05-20 14:16:26.840183547 +0000 UTC m=+575.737426457" May 20 14:16:27.762600 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:27.762567 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b930f6ae-554b-40b8-9778-e95f8d69b8a5" path="/var/lib/kubelet/pods/b930f6ae-554b-40b8-9778-e95f8d69b8a5/volumes" May 20 14:16:37.824922 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:37.824892 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:38.345681 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.345648 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:38.345870 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.345853 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" podUID="b061e942-374a-40bf-8150-936c883586bf" containerName="manager" containerID="cri-o://98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda" gracePeriod=30 May 20 14:16:38.550424 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.550350 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:16:38.554494 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.554472 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:38.563392 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.563371 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:16:38.601511 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.601464 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:38.639062 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.639033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcrg\" (UniqueName: \"kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg\") pod \"maas-controller-b998db48d-8v6gm\" (UID: \"26776f53-a9eb-4292-b1c9-cc7f312ddc43\") " pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:38.739381 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.739357 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tjc9\" (UniqueName: \"kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9\") pod \"b061e942-374a-40bf-8150-936c883586bf\" (UID: \"b061e942-374a-40bf-8150-936c883586bf\") " May 20 14:16:38.739566 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.739550 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcrg\" (UniqueName: \"kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg\") pod \"maas-controller-b998db48d-8v6gm\" (UID: \"26776f53-a9eb-4292-b1c9-cc7f312ddc43\") " pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:38.741492 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.741468 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9" (OuterVolumeSpecName: "kube-api-access-6tjc9") pod "b061e942-374a-40bf-8150-936c883586bf" (UID: "b061e942-374a-40bf-8150-936c883586bf"). InnerVolumeSpecName "kube-api-access-6tjc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:16:38.749074 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.749054 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcrg\" (UniqueName: \"kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg\") pod \"maas-controller-b998db48d-8v6gm\" (UID: \"26776f53-a9eb-4292-b1c9-cc7f312ddc43\") " pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:38.840448 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.840420 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tjc9\" (UniqueName: \"kubernetes.io/projected/b061e942-374a-40bf-8150-936c883586bf-kube-api-access-6tjc9\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:16:38.858577 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.858512 2559 generic.go:358] "Generic (PLEG): container finished" podID="b061e942-374a-40bf-8150-936c883586bf" containerID="98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda" exitCode=0 May 20 14:16:38.858682 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.858578 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" event={"ID":"b061e942-374a-40bf-8150-936c883586bf","Type":"ContainerDied","Data":"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda"} May 20 14:16:38.858682 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.858601 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" event={"ID":"b061e942-374a-40bf-8150-936c883586bf","Type":"ContainerDied","Data":"9fade8248e583c6a4e5de036af3961464de68a9d9df84dcce3a96544755b40ec"} May 20 14:16:38.858682 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.858615 2559 scope.go:117] "RemoveContainer" containerID="98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda" May 20 14:16:38.858682 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.858580 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mdd5d" May 20 14:16:38.866662 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.866630 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:38.867034 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.867012 2559 scope.go:117] "RemoveContainer" containerID="98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda" May 20 14:16:38.867355 ip-10-0-137-228 kubenswrapper[2559]: E0520 14:16:38.867333 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda\": container with ID starting with 98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda not found: ID does not exist" containerID="98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda" May 20 14:16:38.867426 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.867363 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda"} err="failed to get container status \"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda\": rpc error: code = NotFound desc = could not find container \"98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda\": container with ID starting with 98be39e42746f5985ce2dcf1eaf74dd023cf04c662b624d7d354a00edd8f7fda not found: ID does not exist" May 20 14:16:38.882734 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.882712 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:38.887279 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.887261 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mdd5d"] May 20 14:16:38.999905 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:38.999877 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:16:39.001912 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:16:39.001888 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26776f53_a9eb_4292_b1c9_cc7f312ddc43.slice/crio-b74839a904d74f829ff86fee898de637f7c92d1445cef8eda05ecd642dc22da2 WatchSource:0}: Error finding container b74839a904d74f829ff86fee898de637f7c92d1445cef8eda05ecd642dc22da2: Status 404 returned error can't find the container with id b74839a904d74f829ff86fee898de637f7c92d1445cef8eda05ecd642dc22da2 May 20 14:16:39.763812 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:39.763776 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b061e942-374a-40bf-8150-936c883586bf" path="/var/lib/kubelet/pods/b061e942-374a-40bf-8150-936c883586bf/volumes" May 20 14:16:39.864841 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:39.864805 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b998db48d-8v6gm" event={"ID":"26776f53-a9eb-4292-b1c9-cc7f312ddc43","Type":"ContainerStarted","Data":"b74839a904d74f829ff86fee898de637f7c92d1445cef8eda05ecd642dc22da2"} May 20 14:16:40.870054 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:40.870020 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b998db48d-8v6gm" event={"ID":"26776f53-a9eb-4292-b1c9-cc7f312ddc43","Type":"ContainerStarted","Data":"f218595240052a91fb93e2e8b2b4cf8a15e8d9c0534066460fa2d2499d3454ff"} May 20 14:16:40.870457 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:40.870162 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:40.896378 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:40.896335 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-b998db48d-8v6gm" podStartSLOduration=1.163957479 podStartE2EDuration="2.896320555s" podCreationTimestamp="2026-05-20 14:16:38 +0000 UTC" firstStartedPulling="2026-05-20 14:16:39.003085423 +0000 UTC m=+587.900328312" lastFinishedPulling="2026-05-20 14:16:40.735448496 +0000 UTC m=+589.632691388" observedRunningTime="2026-05-20 14:16:40.894239411 +0000 UTC m=+589.791482322" watchObservedRunningTime="2026-05-20 14:16:40.896320555 +0000 UTC m=+589.793563462" May 20 14:16:51.666893 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:51.666866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:16:51.667451 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:51.667094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:16:51.878742 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:51.878713 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:16:59.913812 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.913775 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-846c65d5c-8mp56"] May 20 14:16:59.914171 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.914152 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b061e942-374a-40bf-8150-936c883586bf" containerName="manager" May 20 14:16:59.914171 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.914163 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b061e942-374a-40bf-8150-936c883586bf" containerName="manager" May 20 14:16:59.914240 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.914223 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b061e942-374a-40bf-8150-936c883586bf" containerName="manager" May 20 14:16:59.919105 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.919089 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:16:59.923114 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.923091 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 20 14:16:59.923114 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.923097 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sdr7g\"" May 20 14:16:59.943092 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:16:59.943059 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-846c65d5c-8mp56"] May 20 14:17:00.028857 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.028825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l6zt\" (UniqueName: \"kubernetes.io/projected/0da35821-49d8-45e7-b223-d01965cd2d51-kube-api-access-2l6zt\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.029026 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.028884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da35821-49d8-45e7-b223-d01965cd2d51-maas-api-tls\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.130042 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.130001 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l6zt\" (UniqueName: \"kubernetes.io/projected/0da35821-49d8-45e7-b223-d01965cd2d51-kube-api-access-2l6zt\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.130223 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.130119 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da35821-49d8-45e7-b223-d01965cd2d51-maas-api-tls\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.133263 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.133241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0da35821-49d8-45e7-b223-d01965cd2d51-maas-api-tls\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.143181 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.143151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l6zt\" (UniqueName: \"kubernetes.io/projected/0da35821-49d8-45e7-b223-d01965cd2d51-kube-api-access-2l6zt\") pod \"maas-api-846c65d5c-8mp56\" (UID: \"0da35821-49d8-45e7-b223-d01965cd2d51\") " pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.229243 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.229160 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:00.354429 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.354399 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4sddn"] May 20 14:17:00.357727 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.357708 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:00.361194 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.361173 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 20 14:17:00.385549 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.385505 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-846c65d5c-8mp56"] May 20 14:17:00.386919 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:17:00.386893 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da35821_49d8_45e7_b223_d01965cd2d51.slice/crio-0bfa649e65f3b7be7e07667260ce6285791d5fbffc8b6a8695b432fd2ce3c47c WatchSource:0}: Error finding container 0bfa649e65f3b7be7e07667260ce6285791d5fbffc8b6a8695b432fd2ce3c47c: Status 404 returned error can't find the container with id 0bfa649e65f3b7be7e07667260ce6285791d5fbffc8b6a8695b432fd2ce3c47c May 20 14:17:00.388423 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.388404 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4sddn"] May 20 14:17:00.534459 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.534378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqhv\" (UniqueName: \"kubernetes.io/projected/8c094cbf-27c2-4871-a609-046a6491fd71-kube-api-access-zfqhv\") pod \"payload-processing-58b6c8fdc7-4sddn\" (UID: \"8c094cbf-27c2-4871-a609-046a6491fd71\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:00.635426 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.635382 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqhv\" (UniqueName: \"kubernetes.io/projected/8c094cbf-27c2-4871-a609-046a6491fd71-kube-api-access-zfqhv\") pod \"payload-processing-58b6c8fdc7-4sddn\" (UID: \"8c094cbf-27c2-4871-a609-046a6491fd71\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:00.651072 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.651041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqhv\" (UniqueName: \"kubernetes.io/projected/8c094cbf-27c2-4871-a609-046a6491fd71-kube-api-access-zfqhv\") pod \"payload-processing-58b6c8fdc7-4sddn\" (UID: \"8c094cbf-27c2-4871-a609-046a6491fd71\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:00.668812 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.668788 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:00.817496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.817471 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-4sddn"] May 20 14:17:00.818129 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:17:00.818107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c094cbf_27c2_4871_a609_046a6491fd71.slice/crio-14d3ef0b3e0392d9f356a107446c328675935209be31cebb0f713120ed09754e WatchSource:0}: Error finding container 14d3ef0b3e0392d9f356a107446c328675935209be31cebb0f713120ed09754e: Status 404 returned error can't find the container with id 14d3ef0b3e0392d9f356a107446c328675935209be31cebb0f713120ed09754e May 20 14:17:00.947046 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.947007 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-846c65d5c-8mp56" event={"ID":"0da35821-49d8-45e7-b223-d01965cd2d51","Type":"ContainerStarted","Data":"0bfa649e65f3b7be7e07667260ce6285791d5fbffc8b6a8695b432fd2ce3c47c"} May 20 14:17:00.947986 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:00.947965 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" event={"ID":"8c094cbf-27c2-4871-a609-046a6491fd71","Type":"ContainerStarted","Data":"14d3ef0b3e0392d9f356a107446c328675935209be31cebb0f713120ed09754e"} May 20 14:17:02.987111 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:02.987011 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-846c65d5c-8mp56" event={"ID":"0da35821-49d8-45e7-b223-d01965cd2d51","Type":"ContainerStarted","Data":"03caa749b4319ecbd2c7be6339f3a81b26589e7e61c32dab597aaf6ef64efae2"} May 20 14:17:02.987938 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:02.987913 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:02.988753 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:02.988717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" event={"ID":"8c094cbf-27c2-4871-a609-046a6491fd71","Type":"ContainerStarted","Data":"fb9a998fd02533a6fc5001d06de6eae4430236989ef353c9e84fb2292ced50fc"} May 20 14:17:02.989058 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:02.989039 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:03.062788 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:03.062716 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-846c65d5c-8mp56" podStartSLOduration=1.732098162 podStartE2EDuration="4.062697458s" podCreationTimestamp="2026-05-20 14:16:59 +0000 UTC" firstStartedPulling="2026-05-20 14:17:00.388878297 +0000 UTC m=+609.286121189" lastFinishedPulling="2026-05-20 14:17:02.719477584 +0000 UTC m=+611.616720485" observedRunningTime="2026-05-20 14:17:03.03039991 +0000 UTC m=+611.927642831" watchObservedRunningTime="2026-05-20 14:17:03.062697458 +0000 UTC m=+611.959940365" May 20 14:17:03.063743 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:03.063698 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" podStartSLOduration=1.1612981470000001 podStartE2EDuration="3.063671001s" podCreationTimestamp="2026-05-20 14:17:00 +0000 UTC" firstStartedPulling="2026-05-20 14:17:00.819855301 +0000 UTC m=+609.717098193" lastFinishedPulling="2026-05-20 14:17:02.722228155 +0000 UTC m=+611.619471047" observedRunningTime="2026-05-20 14:17:03.060450609 +0000 UTC m=+611.957693515" watchObservedRunningTime="2026-05-20 14:17:03.063671001 +0000 UTC m=+611.960913914" May 20 14:17:10.001443 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:10.001415 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-846c65d5c-8mp56" May 20 14:17:13.995125 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:13.995090 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-4sddn" May 20 14:17:52.924496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.924458 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf"] May 20 14:17:52.927779 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.927754 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:52.930578 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.930552 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 14:17:52.930670 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.930623 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 20 14:17:52.930841 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.930828 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-77www\"" May 20 14:17:52.931777 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.931760 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 14:17:52.939251 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:52.939230 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf"] May 20 14:17:53.106519 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773d64e9-2e92-4596-b01a-9539c2aa283b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.106686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.106686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8mz\" (UniqueName: \"kubernetes.io/projected/773d64e9-2e92-4596-b01a-9539c2aa283b-kube-api-access-2l8mz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.106686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.106686 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.106819 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.106722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208100 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208132 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8mz\" (UniqueName: \"kubernetes.io/projected/773d64e9-2e92-4596-b01a-9539c2aa283b-kube-api-access-2l8mz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208180 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208183 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208218 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208496 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208245 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773d64e9-2e92-4596-b01a-9539c2aa283b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208666 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208666 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.208788 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.208698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.210335 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.210318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773d64e9-2e92-4596-b01a-9539c2aa283b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.210703 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.210686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773d64e9-2e92-4596-b01a-9539c2aa283b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.216556 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.216534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8mz\" (UniqueName: \"kubernetes.io/projected/773d64e9-2e92-4596-b01a-9539c2aa283b-kube-api-access-2l8mz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4s4mf\" (UID: \"773d64e9-2e92-4596-b01a-9539c2aa283b\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.239703 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.239679 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:17:53.391051 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.390259 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf"] May 20 14:17:53.396058 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:53.396036 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:17:54.186837 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:54.186786 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" event={"ID":"773d64e9-2e92-4596-b01a-9539c2aa283b","Type":"ContainerStarted","Data":"653c1a061e9016cae00293efad8874471cc2ac66cb7a0b70b09bb7a5d373e835"} May 20 14:17:59.211962 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:17:59.211879 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" event={"ID":"773d64e9-2e92-4596-b01a-9539c2aa283b","Type":"ContainerStarted","Data":"e299a7646c68a86c2827ab2c203865667b4df181e9d05fbbdf860f0c60381acd"} May 20 14:18:04.493513 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.493474 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h"] May 20 14:18:04.496134 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.496114 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.498895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.498876 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 20 14:18:04.508172 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.508149 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h"] May 20 14:18:04.512537 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.512631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.512631 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.512705 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.512739 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.512802 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.512776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtlxs\" (UniqueName: \"kubernetes.io/projected/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kube-api-access-qtlxs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613220 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613190 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613236 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlxs\" (UniqueName: \"kubernetes.io/projected/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kube-api-access-qtlxs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613425 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613773 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613890 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.613890 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.613791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.615597 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.615579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.615867 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.615848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.621953 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.621932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtlxs\" (UniqueName: \"kubernetes.io/projected/0a318ffd-93cf-424e-8bd0-7b7fe66be43b-kube-api-access-qtlxs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h\" (UID: \"0a318ffd-93cf-424e-8bd0-7b7fe66be43b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.806400 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.806372 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:04.949787 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:18:04.949738 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a318ffd_93cf_424e_8bd0_7b7fe66be43b.slice/crio-65232ceb849d2d1c14d2ce42ade805e79c9c603bc7528f498a44ae144ac6d3ce WatchSource:0}: Error finding container 65232ceb849d2d1c14d2ce42ade805e79c9c603bc7528f498a44ae144ac6d3ce: Status 404 returned error can't find the container with id 65232ceb849d2d1c14d2ce42ade805e79c9c603bc7528f498a44ae144ac6d3ce May 20 14:18:04.954675 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:04.954583 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h"] May 20 14:18:05.234710 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:05.234677 2559 generic.go:358] "Generic (PLEG): container finished" podID="773d64e9-2e92-4596-b01a-9539c2aa283b" containerID="e299a7646c68a86c2827ab2c203865667b4df181e9d05fbbdf860f0c60381acd" exitCode=0 May 20 14:18:05.234913 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:05.234764 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" event={"ID":"773d64e9-2e92-4596-b01a-9539c2aa283b","Type":"ContainerDied","Data":"e299a7646c68a86c2827ab2c203865667b4df181e9d05fbbdf860f0c60381acd"} May 20 14:18:05.236289 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:05.236266 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" event={"ID":"0a318ffd-93cf-424e-8bd0-7b7fe66be43b","Type":"ContainerStarted","Data":"ef1ad700195e9b06896f278e39190809be5720210a26178dac44c8da3133fc51"} May 20 14:18:05.236484 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:05.236457 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" event={"ID":"0a318ffd-93cf-424e-8bd0-7b7fe66be43b","Type":"ContainerStarted","Data":"65232ceb849d2d1c14d2ce42ade805e79c9c603bc7528f498a44ae144ac6d3ce"} May 20 14:18:07.246435 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:07.246397 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" event={"ID":"773d64e9-2e92-4596-b01a-9539c2aa283b","Type":"ContainerStarted","Data":"f1c6ecca103ea5f5522286a708fa37d9beccb6ba48256cd9e8162dbb5477681a"} May 20 14:18:07.246808 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:07.246618 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:18:07.270890 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:07.270833 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" podStartSLOduration=2.0571369 podStartE2EDuration="15.270815842s" podCreationTimestamp="2026-05-20 14:17:52 +0000 UTC" firstStartedPulling="2026-05-20 14:17:53.396206666 +0000 UTC m=+662.293449571" lastFinishedPulling="2026-05-20 14:18:06.60988561 +0000 UTC m=+675.507128513" observedRunningTime="2026-05-20 14:18:07.269544592 +0000 UTC m=+676.166787501" watchObservedRunningTime="2026-05-20 14:18:07.270815842 +0000 UTC m=+676.168058752" May 20 14:18:15.296274 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:15.296240 2559 generic.go:358] "Generic (PLEG): container finished" podID="0a318ffd-93cf-424e-8bd0-7b7fe66be43b" containerID="ef1ad700195e9b06896f278e39190809be5720210a26178dac44c8da3133fc51" exitCode=0 May 20 14:18:15.296706 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:15.296284 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" event={"ID":"0a318ffd-93cf-424e-8bd0-7b7fe66be43b","Type":"ContainerDied","Data":"ef1ad700195e9b06896f278e39190809be5720210a26178dac44c8da3133fc51"} May 20 14:18:16.301753 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:16.301717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" event={"ID":"0a318ffd-93cf-424e-8bd0-7b7fe66be43b","Type":"ContainerStarted","Data":"c8d4dcfe91d67b86b870b502153b8069441ca75d474b4b4de68297b3d5b2bc56"} May 20 14:18:16.302146 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:16.301910 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:18:16.324790 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:16.324736 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" podStartSLOduration=11.956087636 podStartE2EDuration="12.324720369s" podCreationTimestamp="2026-05-20 14:18:04 +0000 UTC" firstStartedPulling="2026-05-20 14:18:15.296959886 +0000 UTC m=+684.194202773" lastFinishedPulling="2026-05-20 14:18:15.665592619 +0000 UTC m=+684.562835506" observedRunningTime="2026-05-20 14:18:16.324181202 +0000 UTC m=+685.221424106" watchObservedRunningTime="2026-05-20 14:18:16.324720369 +0000 UTC m=+685.221963280" May 20 14:18:18.270060 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:18.270021 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4s4mf" May 20 14:18:27.319788 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:18:27.319759 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h" May 20 14:21:51.707350 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:21:51.707188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:21:51.709689 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:21:51.709436 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:24:01.441594 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.441556 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:24:01.442121 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.441830 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-b998db48d-8v6gm" podUID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" containerName="manager" containerID="cri-o://f218595240052a91fb93e2e8b2b4cf8a15e8d9c0534066460fa2d2499d3454ff" gracePeriod=30 May 20 14:24:01.623702 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.623671 2559 generic.go:358] "Generic (PLEG): container finished" podID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" containerID="f218595240052a91fb93e2e8b2b4cf8a15e8d9c0534066460fa2d2499d3454ff" exitCode=0 May 20 14:24:01.623883 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.623755 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b998db48d-8v6gm" event={"ID":"26776f53-a9eb-4292-b1c9-cc7f312ddc43","Type":"ContainerDied","Data":"f218595240052a91fb93e2e8b2b4cf8a15e8d9c0534066460fa2d2499d3454ff"} May 20 14:24:01.690814 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.690791 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:24:01.835360 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.835221 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwcrg\" (UniqueName: \"kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg\") pod \"26776f53-a9eb-4292-b1c9-cc7f312ddc43\" (UID: \"26776f53-a9eb-4292-b1c9-cc7f312ddc43\") " May 20 14:24:01.837376 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.837342 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg" (OuterVolumeSpecName: "kube-api-access-pwcrg") pod "26776f53-a9eb-4292-b1c9-cc7f312ddc43" (UID: "26776f53-a9eb-4292-b1c9-cc7f312ddc43"). InnerVolumeSpecName "kube-api-access-pwcrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:24:01.936307 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:01.936269 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwcrg\" (UniqueName: \"kubernetes.io/projected/26776f53-a9eb-4292-b1c9-cc7f312ddc43-kube-api-access-pwcrg\") on node \"ip-10-0-137-228.ec2.internal\" DevicePath \"\"" May 20 14:24:02.628333 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:02.628281 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b998db48d-8v6gm" event={"ID":"26776f53-a9eb-4292-b1c9-cc7f312ddc43","Type":"ContainerDied","Data":"b74839a904d74f829ff86fee898de637f7c92d1445cef8eda05ecd642dc22da2"} May 20 14:24:02.628333 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:02.628331 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b998db48d-8v6gm" May 20 14:24:02.628832 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:02.628343 2559 scope.go:117] "RemoveContainer" containerID="f218595240052a91fb93e2e8b2b4cf8a15e8d9c0534066460fa2d2499d3454ff" May 20 14:24:02.653493 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:02.653466 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:24:02.659759 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:02.659736 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b998db48d-8v6gm"] May 20 14:24:03.762867 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:24:03.762835 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" path="/var/lib/kubelet/pods/26776f53-a9eb-4292-b1c9-cc7f312ddc43/volumes" May 20 14:26:51.737597 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:26:51.737473 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:26:51.744417 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:26:51.744396 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:31:51.770700 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:31:51.770590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:31:51.780636 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:31:51.780615 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:36:51.800222 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:36:51.800106 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:36:51.812943 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:36:51.812920 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:41:51.833471 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:41:51.833362 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:41:51.845443 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:41:51.845422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnh5s_9730e4c3-016c-4b7d-8289-785212527297/ovn-acl-logging/0.log" May 20 14:45:13.519066 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:13.519037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lm8c9_63d93a13-3864-4fb5-be99-ebc89b37a120/manager/0.log" May 20 14:45:13.645458 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:13.645432 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-846c65d5c-8mp56_0da35821-49d8-45e7-b223-d01965cd2d51/maas-api/0.log" May 20 14:45:14.150966 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:14.150930 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rthjd_823b9438-7878-4cb9-85e6-591652fa7688/manager/2.log" May 20 14:45:14.375487 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:14.375455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fcff7bc4-pl4nc_47e8a547-ca37-4eb0-8e18-0bae154330a1/manager/0.log" May 20 14:45:14.606117 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:14.606088 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5fdjv_8b6d8d22-b126-4a7e-9c94-d63013c14ce6/postgres/0.log" May 20 14:45:15.974763 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:15.974734 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-7992p_a687ee3f-d828-4b75-b141-443a4dfc8200/manager/0.log" May 20 14:45:17.192165 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:17.192137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cz8sv_ac37d8fe-b952-42ad-b7a2-cc4aa6059866/discovery/0.log" May 20 14:45:17.417703 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:17.417672 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-587b5db545-pqplp_8dcea327-f12a-43f1-8bcb-7ff55dee3ef3/kube-auth-proxy/0.log" May 20 14:45:17.541632 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:17.541555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fnhph_93d43237-b59c-4f95-a6ef-2f5d5de2f3ef/istio-proxy/0.log" May 20 14:45:17.659038 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:17.659005 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-4sddn_8c094cbf-27c2-4871-a609-046a6491fd71/payload-processing/0.log" May 20 14:45:17.798475 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:17.798401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77c656b884-rzkd9_f4a3e708-52e4-49c6-ace5-221329cd3263/router/0.log" May 20 14:45:18.420166 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:18.420137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-4s4mf_773d64e9-2e92-4596-b01a-9539c2aa283b/storage-initializer/0.log" May 20 14:45:18.427310 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:18.427283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-4s4mf_773d64e9-2e92-4596-b01a-9539c2aa283b/main/0.log" May 20 14:45:18.803847 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:18.803773 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h_0a318ffd-93cf-424e-8bd0-7b7fe66be43b/storage-initializer/0.log" May 20 14:45:18.829529 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:18.829504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-ffv4h_0a318ffd-93cf-424e-8bd0-7b7fe66be43b/main/0.log" May 20 14:45:26.270440 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:26.270399 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8nvd_ebcb9e0f-a0bc-4fb7-9990-05ca100df284/global-pull-secret-syncer/0.log" May 20 14:45:26.324197 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:26.324168 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-47czl_5e60838f-a479-4e62-8504-2350dea17856/konnectivity-agent/0.log" May 20 14:45:26.479932 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:26.479909 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-228.ec2.internal_d1328fad5d3e6b09617c1ce056b41386/haproxy/0.log" May 20 14:45:30.966949 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:30.966874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-7992p_a687ee3f-d828-4b75-b141-443a4dfc8200/manager/0.log" May 20 14:45:33.394430 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.394402 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8w6_4670c9cf-c482-47fc-8da7-02ac804cd251/node-exporter/0.log" May 20 14:45:33.418147 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.418122 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8w6_4670c9cf-c482-47fc-8da7-02ac804cd251/kube-rbac-proxy/0.log" May 20 14:45:33.442020 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.441996 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql8w6_4670c9cf-c482-47fc-8da7-02ac804cd251/init-textfile/0.log" May 20 14:45:33.467715 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.467693 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m5nb2_d21c7fac-f50e-49ac-988e-9e07562a9533/kube-rbac-proxy-main/0.log" May 20 14:45:33.489815 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.489793 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m5nb2_d21c7fac-f50e-49ac-988e-9e07562a9533/kube-rbac-proxy-self/0.log" May 20 14:45:33.516783 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.516764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-m5nb2_d21c7fac-f50e-49ac-988e-9e07562a9533/openshift-state-metrics/0.log" May 20 14:45:33.744458 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.744433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9gwcw_18588770-ee67-4103-940e-f2f9dc72f928/prometheus-operator/0.log" May 20 14:45:33.764811 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.764787 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9gwcw_18588770-ee67-4103-940e-f2f9dc72f928/kube-rbac-proxy/0.log" May 20 14:45:33.790391 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.790368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-h2764_da6cbe0a-a7c9-44b8-8b7c-564b74d49c1c/prometheus-operator-admission-webhook/0.log" May 20 14:45:33.825699 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.825673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b76c84558-bz66c_171a5652-5bd4-4f16-a448-dad41546cbad/telemeter-client/0.log" May 20 14:45:33.851166 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.851143 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b76c84558-bz66c_171a5652-5bd4-4f16-a448-dad41546cbad/reload/0.log" May 20 14:45:33.876114 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.876094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b76c84558-bz66c_171a5652-5bd4-4f16-a448-dad41546cbad/kube-rbac-proxy/0.log" May 20 14:45:33.906258 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.906238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/thanos-query/0.log" May 20 14:45:33.929630 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.929609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/kube-rbac-proxy-web/0.log" May 20 14:45:33.960933 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.960913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/kube-rbac-proxy/0.log" May 20 14:45:33.983775 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:33.983756 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/prom-label-proxy/0.log" May 20 14:45:34.005517 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.005456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/kube-rbac-proxy-rules/0.log" May 20 14:45:34.028206 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.028184 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d457c4b9f-7pcw9_cb5d91bb-cf5c-4371-b2ee-0316c8b4471d/kube-rbac-proxy-metrics/0.log" May 20 14:45:34.703699 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.703657 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m"] May 20 14:45:34.704125 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.704106 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" containerName="manager" May 20 14:45:34.704175 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.704129 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" containerName="manager" May 20 14:45:34.704240 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.704228 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="26776f53-a9eb-4292-b1c9-cc7f312ddc43" containerName="manager" May 20 14:45:34.707602 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.707580 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.710998 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.710981 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc2rm\"/\"kube-root-ca.crt\"" May 20 14:45:34.712176 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.712156 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc2rm\"/\"default-dockercfg-g587b\"" May 20 14:45:34.712256 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.712177 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc2rm\"/\"openshift-service-ca.crt\"" May 20 14:45:34.718490 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.718470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m"] May 20 14:45:34.850640 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.850613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-lib-modules\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.850796 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.850666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-proc\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.850796 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.850726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-sys\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.850876 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.850797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-podres\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.850876 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.850826 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl75\" (UniqueName: \"kubernetes.io/projected/2dfa421f-553d-43d4-911d-efc4121660f4-kube-api-access-mjl75\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.951930 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.951907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-lib-modules\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.951943 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-proc\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.951966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-sys\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952009 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-podres\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952027 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl75\" (UniqueName: \"kubernetes.io/projected/2dfa421f-553d-43d4-911d-efc4121660f4-kube-api-access-mjl75\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952070 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-proc\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952232 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-lib-modules\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952232 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-sys\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.952232 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.952132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2dfa421f-553d-43d4-911d-efc4121660f4-podres\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:34.961508 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:34.961449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl75\" (UniqueName: \"kubernetes.io/projected/2dfa421f-553d-43d4-911d-efc4121660f4-kube-api-access-mjl75\") pod \"perf-node-gather-daemonset-7dx7m\" (UID: \"2dfa421f-553d-43d4-911d-efc4121660f4\") " pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:35.018830 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.018807 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:35.086924 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.086902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-457qb_9a327703-9cb6-4993-b496-fc3e32e75978/networking-console-plugin/0.log" May 20 14:45:35.151178 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.151153 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m"] May 20 14:45:35.153522 ip-10-0-137-228 kubenswrapper[2559]: W0520 14:45:35.153496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2dfa421f_553d_43d4_911d_efc4121660f4.slice/crio-ce8a4c45a08631d5575cb62953c2d4122a99da8f71ad8f79e1659a3ad1f087f9 WatchSource:0}: Error finding container ce8a4c45a08631d5575cb62953c2d4122a99da8f71ad8f79e1659a3ad1f087f9: Status 404 returned error can't find the container with id ce8a4c45a08631d5575cb62953c2d4122a99da8f71ad8f79e1659a3ad1f087f9 May 20 14:45:35.155197 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.155180 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:45:35.476415 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.476388 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" event={"ID":"2dfa421f-553d-43d4-911d-efc4121660f4","Type":"ContainerStarted","Data":"ecc36acda217868c37e57457d5e25857b86ccf7a621297e836baa070eb467419"} May 20 14:45:35.476415 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.476419 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" event={"ID":"2dfa421f-553d-43d4-911d-efc4121660f4","Type":"ContainerStarted","Data":"ce8a4c45a08631d5575cb62953c2d4122a99da8f71ad8f79e1659a3ad1f087f9"} May 20 14:45:35.476572 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.476527 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:35.496822 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:35.496783 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" podStartSLOduration=1.4967693770000001 podStartE2EDuration="1.496769377s" podCreationTimestamp="2026-05-20 14:45:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:45:35.495004878 +0000 UTC m=+2324.392247800" watchObservedRunningTime="2026-05-20 14:45:35.496769377 +0000 UTC m=+2324.394012286" May 20 14:45:36.732495 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:36.732470 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-zvng2_182abc85-b0ba-4a04-bf6d-83dec4d83006/volume-data-source-validator/0.log" May 20 14:45:37.565872 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:37.565844 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxsvt_8c62a9bf-0dac-4d9c-841e-08760541e5b8/dns/0.log" May 20 14:45:37.588730 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:37.588698 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxsvt_8c62a9bf-0dac-4d9c-841e-08760541e5b8/kube-rbac-proxy/0.log" May 20 14:45:37.715739 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:37.715713 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nz2ww_c3157c08-3a64-4f76-94f3-dd568f37702c/dns-node-resolver/0.log" May 20 14:45:38.265146 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:38.265110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bf8f5cb46-gzwpv_5e2cf472-5785-47c4-9f68-8d1e24285f4b/registry/0.log" May 20 14:45:38.332779 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:38.332748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ss8jt_c981a7a1-1b2d-4b13-b765-d5e24c3e8e68/node-ca/0.log" May 20 14:45:39.295119 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:39.295088 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cz8sv_ac37d8fe-b952-42ad-b7a2-cc4aa6059866/discovery/0.log" May 20 14:45:39.346058 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:39.346031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-587b5db545-pqplp_8dcea327-f12a-43f1-8bcb-7ff55dee3ef3/kube-auth-proxy/0.log" May 20 14:45:39.401717 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:39.401685 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fnhph_93d43237-b59c-4f95-a6ef-2f5d5de2f3ef/istio-proxy/0.log" May 20 14:45:39.460504 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:39.460475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-4sddn_8c094cbf-27c2-4871-a609-046a6491fd71/payload-processing/0.log" May 20 14:45:39.493309 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:39.493279 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77c656b884-rzkd9_f4a3e708-52e4-49c6-ace5-221329cd3263/router/0.log" May 20 14:45:40.144553 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.144525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wvxg9_2b1476c0-d49e-462a-a67b-7e98f1e0faf0/serve-healthcheck-canary/0.log" May 20 14:45:40.672470 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.672438 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-bqvj7_a3b912a9-6865-46f4-bf8a-5b2151647e69/insights-operator/0.log" May 20 14:45:40.673072 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.673055 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-bqvj7_a3b912a9-6865-46f4-bf8a-5b2151647e69/insights-operator/1.log" May 20 14:45:40.777278 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.777252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gmdx_11894490-3f54-47db-9dd9-72a2b59631fc/kube-rbac-proxy/0.log" May 20 14:45:40.804629 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.804600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gmdx_11894490-3f54-47db-9dd9-72a2b59631fc/exporter/0.log" May 20 14:45:40.829655 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:40.829630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7gmdx_11894490-3f54-47db-9dd9-72a2b59631fc/extractor/0.log" May 20 14:45:41.490273 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:41.490230 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc2rm/perf-node-gather-daemonset-7dx7m" May 20 14:45:42.900974 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:42.900946 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lm8c9_63d93a13-3864-4fb5-be99-ebc89b37a120/manager/0.log" May 20 14:45:42.943736 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:42.943711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-846c65d5c-8mp56_0da35821-49d8-45e7-b223-d01965cd2d51/maas-api/0.log" May 20 14:45:43.152335 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:43.152238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rthjd_823b9438-7878-4cb9-85e6-591652fa7688/manager/1.log" May 20 14:45:43.165934 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:43.165910 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rthjd_823b9438-7878-4cb9-85e6-591652fa7688/manager/2.log" May 20 14:45:43.221581 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:43.221554 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fcff7bc4-pl4nc_47e8a547-ca37-4eb0-8e18-0bae154330a1/manager/0.log" May 20 14:45:43.293413 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:43.293389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5fdjv_8b6d8d22-b126-4a7e-9c94-d63013c14ce6/postgres/0.log" May 20 14:45:49.705109 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:49.705075 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-br4s9_75583376-5a48-45d0-8828-a96c320c782b/kube-storage-version-migrator-operator/1.log" May 20 14:45:49.705895 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:49.705877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-br4s9_75583376-5a48-45d0-8828-a96c320c782b/kube-storage-version-migrator-operator/0.log" May 20 14:45:51.014009 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.013980 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/kube-multus-additional-cni-plugins/0.log" May 20 14:45:51.040712 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.040680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/egress-router-binary-copy/0.log" May 20 14:45:51.071884 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.071862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/cni-plugins/0.log" May 20 14:45:51.094219 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.094200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/bond-cni-plugin/0.log" May 20 14:45:51.115825 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.115805 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/routeoverride-cni/0.log" May 20 14:45:51.139404 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.139388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/whereabouts-cni-bincopy/0.log" May 20 14:45:51.161875 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.161855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tprj2_539cf384-a6b6-45df-9597-af3dda9d5f49/whereabouts-cni/0.log" May 20 14:45:51.357458 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.357344 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n2zxb_6b8a3398-8c10-42e5-8174-c02973b9dcbe/kube-multus/0.log" May 20 14:45:51.377158 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.377132 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kq8v7_49dd36d9-c144-456e-8660-511749aedeb6/network-metrics-daemon/0.log" May 20 14:45:51.397532 ip-10-0-137-228 kubenswrapper[2559]: I0520 14:45:51.397508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kq8v7_49dd36d9-c144-456e-8660-511749aedeb6/kube-rbac-proxy/0.log"