May 26 01:10:43.522409 ip-10-0-137-202 systemd[1]: Starting Kubernetes Kubelet... May 26 01:10:44.023519 ip-10-0-137-202 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 01:10:44.023519 ip-10-0-137-202 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 01:10:44.023519 ip-10-0-137-202 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 01:10:44.023519 ip-10-0-137-202 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 01:10:44.023519 ip-10-0-137-202 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 01:10:44.024205 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.023580 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 01:10:44.028836 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028819 2568 feature_gate.go:328] unrecognized feature gate: Example May 26 01:10:44.028836 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028836 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028841 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028844 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028848 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028852 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028855 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028858 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028860 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028863 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028866 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028868 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028871 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028873 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028876 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028880 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028884 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028887 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028889 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028892 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 01:10:44.028904 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028895 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028898 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028900 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028903 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028905 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028908 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028911 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028913 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028916 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028919 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028921 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028924 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028927 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028929 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028932 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028934 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028936 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028939 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028941 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028944 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 01:10:44.029383 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028946 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028951 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028955 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028958 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028960 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028963 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028966 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028968 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028971 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028974 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028977 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028980 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028982 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028985 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028988 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028991 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028994 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028996 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.028999 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 01:10:44.029890 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029002 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029004 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029007 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029009 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029012 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029014 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029017 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029021 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029023 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029026 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029028 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029030 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029034 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029037 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029039 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029042 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029044 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029046 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029049 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029051 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 01:10:44.030360 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029062 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029065 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029068 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029071 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029073 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029076 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029083 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029484 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029490 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029493 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029497 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029500 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029503 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029506 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029509 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029511 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029514 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029516 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029519 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029522 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 01:10:44.030829 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029524 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029527 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029529 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029532 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029534 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029537 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029540 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029542 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029545 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029550 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029552 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029555 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029557 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029560 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029562 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029566 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029569 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029574 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 01:10:44.031318 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029577 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029580 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029583 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029588 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029590 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029593 2568 feature_gate.go:328] unrecognized feature gate: Example May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029595 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029598 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029601 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029603 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029606 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029608 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029611 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029614 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029616 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029618 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029621 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029623 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029625 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 01:10:44.031780 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029628 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029630 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029633 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029635 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029639 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029641 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029644 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029646 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029648 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029651 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029653 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029658 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029661 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029664 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029666 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029669 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029672 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029674 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029677 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029679 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 01:10:44.032317 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029682 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029684 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029687 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029689 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029693 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029697 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029700 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029702 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029705 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029708 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029710 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029712 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029715 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.029717 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031626 2568 flags.go:64] FLAG: --address="0.0.0.0" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031638 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031644 2568 flags.go:64] FLAG: --anonymous-auth="true" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031648 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031652 2568 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031655 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 01:10:44.032809 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031660 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031664 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031668 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031672 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031675 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031679 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031682 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031685 2568 flags.go:64] FLAG: --cgroup-root="" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031687 2568 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031690 2568 flags.go:64] FLAG: --client-ca-file="" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031693 2568 flags.go:64] FLAG: --cloud-config="" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031696 2568 flags.go:64] FLAG: --cloud-provider="external" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031698 2568 flags.go:64] FLAG: --cluster-dns="[]" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031703 2568 flags.go:64] FLAG: --cluster-domain="" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031706 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031709 2568 flags.go:64] FLAG: --config-dir="" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031712 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031715 2568 flags.go:64] FLAG: --container-log-max-files="5" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031719 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031722 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031725 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031729 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031732 2568 flags.go:64] FLAG: --contention-profiling="false" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031734 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 01:10:44.033338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031737 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031740 2568 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031743 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031748 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031751 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031753 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031756 2568 flags.go:64] FLAG: --enable-load-reader="false" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031759 2568 flags.go:64] FLAG: --enable-server="true" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031762 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031766 2568 flags.go:64] FLAG: --event-burst="100" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031770 2568 flags.go:64] FLAG: --event-qps="50" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031773 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031777 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031780 2568 flags.go:64] FLAG: --eviction-hard="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031784 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031787 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031790 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031793 2568 flags.go:64] FLAG: --eviction-soft="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031796 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031799 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031802 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031805 2568 flags.go:64] FLAG: --experimental-mounter-path="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031808 2568 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031810 2568 flags.go:64] FLAG: --fail-swap-on="true" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031813 2568 flags.go:64] FLAG: --feature-gates="" May 26 01:10:44.033913 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031817 2568 flags.go:64] FLAG: --file-check-frequency="20s" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031820 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031823 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031827 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031830 2568 flags.go:64] FLAG: --healthz-port="10248" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031833 2568 flags.go:64] FLAG: --help="false" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031836 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-202.ec2.internal" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031839 2568 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031842 2568 flags.go:64] FLAG: --http-check-frequency="20s" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031844 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031848 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031851 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031854 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031857 2568 flags.go:64] FLAG: --image-service-endpoint="" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031860 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031863 2568 flags.go:64] FLAG: --kube-api-burst="100" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031866 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031869 2568 flags.go:64] FLAG: --kube-api-qps="50" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031873 2568 flags.go:64] FLAG: --kube-reserved="" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031876 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031878 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031882 2568 flags.go:64] FLAG: --kubelet-cgroups="" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031884 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031887 2568 flags.go:64] FLAG: --lock-file="" May 26 01:10:44.034526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031890 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031893 2568 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031896 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031902 2568 flags.go:64] FLAG: --log-json-split-stream="false" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031904 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031907 2568 flags.go:64] FLAG: --log-text-split-stream="false" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031910 2568 flags.go:64] FLAG: --logging-format="text" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031913 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031916 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031919 2568 flags.go:64] FLAG: --manifest-url="" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031922 2568 flags.go:64] FLAG: --manifest-url-header="" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031926 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031930 2568 flags.go:64] FLAG: --max-open-files="1000000" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031934 2568 flags.go:64] FLAG: --max-pods="110" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031937 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031940 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031943 2568 flags.go:64] FLAG: --memory-manager-policy="None" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031946 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031949 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031952 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031955 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031962 2568 flags.go:64] FLAG: --node-status-max-images="50" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031965 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031968 2568 flags.go:64] FLAG: --oom-score-adj="-999" May 26 01:10:44.035203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031971 2568 flags.go:64] FLAG: --pod-cidr="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031973 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031980 2568 flags.go:64] FLAG: --pod-manifest-path="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031983 2568 flags.go:64] FLAG: --pod-max-pids="-1" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031987 2568 flags.go:64] FLAG: --pods-per-core="0" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031990 2568 flags.go:64] FLAG: --port="10250" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031993 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031996 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0571a05c0abd40cf1" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.031999 2568 flags.go:64] FLAG: --qos-reserved="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032002 2568 flags.go:64] FLAG: --read-only-port="10255" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032005 2568 flags.go:64] FLAG: --register-node="true" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032007 2568 flags.go:64] FLAG: --register-schedulable="true" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032010 2568 flags.go:64] FLAG: --register-with-taints="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032014 2568 flags.go:64] FLAG: --registry-burst="10" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032017 2568 flags.go:64] FLAG: --registry-qps="5" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032020 2568 flags.go:64] FLAG: --reserved-cpus="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032022 2568 flags.go:64] FLAG: --reserved-memory="" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032026 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032029 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032032 2568 flags.go:64] FLAG: --rotate-certificates="false" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032035 2568 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032038 2568 flags.go:64] FLAG: --runonce="false" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032041 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032045 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032048 2568 flags.go:64] FLAG: --seccomp-default="false" May 26 01:10:44.035810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032051 2568 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032054 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032057 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032060 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032063 2568 flags.go:64] FLAG: --storage-driver-password="root" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032066 2568 flags.go:64] FLAG: --storage-driver-secure="false" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032069 2568 flags.go:64] FLAG: --storage-driver-table="stats" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032072 2568 flags.go:64] FLAG: --storage-driver-user="root" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032074 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032077 2568 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032082 2568 flags.go:64] FLAG: --system-cgroups="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032085 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032090 2568 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032105 2568 flags.go:64] FLAG: --tls-cert-file="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032108 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032112 2568 flags.go:64] FLAG: --tls-min-version="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032115 2568 flags.go:64] FLAG: --tls-private-key-file="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032118 2568 flags.go:64] FLAG: --topology-manager-policy="none" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032121 2568 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032124 2568 flags.go:64] FLAG: --topology-manager-scope="container" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032127 2568 flags.go:64] FLAG: --v="2" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032131 2568 flags.go:64] FLAG: --version="false" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032134 2568 flags.go:64] FLAG: --vmodule="" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032139 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.032142 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 01:10:44.036422 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032248 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032252 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032255 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032258 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032262 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032265 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032268 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032270 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032273 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032292 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032296 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032299 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032302 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032305 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032307 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032310 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032313 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032317 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032320 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032323 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 01:10:44.037064 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032325 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032328 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032331 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032334 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032336 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032338 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032341 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032344 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032346 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032349 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032351 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032354 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032357 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032360 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032362 2568 feature_gate.go:328] unrecognized feature gate: Example May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032365 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032368 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032371 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032373 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032375 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 01:10:44.037589 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032378 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032380 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032383 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032385 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032388 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032390 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032392 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032395 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032397 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032401 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032403 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032406 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032408 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032410 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032413 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032415 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032418 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032420 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032423 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032425 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 01:10:44.038129 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032428 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032430 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032432 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032435 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032437 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032440 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032443 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032446 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032450 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032453 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032457 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032459 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032462 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032465 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032467 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032470 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032472 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032475 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032477 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 01:10:44.038638 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032480 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032482 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032485 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032488 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032490 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032493 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.032497 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 01:10:44.039370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.033174 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 01:10:44.040471 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.040447 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 01:10:44.040471 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.040469 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040537 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040545 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040551 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040556 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040560 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040565 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040569 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040573 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040578 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040583 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040587 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040591 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040596 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040602 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040608 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040615 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 01:10:44.040613 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040620 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040625 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040629 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040633 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040637 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040641 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040646 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040650 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040654 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040658 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040663 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040667 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040670 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040674 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040679 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040683 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040687 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040691 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040696 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040702 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 01:10:44.041452 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040706 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040710 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040714 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040718 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040722 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040727 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040731 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040736 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040740 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040743 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040748 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040753 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040757 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040761 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040766 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040770 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040775 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040779 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040784 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040788 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 01:10:44.042085 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040793 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040797 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040802 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040806 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040810 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040817 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040823 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040828 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040832 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040837 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040841 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040845 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040849 2568 feature_gate.go:328] unrecognized feature gate: Example May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040853 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040857 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040862 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040866 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040870 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040874 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 01:10:44.042769 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040878 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040882 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040886 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040891 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040896 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040900 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040905 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040910 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040914 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040918 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.040922 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.040930 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041117 2568 feature_gate.go:328] unrecognized feature gate: Example May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041125 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041130 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041135 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 01:10:44.043727 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041139 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041143 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041148 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041152 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041156 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041160 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041165 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041169 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041173 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041177 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041181 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041185 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041189 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041193 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041197 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041202 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041206 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041210 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041214 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041218 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 01:10:44.044266 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041222 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041228 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041232 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041237 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041241 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041245 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041250 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041254 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041258 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041262 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041266 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041270 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041274 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041278 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041282 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041286 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041290 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041294 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041298 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041302 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 01:10:44.044788 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041307 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041311 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041315 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041319 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041323 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041327 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041331 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041336 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041340 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041344 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041349 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041353 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041357 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041361 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041365 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041371 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041375 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041379 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041384 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041388 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 01:10:44.045415 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041392 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041396 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041400 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041404 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041410 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041415 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041422 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041428 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041433 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041437 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041442 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041447 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041451 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041455 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041459 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041464 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041468 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041472 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041477 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 01:10:44.045912 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041481 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041486 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:44.041491 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.041499 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.041654 2568 server.go:962] "Client rotation is on, will bootstrap in background" May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.044848 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.045983 2568 server.go:1019] "Starting client certificate rotation" May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.046085 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 01:10:44.046455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.046134 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 01:10:44.075922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.075893 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 01:10:44.082223 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.082191 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 01:10:44.103235 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.103218 2568 log.go:25] "Validated CRI v1 runtime API" May 26 01:10:44.109553 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.109526 2568 log.go:25] "Validated CRI v1 image API" May 26 01:10:44.112133 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.112118 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 01:10:44.114856 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.114837 2568 fs.go:135] Filesystem UUIDs: map[30eaeec3-aacd-4db4-9715-fbac7da33fff:/dev/nvme0n1p4 699d0e29-6bf7-436f-b444-9aba5fd4cf49:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 26 01:10:44.114917 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.114857 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 01:10:44.118639 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.118618 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 01:10:44.119367 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.119250 2568 manager.go:217] Machine: {Timestamp:2026-05-26 01:10:44.118663285 +0000 UTC m=+0.464494742 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094891 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c95a111c01f88154116af132e0e6 SystemUUID:ec28c95a-111c-01f8-8154-116af132e0e6 BootID:774134be-17b3-4f01-be7b-a5b6139749c1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:38:ed:c0:77:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:38:ed:c0:77:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:15:e6:c3:15:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 01:10:44.119367 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.119367 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 01:10:44.119465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.119448 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 01:10:44.122440 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.122408 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 01:10:44.122613 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.122442 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 01:10:44.122702 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.122627 2568 topology_manager.go:138] "Creating topology manager with none policy" May 26 01:10:44.122702 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.122640 2568 container_manager_linux.go:306] "Creating device plugin manager" May 26 01:10:44.122702 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.122650 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 01:10:44.123544 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.123532 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 01:10:44.126305 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.126292 2568 state_mem.go:36] "Initialized new in-memory state store" May 26 01:10:44.126454 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.126443 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 01:10:44.129255 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.129243 2568 kubelet.go:491] "Attempting to sync node with API server" May 26 01:10:44.129314 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.129265 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 01:10:44.129314 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.129282 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 01:10:44.129314 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.129295 2568 kubelet.go:397] "Adding apiserver pod source" May 26 01:10:44.129314 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.129307 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 01:10:44.133289 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.130766 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 01:10:44.133289 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.130795 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 01:10:44.136566 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.136532 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 01:10:44.139403 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.139386 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 01:10:44.140392 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140380 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140398 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140404 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140410 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140420 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140429 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 01:10:44.140436 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140437 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 01:10:44.140629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140443 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 01:10:44.140629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140451 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 01:10:44.140629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140457 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 01:10:44.140629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140466 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 01:10:44.140930 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.140920 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 01:10:44.142038 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.142025 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 01:10:44.142079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.142041 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 01:10:44.143343 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.143314 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 01:10:44.143435 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.143323 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 01:10:44.143435 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.143369 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-64n8q" May 26 01:10:44.145629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.145612 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 01:10:44.145714 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.145650 2568 server.go:1295] "Started kubelet" May 26 01:10:44.145763 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.145726 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 01:10:44.145803 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.145749 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 01:10:44.145836 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.145811 2568 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 01:10:44.146454 ip-10-0-137-202 systemd[1]: Started Kubernetes Kubelet. May 26 01:10:44.147415 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.147331 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 01:10:44.147874 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.147849 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 01:10:44.148677 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.148660 2568 server.go:317] "Adding debug handlers to kubelet server" May 26 01:10:44.148774 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.148691 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-64n8q" May 26 01:10:44.155050 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.155029 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 01:10:44.157216 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157198 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 01:10:44.157309 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157199 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 01:10:44.157309 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157259 2568 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 01:10:44.157309 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157272 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 01:10:44.157309 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157292 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 01:10:44.157477 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157452 2568 reconstruct.go:97] "Volume reconstruction finished" May 26 01:10:44.157477 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157462 2568 reconciler.go:26] "Reconciler: start to sync state" May 26 01:10:44.157998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157980 2568 factory.go:55] Registering systemd factory May 26 01:10:44.157998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.157997 2568 factory.go:223] Registration of the systemd container factory successfully May 26 01:10:44.158247 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.158232 2568 factory.go:153] Registering CRI-O factory May 26 01:10:44.158247 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.158237 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.158247 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.158249 2568 factory.go:223] Registration of the crio container factory successfully May 26 01:10:44.158411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.158300 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 01:10:44.158411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.158323 2568 factory.go:103] Registering Raw factory May 26 01:10:44.158411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.158339 2568 manager.go:1196] Started watching for new ooms in manager May 26 01:10:44.159468 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.159407 2568 manager.go:319] Starting recovery of all containers May 26 01:10:44.160249 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.160227 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:44.162238 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.162072 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-202.ec2.internal\" not found" node="ip-10-0-137-202.ec2.internal" May 26 01:10:44.171464 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.171441 2568 manager.go:324] Recovery completed May 26 01:10:44.175603 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.175590 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.177586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.177567 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.177678 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.177606 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.177678 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.177622 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.178230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.178214 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 01:10:44.178312 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.178232 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 01:10:44.178312 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.178251 2568 state_mem.go:36] "Initialized new in-memory state store" May 26 01:10:44.182135 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.182121 2568 policy_none.go:49] "None policy: Start" May 26 01:10:44.182186 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.182138 2568 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 01:10:44.182186 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.182148 2568 state_mem.go:35] "Initializing new in-memory state store" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.220898 2568 manager.go:341] "Starting Device Plugin manager" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.220929 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.220939 2568 server.go:85] "Starting device plugin registration server" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.221379 2568 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.221393 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.221482 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.221567 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.221575 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.222200 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 01:10:44.246380 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.222243 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.266034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.265991 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 01:10:44.267397 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.267376 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 01:10:44.267447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.267408 2568 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 01:10:44.267482 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.267447 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 01:10:44.267482 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.267460 2568 kubelet.go:2451] "Starting kubelet main sync loop" May 26 01:10:44.267560 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.267506 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 01:10:44.269686 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.269665 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:44.321554 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.321469 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.322626 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.322602 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.322703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.322639 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.322703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.322651 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.322703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.322673 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-202.ec2.internal" May 26 01:10:44.331503 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.331486 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-202.ec2.internal" May 26 01:10:44.331549 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.331509 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-202.ec2.internal\": node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.351583 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.351547 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.367893 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.367830 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal"] May 26 01:10:44.367999 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.367955 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.368936 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.368910 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.368998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.368943 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.368998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.368956 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.370313 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.370300 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.370471 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.370452 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.370523 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.370498 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.371071 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371054 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.371071 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371065 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.371201 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371085 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.371201 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371086 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.371201 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371114 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.371201 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.371123 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.372235 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.372221 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:44.372276 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.372251 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 01:10:44.372869 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.372851 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientMemory" May 26 01:10:44.372969 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.372880 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasNoDiskPressure" May 26 01:10:44.372969 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.372891 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeHasSufficientPID" May 26 01:10:44.407762 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.407739 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-202.ec2.internal\" not found" node="ip-10-0-137-202.ec2.internal" May 26 01:10:44.411053 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.411034 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-202.ec2.internal\" not found" node="ip-10-0-137-202.ec2.internal" May 26 01:10:44.452443 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.452411 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.459787 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.459761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.459854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.459795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.459854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.459818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e0ef6285d9b60c9a32d7ffb890bdc9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-202.ec2.internal\" (UID: \"a8e0ef6285d9b60c9a32d7ffb890bdc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:44.552924 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.552898 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.560269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560243 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.560353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560284 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e0ef6285d9b60c9a32d7ffb890bdc9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-202.ec2.internal\" (UID: \"a8e0ef6285d9b60c9a32d7ffb890bdc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:44.560353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560309 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.560353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.560472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e0ef6285d9b60c9a32d7ffb890bdc9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-202.ec2.internal\" (UID: \"a8e0ef6285d9b60c9a32d7ffb890bdc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:44.560472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.560348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b009de61ce0c820c61d04b2a906afc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal\" (UID: \"d3b009de61ce0c820c61d04b2a906afc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.653753 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.653679 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.711169 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.711129 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:44.713984 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:44.713966 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:44.754735 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.754704 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.855191 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.855170 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:44.955712 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:44.955641 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.046257 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.046230 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 01:10:45.046794 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.046369 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 01:10:45.046794 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.046406 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 01:10:45.056379 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.056359 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.150909 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.150870 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 01:05:44 +0000 UTC" deadline="2027-11-10 06:05:11.087336759 +0000 UTC" May 26 01:10:45.150909 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.150902 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12796h54m25.936438483s" May 26 01:10:45.157237 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.157213 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.158885 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.158861 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 01:10:45.169108 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.169082 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 01:10:45.188504 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.188481 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wshv" May 26 01:10:45.195621 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.195600 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wshv" May 26 01:10:45.257883 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.257845 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.358342 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.358309 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.385193 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:45.385157 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b009de61ce0c820c61d04b2a906afc.slice/crio-06c0b5905947599134a1e25d45acfe2580e838e4750a47328f6f5dd40a8f114e WatchSource:0}: Error finding container 06c0b5905947599134a1e25d45acfe2580e838e4750a47328f6f5dd40a8f114e: Status 404 returned error can't find the container with id 06c0b5905947599134a1e25d45acfe2580e838e4750a47328f6f5dd40a8f114e May 26 01:10:45.385380 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:45.385365 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e0ef6285d9b60c9a32d7ffb890bdc9.slice/crio-207c685f2484a29c91dfb62f748b76f36effcf281f5148c70bff379eb3c4a529 WatchSource:0}: Error finding container 207c685f2484a29c91dfb62f748b76f36effcf281f5148c70bff379eb3c4a529: Status 404 returned error can't find the container with id 207c685f2484a29c91dfb62f748b76f36effcf281f5148c70bff379eb3c4a529 May 26 01:10:45.389567 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.389550 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 01:10:45.458727 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.458684 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.559183 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.559119 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.659923 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:45.659891 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-202.ec2.internal\" not found" May 26 01:10:45.667286 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.667260 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:45.669604 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.669584 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:45.758324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.758292 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" May 26 01:10:45.774845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.774818 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 01:10:45.776135 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.776113 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" May 26 01:10:45.782970 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:45.782949 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 01:10:46.130787 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.130756 2568 apiserver.go:52] "Watching apiserver" May 26 01:10:46.136504 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.136473 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 01:10:46.137867 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.137836 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8gvfj","openshift-dns/node-resolver-k7k8b","openshift-image-registry/node-ca-d7g7f","openshift-multus/multus-additional-cni-plugins-s6h5n","openshift-multus/network-metrics-daemon-8lcnj","openshift-network-diagnostics/network-check-target-9sllb","openshift-network-operator/iptables-alerter-vjrcp","openshift-ovn-kubernetes/ovnkube-node-qdm2l","kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z","openshift-cluster-node-tuning-operator/tuned-fbd6l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal","openshift-multus/multus-pxnnc"] May 26 01:10:46.143081 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.143058 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.145529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.145510 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 01:10:46.145858 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.145838 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 01:10:46.145932 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.145834 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lvkfr\"" May 26 01:10:46.146204 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.146183 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 01:10:46.146813 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.146794 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.148655 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.148631 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 01:10:46.148786 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.148768 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 01:10:46.148856 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.148843 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9cfhk\"" May 26 01:10:46.150082 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.149628 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.151619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.151474 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 01:10:46.151825 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.151807 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6w4x9\"" May 26 01:10:46.151894 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.151829 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 01:10:46.152005 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.151918 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 01:10:46.154009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.153567 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.154009 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.153678 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:46.156485 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.156277 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.159142 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.159314 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.159547 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bmpg\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.159694 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.159879 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.160118 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.160281 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 01:10:46.161483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.160948 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 01:10:46.161884 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.161595 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:46.161884 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.161666 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:46.163170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.163000 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 01:10:46.163170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.163147 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ctsnx\"" May 26 01:10:46.164061 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.163935 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.166206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.166179 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 01:10:46.167848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.166395 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.167848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.166869 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 01:10:46.167848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.167380 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 01:10:46.167848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.167643 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qthgh\"" May 26 01:10:46.168126 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.167884 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 01:10:46.168126 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.167975 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 01:10:46.168224 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.168203 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 01:10:46.169038 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.168953 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 01:10:46.169038 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.168964 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g26kn\"" May 26 01:10:46.169586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169326 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 01:10:46.169586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169386 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 01:10:46.169751 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75cp2\" (UniqueName: \"kubernetes.io/projected/59afbbc1-4406-4bf3-a61e-65bdf8149809-kube-api-access-75cp2\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.169859 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c4134c-230f-411c-ba4f-44f5fb52c215-host\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.169924 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwhqq\" (UniqueName: \"kubernetes.io/projected/e0146d55-9073-4601-8953-042c67ddaf53-kube-api-access-dwhqq\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.169965 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-system-cni-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.169998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.169987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7sh\" (UniqueName: \"kubernetes.io/projected/96c69e1e-4e81-42a4-a126-18632305214b-kube-api-access-xj7sh\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.170056 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170022 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxnnc" May 26 01:10:46.170056 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170052 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.170178 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0146d55-9073-4601-8953-042c67ddaf53-iptables-alerter-script\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.170178 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-os-release\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.170178 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.170322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.170322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.170322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:46.170322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/798d89c8-5ba9-42eb-87ef-bb26636057ff-agent-certs\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.170322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59afbbc1-4406-4bf3-a61e-65bdf8149809-hosts-file\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59afbbc1-4406-4bf3-a61e-65bdf8149809-tmp-dir\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c4134c-230f-411c-ba4f-44f5fb52c215-serviceca\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szz66\" (UniqueName: \"kubernetes.io/projected/36c4134c-230f-411c-ba4f-44f5fb52c215-kube-api-access-szz66\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0146d55-9073-4601-8953-042c67ddaf53-host-slash\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.170528 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170501 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/798d89c8-5ba9-42eb-87ef-bb26636057ff-konnectivity-ca\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.170773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-cnibin\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.170773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.170575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.171626 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.171600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmtlz\" (UniqueName: \"kubernetes.io/projected/6cb0e279-5346-4331-a42d-3e1e654b03f9-kube-api-access-tmtlz\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.172024 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.172001 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zpqsk\"" May 26 01:10:46.172124 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.172056 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 01:10:46.172317 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.172294 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 01:10:46.172449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.172427 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2rq56\"" May 26 01:10:46.173082 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.173064 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 01:10:46.177326 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.177262 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:46.197584 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.197551 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 01:05:45 +0000 UTC" deadline="2027-11-16 15:55:27.764720493 +0000 UTC" May 26 01:10:46.197685 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.197585 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12950h44m41.567138838s" May 26 01:10:46.212264 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.212244 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 01:10:46.258412 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.258385 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 01:10:46.271849 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-etc-tuned\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-system-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-socket-dir-parent\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-modprobe-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-multus-certs\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.271998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-etc-kubernetes\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272033 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0146d55-9073-4601-8953-042c67ddaf53-iptables-alerter-script\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272060 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272091 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-kubelet\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-netd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkbzv\" (UniqueName: \"kubernetes.io/projected/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kube-api-access-fkbzv\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272273 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272310 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/798d89c8-5ba9-42eb-87ef-bb26636057ff-konnectivity-ca\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-script-lib\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-kubernetes\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-systemd\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-var-lib-kubelet\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-multus\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-kubelet\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-node-log\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-conf\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-hostroot\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272591 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272612 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0146d55-9073-4601-8953-042c67ddaf53-iptables-alerter-script\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75cp2\" (UniqueName: \"kubernetes.io/projected/59afbbc1-4406-4bf3-a61e-65bdf8149809-kube-api-access-75cp2\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272644 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwhqq\" (UniqueName: \"kubernetes.io/projected/e0146d55-9073-4601-8953-042c67ddaf53-kube-api-access-dwhqq\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-systemd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-device-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272722 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272740 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/798d89c8-5ba9-42eb-87ef-bb26636057ff-agent-certs\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-bin\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.272950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdm5\" (UniqueName: \"kubernetes.io/projected/761e4056-776c-44ae-a96e-526896775703-kube-api-access-phdm5\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272864 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c4134c-230f-411c-ba4f-44f5fb52c215-serviceca\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272882 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0146d55-9073-4601-8953-042c67ddaf53-host-slash\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272884 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-etc-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/761e4056-776c-44ae-a96e-526896775703-ovn-node-metrics-cert\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.272932 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-host\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-env-overrides\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.273003 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:10:46.772981314 +0000 UTC m=+3.118812762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-os-release\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273220 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c4134c-230f-411c-ba4f-44f5fb52c215-host\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273236 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-system-cni-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273227 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6nx\" (UniqueName: \"kubernetes.io/projected/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-kube-api-access-sh6nx\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.273724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273271 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbk6z\" (UniqueName: \"kubernetes.io/projected/aad28b33-d40a-4258-88b0-25841cb542c1-kube-api-access-jbk6z\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273326 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36c4134c-230f-411c-ba4f-44f5fb52c215-serviceca\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-k8s-cni-cncf-io\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-bin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-daemon-config\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-systemd-units\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273401 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-system-cni-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-slash\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/798d89c8-5ba9-42eb-87ef-bb26636057ff-konnectivity-ca\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-lib-modules\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-netns\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-conf-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36c4134c-230f-411c-ba4f-44f5fb52c215-host\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273513 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0146d55-9073-4601-8953-042c67ddaf53-host-slash\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.274547 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-netns\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.272774 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-run\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-sys\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.273963 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" event={"ID":"a8e0ef6285d9b60c9a32d7ffb890bdc9","Type":"ContainerStarted","Data":"207c685f2484a29c91dfb62f748b76f36effcf281f5148c70bff379eb3c4a529"} May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cnibin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274222 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7sh\" (UniqueName: \"kubernetes.io/projected/96c69e1e-4e81-42a4-a126-18632305214b-kube-api-access-xj7sh\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-tmp\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274309 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-os-release\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-log-socket\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysconfig\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cni-binary-copy\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-os-release\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.275334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274474 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59afbbc1-4406-4bf3-a61e-65bdf8149809-hosts-file\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274499 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59afbbc1-4406-4bf3-a61e-65bdf8149809-tmp-dir\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szz66\" (UniqueName: \"kubernetes.io/projected/36c4134c-230f-411c-ba4f-44f5fb52c215-kube-api-access-szz66\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59afbbc1-4406-4bf3-a61e-65bdf8149809-hosts-file\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-var-lib-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-config\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274669 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-cnibin\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274754 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59afbbc1-4406-4bf3-a61e-65bdf8149809-tmp-dir\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274782 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274812 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmtlz\" (UniqueName: \"kubernetes.io/projected/6cb0e279-5346-4331-a42d-3e1e654b03f9-kube-api-access-tmtlz\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274832 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cb0e279-5346-4331-a42d-3e1e654b03f9-cnibin\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.274839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-ovn\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.275368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cb0e279-5346-4331-a42d-3e1e654b03f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.276241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.275660 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" event={"ID":"d3b009de61ce0c820c61d04b2a906afc","Type":"ContainerStarted","Data":"06c0b5905947599134a1e25d45acfe2580e838e4750a47328f6f5dd40a8f114e"} May 26 01:10:46.277565 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.277544 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/798d89c8-5ba9-42eb-87ef-bb26636057ff-agent-certs\") pod \"konnectivity-agent-8gvfj\" (UID: \"798d89c8-5ba9-42eb-87ef-bb26636057ff\") " pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.277565 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.277561 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:10:46.277690 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.277581 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:10:46.277690 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.277594 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:46.277690 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.277652 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:10:46.777633196 +0000 UTC m=+3.123464655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:46.280501 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.279967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwhqq\" (UniqueName: \"kubernetes.io/projected/e0146d55-9073-4601-8953-042c67ddaf53-kube-api-access-dwhqq\") pod \"iptables-alerter-vjrcp\" (UID: \"e0146d55-9073-4601-8953-042c67ddaf53\") " pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.284825 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.282239 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7sh\" (UniqueName: \"kubernetes.io/projected/96c69e1e-4e81-42a4-a126-18632305214b-kube-api-access-xj7sh\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.286433 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.286408 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75cp2\" (UniqueName: \"kubernetes.io/projected/59afbbc1-4406-4bf3-a61e-65bdf8149809-kube-api-access-75cp2\") pod \"node-resolver-k7k8b\" (UID: \"59afbbc1-4406-4bf3-a61e-65bdf8149809\") " pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.286621 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.286603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmtlz\" (UniqueName: \"kubernetes.io/projected/6cb0e279-5346-4331-a42d-3e1e654b03f9-kube-api-access-tmtlz\") pod \"multus-additional-cni-plugins-s6h5n\" (UID: \"6cb0e279-5346-4331-a42d-3e1e654b03f9\") " pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.287858 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.287829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szz66\" (UniqueName: \"kubernetes.io/projected/36c4134c-230f-411c-ba4f-44f5fb52c215-kube-api-access-szz66\") pod \"node-ca-d7g7f\" (UID: \"36c4134c-230f-411c-ba4f-44f5fb52c215\") " pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.375523 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375494 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-systemd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.375523 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375526 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-device-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375559 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-bin\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375596 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-systemd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375602 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-bin\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375647 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phdm5\" (UniqueName: \"kubernetes.io/projected/761e4056-776c-44ae-a96e-526896775703-kube-api-access-phdm5\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375694 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375650 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-device-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.375734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375720 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-etc-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375737 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/761e4056-776c-44ae-a96e-526896775703-ovn-node-metrics-cert\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375754 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-host\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375770 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375764 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-registration-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375792 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-env-overrides\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.375993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-etc-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-host\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376153 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-os-release\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376206 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6nx\" (UniqueName: \"kubernetes.io/projected/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-kube-api-access-sh6nx\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376238 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376263 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbk6z\" (UniqueName: \"kubernetes.io/projected/aad28b33-d40a-4258-88b0-25841cb542c1-kube-api-access-jbk6z\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-os-release\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376287 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-k8s-cni-cncf-io\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376315 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-bin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376340 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-daemon-config\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376364 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-systemd-units\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376373 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-env-overrides\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376388 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-slash\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-lib-modules\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-bin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376435 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-netns\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376472 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-conf-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376497 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-netns\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376519 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-run\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376542 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-sys\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376564 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cnibin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-netns\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376606 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-netns\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.376624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cnibin\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-k8s-cni-cncf-io\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-run\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376706 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-conf-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-sys\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376709 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376751 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-tmp\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376757 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-slash\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376777 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-systemd-units\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376805 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376833 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-log-socket\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376858 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-lib-modules\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376884 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysconfig\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-log-socket\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376934 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysconfig\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.377422 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376947 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cni-binary-copy\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.376979 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-var-lib-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377000 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-daemon-config\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377009 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-var-lib-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377009 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-config\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377041 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377081 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-ovn\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377127 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-etc-tuned\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377152 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-system-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377176 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-socket-dir-parent\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377200 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377227 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-modprobe-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377251 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-multus-certs\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377285 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-etc-kubernetes\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377326 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-kubelet\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377356 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-netd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkbzv\" (UniqueName: \"kubernetes.io/projected/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kube-api-access-fkbzv\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-script-lib\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377439 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-kubernetes\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377464 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-systemd\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377488 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-var-lib-kubelet\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377514 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-multus\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377539 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-kubelet\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-config\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377552 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-openvswitch\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377563 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-node-log\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377604 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-sys-fs\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-node-log\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377613 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-etc-kubernetes\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-kubelet\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-run-ovn\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377659 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-kubernetes\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-system-cni-dir\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.378955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377690 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-cni-netd\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377702 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-systemd\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-multus-socket-dir-parent\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377745 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-var-lib-kubelet\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-cni-binary-copy\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-cni-multus\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377807 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-var-lib-kubelet\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377844 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/761e4056-776c-44ae-a96e-526896775703-host-run-ovn-kubernetes\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377851 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-host-run-multus-certs\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377886 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-conf\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377916 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-hostroot\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-modprobe-d\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377942 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.377980 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-hostroot\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.378060 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aad28b33-d40a-4258-88b0-25841cb542c1-etc-sysctl-conf\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.378076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-socket-dir\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.378320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/761e4056-776c-44ae-a96e-526896775703-ovn-node-metrics-cert\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.378375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/761e4056-776c-44ae-a96e-526896775703-ovnkube-script-lib\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.379546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.379173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-tmp\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.380254 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.379944 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aad28b33-d40a-4258-88b0-25841cb542c1-etc-tuned\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.384259 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.384188 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbk6z\" (UniqueName: \"kubernetes.io/projected/aad28b33-d40a-4258-88b0-25841cb542c1-kube-api-access-jbk6z\") pod \"tuned-fbd6l\" (UID: \"aad28b33-d40a-4258-88b0-25841cb542c1\") " pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.384583 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.384566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdm5\" (UniqueName: \"kubernetes.io/projected/761e4056-776c-44ae-a96e-526896775703-kube-api-access-phdm5\") pod \"ovnkube-node-qdm2l\" (UID: \"761e4056-776c-44ae-a96e-526896775703\") " pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.385204 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.385187 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkbzv\" (UniqueName: \"kubernetes.io/projected/3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7-kube-api-access-fkbzv\") pod \"aws-ebs-csi-driver-node-8gn9z\" (UID: \"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.385933 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.385915 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6nx\" (UniqueName: \"kubernetes.io/projected/a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb-kube-api-access-sh6nx\") pod \"multus-pxnnc\" (UID: \"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb\") " pod="openshift-multus/multus-pxnnc" May 26 01:10:46.459152 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.459114 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vjrcp" May 26 01:10:46.469901 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.469870 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k7k8b" May 26 01:10:46.482706 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.482677 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7g7f" May 26 01:10:46.488347 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.488326 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" May 26 01:10:46.498065 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.498041 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:10:46.504808 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.504788 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:10:46.512489 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.512467 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" May 26 01:10:46.525172 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.525133 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxnnc" May 26 01:10:46.532923 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.532897 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" May 26 01:10:46.780138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.780046 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:46.780138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:46.780115 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780218 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780235 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780239 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780244 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780293 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:10:47.780275624 +0000 UTC m=+4.126107075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:46.780318 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:46.780307 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:10:47.780300533 +0000 UTC m=+4.126131977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:47.077176 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.077082 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59afbbc1_4406_4bf3_a61e_65bdf8149809.slice/crio-c3fae16aae027aaa31bc9ad1638c89d564e160c3f4a6f4ca35a1d4aaf8e65883 WatchSource:0}: Error finding container c3fae16aae027aaa31bc9ad1638c89d564e160c3f4a6f4ca35a1d4aaf8e65883: Status 404 returned error can't find the container with id c3fae16aae027aaa31bc9ad1638c89d564e160c3f4a6f4ca35a1d4aaf8e65883 May 26 01:10:47.081936 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.081909 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0146d55_9073_4601_8953_042c67ddaf53.slice/crio-94a62df57dd4792d814019ff5e11493bc6d6bd748ee97e047b5967602e3025c8 WatchSource:0}: Error finding container 94a62df57dd4792d814019ff5e11493bc6d6bd748ee97e047b5967602e3025c8: Status 404 returned error can't find the container with id 94a62df57dd4792d814019ff5e11493bc6d6bd748ee97e047b5967602e3025c8 May 26 01:10:47.083710 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.083688 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb0e279_5346_4331_a42d_3e1e654b03f9.slice/crio-74c70f0db911b300d744d5ed7d2e1f48efdd4e3c2adef09668a33a09c126e78b WatchSource:0}: Error finding container 74c70f0db911b300d744d5ed7d2e1f48efdd4e3c2adef09668a33a09c126e78b: Status 404 returned error can't find the container with id 74c70f0db911b300d744d5ed7d2e1f48efdd4e3c2adef09668a33a09c126e78b May 26 01:10:47.085815 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.085126 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c4134c_230f_411c_ba4f_44f5fb52c215.slice/crio-e3a58f709485111d6733b0b96c7d96918430b83b3752fa8e83debb666e631d61 WatchSource:0}: Error finding container e3a58f709485111d6733b0b96c7d96918430b83b3752fa8e83debb666e631d61: Status 404 returned error can't find the container with id e3a58f709485111d6733b0b96c7d96918430b83b3752fa8e83debb666e631d61 May 26 01:10:47.086146 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.086047 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798d89c8_5ba9_42eb_87ef_bb26636057ff.slice/crio-2529d9bc4205b12545f27bd8f1a2881ba37a63e282d4b14edeedd3de4b570b58 WatchSource:0}: Error finding container 2529d9bc4205b12545f27bd8f1a2881ba37a63e282d4b14edeedd3de4b570b58: Status 404 returned error can't find the container with id 2529d9bc4205b12545f27bd8f1a2881ba37a63e282d4b14edeedd3de4b570b58 May 26 01:10:47.086873 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.086738 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad28b33_d40a_4258_88b0_25841cb542c1.slice/crio-e2f49af2afacf7b3f10ac92e59914e61080f282aad331af23f7cb75e08d1aebb WatchSource:0}: Error finding container e2f49af2afacf7b3f10ac92e59914e61080f282aad331af23f7cb75e08d1aebb: Status 404 returned error can't find the container with id e2f49af2afacf7b3f10ac92e59914e61080f282aad331af23f7cb75e08d1aebb May 26 01:10:47.087885 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.087861 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e1eeec_4a6f_4c24_8a16_e5ea1b926adb.slice/crio-a6d6214ec1d2e33a45e425566974b503895c684e464ef67d9d288bd8d8ded0fc WatchSource:0}: Error finding container a6d6214ec1d2e33a45e425566974b503895c684e464ef67d9d288bd8d8ded0fc: Status 404 returned error can't find the container with id a6d6214ec1d2e33a45e425566974b503895c684e464ef67d9d288bd8d8ded0fc May 26 01:10:47.089305 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.088535 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d56d88b_38c0_4216_a3e6_e2e3d72aa8a7.slice/crio-c1954af6b0dc89214366304dd20f9e8075dde0b96cc1d7ef3fd839fd9dc5a2e0 WatchSource:0}: Error finding container c1954af6b0dc89214366304dd20f9e8075dde0b96cc1d7ef3fd839fd9dc5a2e0: Status 404 returned error can't find the container with id c1954af6b0dc89214366304dd20f9e8075dde0b96cc1d7ef3fd839fd9dc5a2e0 May 26 01:10:47.090380 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:10:47.090363 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761e4056_776c_44ae_a96e_526896775703.slice/crio-b971bd6fba1845aac8508a617824cc25ad03062e02d905f85f070f2e8782b937 WatchSource:0}: Error finding container b971bd6fba1845aac8508a617824cc25ad03062e02d905f85f070f2e8782b937: Status 404 returned error can't find the container with id b971bd6fba1845aac8508a617824cc25ad03062e02d905f85f070f2e8782b937 May 26 01:10:47.198467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.198427 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 01:05:45 +0000 UTC" deadline="2028-03-09 02:36:40.728527518 +0000 UTC" May 26 01:10:47.198467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.198462 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15673h25m53.530068519s" May 26 01:10:47.278824 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.278790 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" event={"ID":"a8e0ef6285d9b60c9a32d7ffb890bdc9","Type":"ContainerStarted","Data":"ce1a67b12af05d9ecae872779f90e453eb0459da700dfe23b75b2b63194b5c72"} May 26 01:10:47.279696 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.279669 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerStarted","Data":"74c70f0db911b300d744d5ed7d2e1f48efdd4e3c2adef09668a33a09c126e78b"} May 26 01:10:47.280564 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.280536 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7g7f" event={"ID":"36c4134c-230f-411c-ba4f-44f5fb52c215","Type":"ContainerStarted","Data":"e3a58f709485111d6733b0b96c7d96918430b83b3752fa8e83debb666e631d61"} May 26 01:10:47.281565 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.281539 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vjrcp" event={"ID":"e0146d55-9073-4601-8953-042c67ddaf53","Type":"ContainerStarted","Data":"94a62df57dd4792d814019ff5e11493bc6d6bd748ee97e047b5967602e3025c8"} May 26 01:10:47.282542 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.282522 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k7k8b" event={"ID":"59afbbc1-4406-4bf3-a61e-65bdf8149809","Type":"ContainerStarted","Data":"c3fae16aae027aaa31bc9ad1638c89d564e160c3f4a6f4ca35a1d4aaf8e65883"} May 26 01:10:47.283490 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.283464 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"b971bd6fba1845aac8508a617824cc25ad03062e02d905f85f070f2e8782b937"} May 26 01:10:47.284498 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.284479 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" event={"ID":"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7","Type":"ContainerStarted","Data":"c1954af6b0dc89214366304dd20f9e8075dde0b96cc1d7ef3fd839fd9dc5a2e0"} May 26 01:10:47.285473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.285448 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxnnc" event={"ID":"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb","Type":"ContainerStarted","Data":"a6d6214ec1d2e33a45e425566974b503895c684e464ef67d9d288bd8d8ded0fc"} May 26 01:10:47.286377 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.286359 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gvfj" event={"ID":"798d89c8-5ba9-42eb-87ef-bb26636057ff","Type":"ContainerStarted","Data":"2529d9bc4205b12545f27bd8f1a2881ba37a63e282d4b14edeedd3de4b570b58"} May 26 01:10:47.287269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.287247 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" event={"ID":"aad28b33-d40a-4258-88b0-25841cb542c1","Type":"ContainerStarted","Data":"e2f49af2afacf7b3f10ac92e59914e61080f282aad331af23f7cb75e08d1aebb"} May 26 01:10:47.291235 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.291196 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-202.ec2.internal" podStartSLOduration=2.29118583 podStartE2EDuration="2.29118583s" podCreationTimestamp="2026-05-26 01:10:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:10:47.291070332 +0000 UTC m=+3.636901798" watchObservedRunningTime="2026-05-26 01:10:47.29118583 +0000 UTC m=+3.637017296" May 26 01:10:47.786320 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.786017 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:47.786320 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:47.786079 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:47.786320 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786242 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:47.786320 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786305 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:10:49.78628548 +0000 UTC m=+6.132116932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:47.786983 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786716 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:10:47.786983 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786736 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:10:47.786983 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786749 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:47.786983 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:47.786793 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:10:49.786778122 +0000 UTC m=+6.132609572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:48.270483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:48.270400 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:48.270908 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:48.270536 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:48.270998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:48.270971 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:48.271090 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:48.271067 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:48.299929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:48.299580 2568 generic.go:358] "Generic (PLEG): container finished" podID="d3b009de61ce0c820c61d04b2a906afc" containerID="d03e0029e7ad4a857c0820f6716cac8362d880d81d2f5f1ae37d1a0eb589e202" exitCode=0 May 26 01:10:48.299929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:48.299697 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" event={"ID":"d3b009de61ce0c820c61d04b2a906afc","Type":"ContainerDied","Data":"d03e0029e7ad4a857c0820f6716cac8362d880d81d2f5f1ae37d1a0eb589e202"} May 26 01:10:49.324114 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:49.324016 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" event={"ID":"d3b009de61ce0c820c61d04b2a906afc","Type":"ContainerStarted","Data":"2cc8c85eac3e788d8c0c2da01f0d9876a707ebc80f6c6e5fdadc6e3c06383814"} May 26 01:10:49.800158 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:49.800053 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:49.800158 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:49.800138 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:49.800382 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800278 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:49.800382 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800344 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:10:53.800323422 +0000 UTC m=+10.146154894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:49.800813 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800794 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:10:49.800813 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800816 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:10:49.800961 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800829 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:49.800961 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:49.800876 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:10:53.800860512 +0000 UTC m=+10.146691986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:50.268333 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:50.268261 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:50.268333 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:50.268289 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:50.268512 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:50.268402 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:50.268578 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:50.268531 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:52.269232 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:52.269204 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:52.269646 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:52.269237 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:52.269646 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:52.269318 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:52.269646 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:52.269416 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:53.838321 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:53.838283 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:53.838767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:53.838336 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:53.838767 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838466 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:53.838767 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838529 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:01.838508734 +0000 UTC m=+18.184340181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:10:53.838938 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838900 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:10:53.838938 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838915 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:10:53.838938 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838929 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:53.839083 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:53.838971 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:01.838957487 +0000 UTC m=+18.184788936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:10:54.269510 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:54.269425 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:54.269668 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:54.269542 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:54.270026 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:54.270001 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:54.270148 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:54.270120 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:56.268156 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:56.268118 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:56.268156 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:56.268156 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:56.268637 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:56.268266 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:56.268708 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:56.268679 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:10:58.267971 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:58.267928 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:10:58.268374 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:10:58.267933 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:10:58.268374 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:58.268067 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:10:58.268374 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:10:58.268123 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:00.270701 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.270666 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:00.271208 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:00.270824 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:00.271270 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.271213 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:00.271328 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:00.271290 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:00.502836 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.502768 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-202.ec2.internal" podStartSLOduration=15.502751252 podStartE2EDuration="15.502751252s" podCreationTimestamp="2026-05-26 01:10:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:10:49.339435178 +0000 UTC m=+5.685266646" watchObservedRunningTime="2026-05-26 01:11:00.502751252 +0000 UTC m=+16.848582718" May 26 01:11:00.503011 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.502972 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dvxhq"] May 26 01:11:00.507605 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.507575 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.507739 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:00.507658 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:00.586013 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.585981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-kubelet-config\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.586119 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.586028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.586189 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.586174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-dbus\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687494 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.687450 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-dbus\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687664 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.687540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-kubelet-config\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687664 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.687558 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687766 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.687674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-kubelet-config\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687766 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:00.687674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/899b198e-4b22-4515-a64b-806f74124a0b-dbus\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:00.687766 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:00.687682 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:00.687884 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:00.687776 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:01.187760262 +0000 UTC m=+17.533591710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:01.190582 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:01.190538 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:01.190774 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.190742 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:01.190831 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.190808 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:02.190793363 +0000 UTC m=+18.536624808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:01.895860 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:01.895817 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:01.895899 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.895993 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.896016 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.896019 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.896114 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:17.896076905 +0000 UTC m=+34.241908362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.896027 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:11:01.896310 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:01.896197 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:17.896176764 +0000 UTC m=+34.242008227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:11:02.198650 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:02.198542 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:02.198818 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:02.198718 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:02.198818 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:02.198794 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:04.198775213 +0000 UTC m=+20.544606664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:02.268378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:02.268343 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:02.268378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:02.268368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:02.268378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:02.268343 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:02.268664 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:02.268499 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:02.268664 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:02.268553 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:02.268664 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:02.268617 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:04.212933 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:04.212895 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:04.213483 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:04.213070 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:04.213483 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:04.213157 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:08.21313753 +0000 UTC m=+24.558968991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:04.269141 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:04.269086 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:04.269307 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:04.269193 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:04.269307 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:04.269221 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:04.269307 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:04.269231 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:04.269452 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:04.269350 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:04.269452 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:04.269405 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:05.356469 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.356244 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" event={"ID":"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7","Type":"ContainerStarted","Data":"4b5000df6b32ab0a894f7c38b4510f10d80642a04db09c6db45cd89404ada260"} May 26 01:11:05.357706 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.357677 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxnnc" event={"ID":"a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb","Type":"ContainerStarted","Data":"84452c27425348eefd25773418d05097a311537c8482202acb88f353aab1997d"} May 26 01:11:05.360076 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.360054 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gvfj" event={"ID":"798d89c8-5ba9-42eb-87ef-bb26636057ff","Type":"ContainerStarted","Data":"53cb9de5bc06be758139049374943290a09757a152eba4bca4252fca9685d32d"} May 26 01:11:05.362283 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.362246 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" event={"ID":"aad28b33-d40a-4258-88b0-25841cb542c1","Type":"ContainerStarted","Data":"f74b859874d1bcdd96dab3df3f87424a6f6c5549714d4071652adcde5b5e4048"} May 26 01:11:05.364656 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.364630 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7g7f" event={"ID":"36c4134c-230f-411c-ba4f-44f5fb52c215","Type":"ContainerStarted","Data":"dbf477c403c32fe4dd833958f9b3d99b4175f098648b0aaaf9a248042a477610"} May 26 01:11:05.366225 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.366191 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k7k8b" event={"ID":"59afbbc1-4406-4bf3-a61e-65bdf8149809","Type":"ContainerStarted","Data":"43ae5d76bd7784db6119e4aee0f6abca382f4d74b97d2f50abc2ae82cc8e666e"} May 26 01:11:05.370175 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.370152 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"3e04ffb15acea7e184f5c8a26febeaa41fdaa70d234f7bf86c933d7821318be7"} May 26 01:11:05.373815 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.373776 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pxnnc" podStartSLOduration=3.450423243 podStartE2EDuration="21.373766042s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.089693518 +0000 UTC m=+3.435524965" lastFinishedPulling="2026-05-26 01:11:05.013036317 +0000 UTC m=+21.358867764" observedRunningTime="2026-05-26 01:11:05.373403829 +0000 UTC m=+21.719235296" watchObservedRunningTime="2026-05-26 01:11:05.373766042 +0000 UTC m=+21.719597508" May 26 01:11:05.398373 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.398332 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k7k8b" podStartSLOduration=3.500638362 podStartE2EDuration="21.398316558s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.079847314 +0000 UTC m=+3.425678772" lastFinishedPulling="2026-05-26 01:11:04.977525525 +0000 UTC m=+21.323356968" observedRunningTime="2026-05-26 01:11:05.385320214 +0000 UTC m=+21.731151682" watchObservedRunningTime="2026-05-26 01:11:05.398316558 +0000 UTC m=+21.744148020" May 26 01:11:05.398468 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.398404 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d7g7f" podStartSLOduration=3.5079720720000003 podStartE2EDuration="21.398400583s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.087117015 +0000 UTC m=+3.432948461" lastFinishedPulling="2026-05-26 01:11:04.977545524 +0000 UTC m=+21.323376972" observedRunningTime="2026-05-26 01:11:05.39800337 +0000 UTC m=+21.743834836" watchObservedRunningTime="2026-05-26 01:11:05.398400583 +0000 UTC m=+21.744232048" May 26 01:11:05.410722 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.410670 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8gvfj" podStartSLOduration=3.521213011 podStartE2EDuration="21.410650848s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.088083239 +0000 UTC m=+3.433914688" lastFinishedPulling="2026-05-26 01:11:04.97752107 +0000 UTC m=+21.323352525" observedRunningTime="2026-05-26 01:11:05.410473538 +0000 UTC m=+21.756305006" watchObservedRunningTime="2026-05-26 01:11:05.410650848 +0000 UTC m=+21.756482315" May 26 01:11:05.429725 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:05.429674 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fbd6l" podStartSLOduration=3.518399971 podStartE2EDuration="21.429658909s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.08874895 +0000 UTC m=+3.434580394" lastFinishedPulling="2026-05-26 01:11:05.000007863 +0000 UTC m=+21.345839332" observedRunningTime="2026-05-26 01:11:05.429340944 +0000 UTC m=+21.775172411" watchObservedRunningTime="2026-05-26 01:11:05.429658909 +0000 UTC m=+21.775490374" May 26 01:11:06.268640 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.268386 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:06.268867 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.268441 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:06.268867 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:06.268740 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:06.268867 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.268459 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:06.268867 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:06.268834 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:06.268867 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:06.268857 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:06.372890 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.372858 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="b713e531e50fa042a5dbd16c17f78f4f429a6171189530fb79a3c9acb39ad3d1" exitCode=0 May 26 01:11:06.373618 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.372935 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"b713e531e50fa042a5dbd16c17f78f4f429a6171189530fb79a3c9acb39ad3d1"} May 26 01:11:06.375346 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375328 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:11:06.375582 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375565 2568 generic.go:358] "Generic (PLEG): container finished" podID="761e4056-776c-44ae-a96e-526896775703" containerID="066fd71205452a3c52ed6a7b946b2476c16f0458426d833c5bafd73ee04a35cb" exitCode=1 May 26 01:11:06.375722 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375695 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"f91ab1d60260873785503683c603aa6638437fddd0e8e479bd31efeead70a549"} May 26 01:11:06.375788 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375733 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"2e04b19adcfe0f3fe003eb57d4d6b7c0e7d0373e490f3848ba16eed3a9ebd6ee"} May 26 01:11:06.375788 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375744 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"d14c13083aae221a0f3bb533ca9f63804e13ced1a5db8dbc00ee3974833ff5ba"} May 26 01:11:06.375788 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375752 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"56d28c350961446d2fef8cc0174aad18890eba5824a44b8dafb0592125ecf89c"} May 26 01:11:06.375788 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.375765 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerDied","Data":"066fd71205452a3c52ed6a7b946b2476c16f0458426d833c5bafd73ee04a35cb"} May 26 01:11:06.572288 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:06.572265 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 01:11:07.240287 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.240062 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T01:11:06.572288782Z","UUID":"df1f8133-8f12-4d4f-af45-22bbf2ad184f","Handler":null,"Name":"","Endpoint":""} May 26 01:11:07.242275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.242240 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 01:11:07.242275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.242274 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 01:11:07.378828 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.378782 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vjrcp" event={"ID":"e0146d55-9073-4601-8953-042c67ddaf53","Type":"ContainerStarted","Data":"07fd8691fbdbd5629000277371592d34ad70206682eafd1c02d2a4cfdfb6eae2"} May 26 01:11:07.380440 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.380414 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" event={"ID":"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7","Type":"ContainerStarted","Data":"8dc71edf3a99c5a53984884ceab48c529a004fc54588cf522fd6225ce59b5bc1"} May 26 01:11:07.392642 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.392589 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vjrcp" podStartSLOduration=5.470907297 podStartE2EDuration="23.392572212s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.083696027 +0000 UTC m=+3.429527475" lastFinishedPulling="2026-05-26 01:11:05.005360932 +0000 UTC m=+21.351192390" observedRunningTime="2026-05-26 01:11:07.391658754 +0000 UTC m=+23.737490220" watchObservedRunningTime="2026-05-26 01:11:07.392572212 +0000 UTC m=+23.738403693" May 26 01:11:07.433964 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.433927 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:11:07.434639 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:07.434621 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:11:08.243020 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.242709 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:08.243207 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:08.243053 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:08.243207 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:08.243142 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:16.24312143 +0000 UTC m=+32.588952884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:08.268466 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.268433 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:08.268638 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:08.268551 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:08.268638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.268558 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:08.268638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.268581 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:08.268801 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:08.268658 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:08.268801 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:08.268737 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:08.385796 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.385767 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:11:08.386221 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.386183 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"2e0d1524471cb82ee17378e9dcd35d4ba8045526333105492c50d397b53dd997"} May 26 01:11:08.388927 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.388510 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" event={"ID":"3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7","Type":"ContainerStarted","Data":"34126da29d8e02bad2fc5b3f5ffc43c59e5d663c14b79f1f7db2169adb855d81"} May 26 01:11:08.402660 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:08.402612 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gn9z" podStartSLOduration=3.9502729370000003 podStartE2EDuration="24.402597399s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.111710992 +0000 UTC m=+3.457542440" lastFinishedPulling="2026-05-26 01:11:07.564035457 +0000 UTC m=+23.909866902" observedRunningTime="2026-05-26 01:11:08.402340597 +0000 UTC m=+24.748172068" watchObservedRunningTime="2026-05-26 01:11:08.402597399 +0000 UTC m=+24.748428864" May 26 01:11:10.273979 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:10.273948 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:10.274697 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:10.274056 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:10.274697 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:10.274077 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:10.274697 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:10.273949 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:10.274697 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:10.274200 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:10.274697 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:10.274281 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:11.394849 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.394634 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="453779a864bdb5ec3751f6998d6644c7a29c87fb13813fc955304febdcfcb0ff" exitCode=0 May 26 01:11:11.395329 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.394674 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"453779a864bdb5ec3751f6998d6644c7a29c87fb13813fc955304febdcfcb0ff"} May 26 01:11:11.397904 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.397884 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:11:11.398303 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.398278 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"ae2313b88e5689cc4dc084f99b12aac584d4bc3bb6cad66bebd4252e77c5a5b7"} May 26 01:11:11.398645 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.398615 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:11.398728 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.398648 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:11.398792 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.398730 2568 scope.go:117] "RemoveContainer" containerID="066fd71205452a3c52ed6a7b946b2476c16f0458426d833c5bafd73ee04a35cb" May 26 01:11:11.415074 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:11.415053 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:12.270386 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.270360 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:12.270507 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.270360 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:12.270507 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.270457 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:12.270600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.270360 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:12.270600 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.270534 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:12.270600 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.270595 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:12.403662 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.403526 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:11:12.403971 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.403933 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" event={"ID":"761e4056-776c-44ae-a96e-526896775703","Type":"ContainerStarted","Data":"fb45f972025cf339d0edd4ba20265170955707e6805debe90e7a167536994fa3"} May 26 01:11:12.404313 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.404292 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:12.419047 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.418978 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:12.432406 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.430512 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" podStartSLOduration=10.276815629 podStartE2EDuration="28.430494541s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.111662184 +0000 UTC m=+3.457493627" lastFinishedPulling="2026-05-26 01:11:05.265341096 +0000 UTC m=+21.611172539" observedRunningTime="2026-05-26 01:11:12.429780721 +0000 UTC m=+28.775612187" watchObservedRunningTime="2026-05-26 01:11:12.430494541 +0000 UTC m=+28.776326008" May 26 01:11:12.457213 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.457178 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvxhq"] May 26 01:11:12.457358 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.457315 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:12.457432 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.457409 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:12.460748 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.460721 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8lcnj"] May 26 01:11:12.460927 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.460917 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:12.461067 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.461046 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:12.461718 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.461697 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9sllb"] May 26 01:11:12.461816 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:12.461801 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:12.461908 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:12.461890 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:13.198689 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:13.198642 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:11:13.198842 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:13.198800 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 01:11:13.199363 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:13.199343 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8gvfj" May 26 01:11:13.408155 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:13.408120 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="0dd9f54a9dff3dca219d47b9331439c03237ccec0c063bcaaee6215a3444ecd2" exitCode=0 May 26 01:11:13.408620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:13.408196 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"0dd9f54a9dff3dca219d47b9331439c03237ccec0c063bcaaee6215a3444ecd2"} May 26 01:11:14.270420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:14.270382 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:14.270609 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:14.270527 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:14.270998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:14.270975 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:14.271132 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:14.271111 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:14.271211 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:14.271182 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:14.271308 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:14.271290 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:14.412586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:14.412546 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="6ae8f1970a9271a766ce65879bfece6637bc6eb6c0d5cd89f655cb898fa2cc83" exitCode=0 May 26 01:11:14.413009 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:14.412617 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"6ae8f1970a9271a766ce65879bfece6637bc6eb6c0d5cd89f655cb898fa2cc83"} May 26 01:11:16.268284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:16.268252 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:16.268284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:16.268264 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:16.268981 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:16.268262 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:16.268981 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:16.268370 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvxhq" podUID="899b198e-4b22-4515-a64b-806f74124a0b" May 26 01:11:16.268981 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:16.268458 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8lcnj" podUID="96c69e1e-4e81-42a4-a126-18632305214b" May 26 01:11:16.268981 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:16.268540 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sllb" podUID="b5289ea7-a72e-4a58-8d63-641e8a0d5545" May 26 01:11:16.309158 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:16.309120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:16.309344 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:16.309221 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 01:11:16.309344 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:16.309304 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret podName:899b198e-4b22-4515-a64b-806f74124a0b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:32.309283559 +0000 UTC m=+48.655115008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret") pod "global-pull-secret-syncer-dvxhq" (UID: "899b198e-4b22-4515-a64b-806f74124a0b") : object "kube-system"/"original-pull-secret" not registered May 26 01:11:17.921473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:17.921385 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:17.921473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:17.921445 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921551 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921568 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921570 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921581 2568 projected.go:194] Error preparing data for projected volume kube-api-access-g8wjc for pod openshift-network-diagnostics/network-check-target-9sllb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921642 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc podName:b5289ea7-a72e-4a58-8d63-641e8a0d5545 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:49.921625818 +0000 UTC m=+66.267457266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8wjc" (UniqueName: "kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc") pod "network-check-target-9sllb" (UID: "b5289ea7-a72e-4a58-8d63-641e8a0d5545") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 01:11:17.922171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:17.921660 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:11:49.921650347 +0000 UTC m=+66.267481791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 01:11:17.992160 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:17.992116 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-202.ec2.internal" event="NodeReady" May 26 01:11:17.992327 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:17.992290 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 01:11:18.031757 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.031730 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xf6kz"] May 26 01:11:18.034989 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.034963 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rzxnz"] May 26 01:11:18.035208 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.035175 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.037494 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.037472 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.037703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.037681 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 01:11:18.037777 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.037701 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf7j4\"" May 26 01:11:18.038065 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.038045 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 01:11:18.039295 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.039275 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 01:11:18.039708 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.039504 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 01:11:18.039708 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.039543 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 01:11:18.039820 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.039758 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4xl9v\"" May 26 01:11:18.048251 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.048227 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xf6kz"] May 26 01:11:18.048359 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.048262 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rzxnz"] May 26 01:11:18.123664 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.123850 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90253730-09e3-4f2e-8c5a-294a34a85a4f-config-volume\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.123850 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90253730-09e3-4f2e-8c5a-294a34a85a4f-tmp-dir\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.123850 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjlc\" (UniqueName: \"kubernetes.io/projected/8f6a6674-5260-4618-b8bd-d6efe56141d3-kube-api-access-psjlc\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.123850 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.123850 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.123831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfmd\" (UniqueName: \"kubernetes.io/projected/90253730-09e3-4f2e-8c5a-294a34a85a4f-kube-api-access-vgfmd\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.224925 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.224837 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psjlc\" (UniqueName: \"kubernetes.io/projected/8f6a6674-5260-4618-b8bd-d6efe56141d3-kube-api-access-psjlc\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.224925 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.224887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.225171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.224989 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:18.225171 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225008 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfmd\" (UniqueName: \"kubernetes.io/projected/90253730-09e3-4f2e-8c5a-294a34a85a4f-kube-api-access-vgfmd\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.225171 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.225064 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:18.725041423 +0000 UTC m=+35.070872867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:18.225171 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225168 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.225378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225191 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90253730-09e3-4f2e-8c5a-294a34a85a4f-config-volume\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.225378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225216 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90253730-09e3-4f2e-8c5a-294a34a85a4f-tmp-dir\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.225378 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.225292 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:18.225378 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.225339 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:18.725328098 +0000 UTC m=+35.071159543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:18.225576 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225559 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90253730-09e3-4f2e-8c5a-294a34a85a4f-tmp-dir\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.225840 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.225823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90253730-09e3-4f2e-8c5a-294a34a85a4f-config-volume\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.237573 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.237544 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfmd\" (UniqueName: \"kubernetes.io/projected/90253730-09e3-4f2e-8c5a-294a34a85a4f-kube-api-access-vgfmd\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.237718 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.237617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjlc\" (UniqueName: \"kubernetes.io/projected/8f6a6674-5260-4618-b8bd-d6efe56141d3-kube-api-access-psjlc\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.268798 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.268612 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:18.268960 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.268612 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:18.269028 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.268676 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:18.271515 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.271493 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 01:11:18.271707 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.271688 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 01:11:18.271785 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.271712 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srh2n\"" May 26 01:11:18.271785 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.271736 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 01:11:18.271890 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.271699 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 01:11:18.272462 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.272439 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvgkt\"" May 26 01:11:18.729472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.729433 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:18.729665 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:18.729543 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:18.729665 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.729557 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:18.729665 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.729619 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:19.729600771 +0000 UTC m=+36.075432215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:18.729665 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.729634 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:18.729807 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:18.729676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:19.729665461 +0000 UTC m=+36.075496912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:19.737505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:19.737462 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:19.737973 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:19.737530 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:19.737973 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:19.737626 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:19.737973 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:19.737673 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:19.737973 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:19.737709 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:21.737687471 +0000 UTC m=+38.083518938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:19.737973 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:19.737734 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:21.737723139 +0000 UTC m=+38.083554589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:21.428496 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:21.428465 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="61bbc99dbf05e690014f4b4ae8cda3fecd3d911c3e2dca92c710f91a4277b06e" exitCode=0 May 26 01:11:21.428843 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:21.428507 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"61bbc99dbf05e690014f4b4ae8cda3fecd3d911c3e2dca92c710f91a4277b06e"} May 26 01:11:21.750908 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:21.750825 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:21.750908 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:21.750873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:21.751133 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:21.750963 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:21.751133 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:21.750985 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:21.751133 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:21.751020 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:25.751006993 +0000 UTC m=+42.096838438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:21.751133 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:21.751044 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:25.751028083 +0000 UTC m=+42.096859530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:22.432518 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:22.432488 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cb0e279-5346-4331-a42d-3e1e654b03f9" containerID="676e210265c29e5453d6e89f4f46f49d4df61062ad3fd9e6e850416ca618809a" exitCode=0 May 26 01:11:22.432862 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:22.432546 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerDied","Data":"676e210265c29e5453d6e89f4f46f49d4df61062ad3fd9e6e850416ca618809a"} May 26 01:11:23.437455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:23.437417 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" event={"ID":"6cb0e279-5346-4331-a42d-3e1e654b03f9","Type":"ContainerStarted","Data":"ee8e5b745f2bc173f7d64a24e9673ce92a493a21bd97a22c7f84c9381c77a560"} May 26 01:11:23.458990 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:23.458933 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s6h5n" podStartSLOduration=6.209784099 podStartE2EDuration="39.458917869s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:10:47.085620619 +0000 UTC m=+3.431452068" lastFinishedPulling="2026-05-26 01:11:20.334754394 +0000 UTC m=+36.680585838" observedRunningTime="2026-05-26 01:11:23.458326241 +0000 UTC m=+39.804157707" watchObservedRunningTime="2026-05-26 01:11:23.458917869 +0000 UTC m=+39.804749335" May 26 01:11:25.776745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:25.776703 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:25.777201 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:25.776781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:25.777201 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:25.776872 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:25.777201 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:25.776935 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:33.776919885 +0000 UTC m=+50.122751333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:25.777201 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:25.776876 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:25.777201 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:25.776967 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:33.776961909 +0000 UTC m=+50.122793353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:32.324060 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:32.324011 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:32.327777 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:32.327740 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/899b198e-4b22-4515-a64b-806f74124a0b-original-pull-secret\") pod \"global-pull-secret-syncer-dvxhq\" (UID: \"899b198e-4b22-4515-a64b-806f74124a0b\") " pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:32.395027 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:32.394983 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvxhq" May 26 01:11:32.567478 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:32.567446 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvxhq"] May 26 01:11:32.571090 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:11:32.571058 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899b198e_4b22_4515_a64b_806f74124a0b.slice/crio-925e3461db0e226d510366eea29a3757f94a4f232a4d69407fe31392b06181bf WatchSource:0}: Error finding container 925e3461db0e226d510366eea29a3757f94a4f232a4d69407fe31392b06181bf: Status 404 returned error can't find the container with id 925e3461db0e226d510366eea29a3757f94a4f232a4d69407fe31392b06181bf May 26 01:11:33.458264 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:33.458221 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvxhq" event={"ID":"899b198e-4b22-4515-a64b-806f74124a0b","Type":"ContainerStarted","Data":"925e3461db0e226d510366eea29a3757f94a4f232a4d69407fe31392b06181bf"} May 26 01:11:33.837722 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:33.837685 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:33.837918 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:33.837744 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:33.837918 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:33.837847 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:33.837918 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:33.837877 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:33.837918 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:33.837915 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:11:49.837898349 +0000 UTC m=+66.183729797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:33.838160 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:33.837930 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:11:49.837924205 +0000 UTC m=+66.183755649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:37.467001 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:37.466898 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvxhq" event={"ID":"899b198e-4b22-4515-a64b-806f74124a0b","Type":"ContainerStarted","Data":"8e6c07cd78f5d07727ba693f26652c63551d51be7647081a234659f548d6431f"} May 26 01:11:37.479939 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:37.479888 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvxhq" podStartSLOduration=32.885231586 podStartE2EDuration="37.479875562s" podCreationTimestamp="2026-05-26 01:11:00 +0000 UTC" firstStartedPulling="2026-05-26 01:11:32.572911692 +0000 UTC m=+48.918743136" lastFinishedPulling="2026-05-26 01:11:37.167555667 +0000 UTC m=+53.513387112" observedRunningTime="2026-05-26 01:11:37.4796746 +0000 UTC m=+53.825506068" watchObservedRunningTime="2026-05-26 01:11:37.479875562 +0000 UTC m=+53.825707028" May 26 01:11:44.424637 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:44.424605 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qdm2l" May 26 01:11:49.853317 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.853272 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:11:49.853810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.853330 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:11:49.853810 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.853416 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:11:49.853810 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.853473 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:11:49.853810 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.853479 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:21.853462951 +0000 UTC m=+98.199294395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:11:49.853810 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.853533 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:12:21.853517695 +0000 UTC m=+98.199349139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:11:49.954341 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.954297 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:49.954446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.954362 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:11:49.956754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.956733 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 01:11:49.956821 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.956770 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 01:11:49.964882 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.964861 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 01:11:49.964954 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:11:49.964926 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs podName:96c69e1e-4e81-42a4-a126-18632305214b nodeName:}" failed. No retries permitted until 2026-05-26 01:12:53.964908704 +0000 UTC m=+130.310740149 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs") pod "network-metrics-daemon-8lcnj" (UID: "96c69e1e-4e81-42a4-a126-18632305214b") : secret "metrics-daemon-secret" not found May 26 01:11:49.966722 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.966706 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 01:11:49.977773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:49.977752 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wjc\" (UniqueName: \"kubernetes.io/projected/b5289ea7-a72e-4a58-8d63-641e8a0d5545-kube-api-access-g8wjc\") pod \"network-check-target-9sllb\" (UID: \"b5289ea7-a72e-4a58-8d63-641e8a0d5545\") " pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:50.092254 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:50.092226 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pvgkt\"" May 26 01:11:50.100127 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:50.100109 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:50.232055 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:50.232026 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9sllb"] May 26 01:11:50.235280 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:11:50.235249 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5289ea7_a72e_4a58_8d63_641e8a0d5545.slice/crio-28636e0f596cf26d21eb558acc84dacde17a505207cc0279c081eaa1f444ca9a WatchSource:0}: Error finding container 28636e0f596cf26d21eb558acc84dacde17a505207cc0279c081eaa1f444ca9a: Status 404 returned error can't find the container with id 28636e0f596cf26d21eb558acc84dacde17a505207cc0279c081eaa1f444ca9a May 26 01:11:50.491269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:50.491186 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9sllb" event={"ID":"b5289ea7-a72e-4a58-8d63-641e8a0d5545","Type":"ContainerStarted","Data":"28636e0f596cf26d21eb558acc84dacde17a505207cc0279c081eaa1f444ca9a"} May 26 01:11:53.501556 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:53.501457 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9sllb" event={"ID":"b5289ea7-a72e-4a58-8d63-641e8a0d5545","Type":"ContainerStarted","Data":"f80dac353d75dff3903e1907c073e53ccc42316a8e648e52e9a57c1a5117a3b8"} May 26 01:11:53.501898 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:53.501681 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:11:53.516184 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:11:53.516134 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9sllb" podStartSLOduration=66.612600676 podStartE2EDuration="1m9.51611946s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:11:50.237177818 +0000 UTC m=+66.583009262" lastFinishedPulling="2026-05-26 01:11:53.140696601 +0000 UTC m=+69.486528046" observedRunningTime="2026-05-26 01:11:53.515543325 +0000 UTC m=+69.861374819" watchObservedRunningTime="2026-05-26 01:11:53.51611946 +0000 UTC m=+69.861950920" May 26 01:12:21.876177 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:21.876135 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:12:21.876632 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:21.876189 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:12:21.876632 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:21.876277 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 01:12:21.876632 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:21.876280 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 01:12:21.876632 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:21.876353 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls podName:90253730-09e3-4f2e-8c5a-294a34a85a4f nodeName:}" failed. No retries permitted until 2026-05-26 01:13:25.876338699 +0000 UTC m=+162.222170142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls") pod "dns-default-xf6kz" (UID: "90253730-09e3-4f2e-8c5a-294a34a85a4f") : secret "dns-default-metrics-tls" not found May 26 01:12:21.876632 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:21.876366 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert podName:8f6a6674-5260-4618-b8bd-d6efe56141d3 nodeName:}" failed. No retries permitted until 2026-05-26 01:13:25.876359992 +0000 UTC m=+162.222191436 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert") pod "ingress-canary-rzxnz" (UID: "8f6a6674-5260-4618-b8bd-d6efe56141d3") : secret "canary-serving-cert" not found May 26 01:12:23.131641 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.131599 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-n96tq"] May 26 01:12:23.134207 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.134182 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.136615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.136473 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 01:12:23.136615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.136492 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 01:12:23.136615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.136489 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 01:12:23.136615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.136548 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sfkdx\"" May 26 01:12:23.137271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.137255 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 01:12:23.141464 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.141332 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 01:12:23.143494 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.143473 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-n96tq"] May 26 01:12:23.186060 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.186023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-config\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.186289 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.186073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642df71f-8dd8-4419-b91b-df530f7394b5-serving-cert\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.186289 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.186143 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-trusted-ca\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.186289 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.186188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jqq\" (UniqueName: \"kubernetes.io/projected/642df71f-8dd8-4419-b91b-df530f7394b5-kube-api-access-q8jqq\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.228281 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.228250 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l"] May 26 01:12:23.229872 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.229853 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.232278 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.232254 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k2d8s\"" May 26 01:12:23.232278 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.232268 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 26 01:12:23.232455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.232255 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 26 01:12:23.232455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.232340 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 26 01:12:23.232455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.232372 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 26 01:12:23.234273 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.234254 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7"] May 26 01:12:23.235879 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.235859 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.237512 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.237489 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l"] May 26 01:12:23.238273 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.238114 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 26 01:12:23.238273 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.238130 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sqdjb\"" May 26 01:12:23.238273 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.238135 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 26 01:12:23.238445 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.238319 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 26 01:12:23.238909 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.238895 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 26 01:12:23.249025 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.248998 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7"] May 26 01:12:23.286634 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-config\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.286634 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgc2p\" (UniqueName: \"kubernetes.io/projected/5637e8ce-bd05-445f-a9f0-027037e8e611-kube-api-access-wgc2p\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286671 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642df71f-8dd8-4419-b91b-df530f7394b5-serving-cert\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286744 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-trusted-ca\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286793 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jqq\" (UniqueName: \"kubernetes.io/projected/642df71f-8dd8-4419-b91b-df530f7394b5-kube-api-access-q8jqq\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5637e8ce-bd05-445f-a9f0-027037e8e611-serving-cert\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vtw\" (UniqueName: \"kubernetes.io/projected/43c25ccd-9171-456e-b070-a165c302ca48-kube-api-access-22vtw\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.286899 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5637e8ce-bd05-445f-a9f0-027037e8e611-config\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.287210 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.286957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c25ccd-9171-456e-b070-a165c302ca48-config\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.287210 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.287037 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c25ccd-9171-456e-b070-a165c302ca48-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.287410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.287389 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-config\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.287599 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.287583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/642df71f-8dd8-4419-b91b-df530f7394b5-trusted-ca\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.289265 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.289242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/642df71f-8dd8-4419-b91b-df530f7394b5-serving-cert\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.294292 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.294272 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jqq\" (UniqueName: \"kubernetes.io/projected/642df71f-8dd8-4419-b91b-df530f7394b5-kube-api-access-q8jqq\") pod \"console-operator-76dff48d59-n96tq\" (UID: \"642df71f-8dd8-4419-b91b-df530f7394b5\") " pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.327675 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.327635 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l"] May 26 01:12:23.329521 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.329505 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" May 26 01:12:23.331665 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.331640 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jgc9b\"" May 26 01:12:23.334650 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.334628 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2"] May 26 01:12:23.336494 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.336472 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.339230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.339042 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 26 01:12:23.339230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.339062 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6mzjn\"" May 26 01:12:23.339230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.339123 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 26 01:12:23.339400 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.339387 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 26 01:12:23.340016 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.339997 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l"] May 26 01:12:23.346199 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.346176 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2"] May 26 01:12:23.388170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388046 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5637e8ce-bd05-445f-a9f0-027037e8e611-serving-cert\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.388170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388119 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22vtw\" (UniqueName: \"kubernetes.io/projected/43c25ccd-9171-456e-b070-a165c302ca48-kube-api-access-22vtw\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.388170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388150 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5637e8ce-bd05-445f-a9f0-027037e8e611-config\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388224 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c25ccd-9171-456e-b070-a165c302ca48-config\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cc5d\" (UniqueName: \"kubernetes.io/projected/0ba18d8c-0f90-4105-b1c1-80459bf1f16a-kube-api-access-2cc5d\") pod \"network-check-source-7f44b6dd87-mfg9l\" (UID: \"0ba18d8c-0f90-4105-b1c1-80459bf1f16a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388349 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c25ccd-9171-456e-b070-a165c302ca48-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388394 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgc2p\" (UniqueName: \"kubernetes.io/projected/5637e8ce-bd05-445f-a9f0-027037e8e611-kube-api-access-wgc2p\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.388446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xtc\" (UniqueName: \"kubernetes.io/projected/8f31582c-b319-46d8-a5cd-a87663039eb5-kube-api-access-27xtc\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.388836 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5637e8ce-bd05-445f-a9f0-027037e8e611-config\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.388886 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.388813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43c25ccd-9171-456e-b070-a165c302ca48-config\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.390572 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.390545 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5637e8ce-bd05-445f-a9f0-027037e8e611-serving-cert\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.390724 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.390630 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43c25ccd-9171-456e-b070-a165c302ca48-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.395650 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.395625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vtw\" (UniqueName: \"kubernetes.io/projected/43c25ccd-9171-456e-b070-a165c302ca48-kube-api-access-22vtw\") pod \"kube-storage-version-migrator-operator-565644f49-dmss7\" (UID: \"43c25ccd-9171-456e-b070-a165c302ca48\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.395787 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.395732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgc2p\" (UniqueName: \"kubernetes.io/projected/5637e8ce-bd05-445f-a9f0-027037e8e611-kube-api-access-wgc2p\") pod \"service-ca-operator-57b5b68b8-sw54l\" (UID: \"5637e8ce-bd05-445f-a9f0-027037e8e611\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.444270 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.444228 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:23.489077 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.489020 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.489268 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.489131 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cc5d\" (UniqueName: \"kubernetes.io/projected/0ba18d8c-0f90-4105-b1c1-80459bf1f16a-kube-api-access-2cc5d\") pod \"network-check-source-7f44b6dd87-mfg9l\" (UID: \"0ba18d8c-0f90-4105-b1c1-80459bf1f16a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" May 26 01:12:23.489268 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.489173 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27xtc\" (UniqueName: \"kubernetes.io/projected/8f31582c-b319-46d8-a5cd-a87663039eb5-kube-api-access-27xtc\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.489718 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:23.489666 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 01:12:23.489785 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:23.489752 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls podName:8f31582c-b319-46d8-a5cd-a87663039eb5 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:23.989728565 +0000 UTC m=+100.335560029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls") pod "cluster-samples-operator-697587599-rfwd2" (UID: "8f31582c-b319-46d8-a5cd-a87663039eb5") : secret "samples-operator-tls" not found May 26 01:12:23.497434 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.497357 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cc5d\" (UniqueName: \"kubernetes.io/projected/0ba18d8c-0f90-4105-b1c1-80459bf1f16a-kube-api-access-2cc5d\") pod \"network-check-source-7f44b6dd87-mfg9l\" (UID: \"0ba18d8c-0f90-4105-b1c1-80459bf1f16a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" May 26 01:12:23.497688 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.497669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xtc\" (UniqueName: \"kubernetes.io/projected/8f31582c-b319-46d8-a5cd-a87663039eb5-kube-api-access-27xtc\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.540062 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.540031 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" May 26 01:12:23.546757 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.546731 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" May 26 01:12:23.567427 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.567377 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-n96tq"] May 26 01:12:23.572608 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:23.572578 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642df71f_8dd8_4419_b91b_df530f7394b5.slice/crio-6c045434815a8612de4e398ad4fbe46296551c515cdd5771d193462cabe0cbe1 WatchSource:0}: Error finding container 6c045434815a8612de4e398ad4fbe46296551c515cdd5771d193462cabe0cbe1: Status 404 returned error can't find the container with id 6c045434815a8612de4e398ad4fbe46296551c515cdd5771d193462cabe0cbe1 May 26 01:12:23.638557 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.638473 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" May 26 01:12:23.672368 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.672327 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l"] May 26 01:12:23.676237 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:23.676191 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5637e8ce_bd05_445f_a9f0_027037e8e611.slice/crio-1c72920ba3600c7d2e29520e22c92a2d5d0bfe730e74da13b380b8b09f652a25 WatchSource:0}: Error finding container 1c72920ba3600c7d2e29520e22c92a2d5d0bfe730e74da13b380b8b09f652a25: Status 404 returned error can't find the container with id 1c72920ba3600c7d2e29520e22c92a2d5d0bfe730e74da13b380b8b09f652a25 May 26 01:12:23.687354 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.687330 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7"] May 26 01:12:23.764076 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.764046 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l"] May 26 01:12:23.767517 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:23.767475 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba18d8c_0f90_4105_b1c1_80459bf1f16a.slice/crio-b66d9673c4ef0518de418dd65f0d12cd6e3de83214dfe574eef02b1f30614177 WatchSource:0}: Error finding container b66d9673c4ef0518de418dd65f0d12cd6e3de83214dfe574eef02b1f30614177: Status 404 returned error can't find the container with id b66d9673c4ef0518de418dd65f0d12cd6e3de83214dfe574eef02b1f30614177 May 26 01:12:23.993943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:23.993858 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:23.994133 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:23.994037 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 01:12:23.994207 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:23.994143 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls podName:8f31582c-b319-46d8-a5cd-a87663039eb5 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:24.994120583 +0000 UTC m=+101.339952049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls") pod "cluster-samples-operator-697587599-rfwd2" (UID: "8f31582c-b319-46d8-a5cd-a87663039eb5") : secret "samples-operator-tls" not found May 26 01:12:24.506730 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.506460 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9sllb" May 26 01:12:24.560262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.560195 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" event={"ID":"5637e8ce-bd05-445f-a9f0-027037e8e611","Type":"ContainerStarted","Data":"1c72920ba3600c7d2e29520e22c92a2d5d0bfe730e74da13b380b8b09f652a25"} May 26 01:12:24.561835 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.561793 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" event={"ID":"642df71f-8dd8-4419-b91b-df530f7394b5","Type":"ContainerStarted","Data":"6c045434815a8612de4e398ad4fbe46296551c515cdd5771d193462cabe0cbe1"} May 26 01:12:24.564420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.564390 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" event={"ID":"43c25ccd-9171-456e-b070-a165c302ca48","Type":"ContainerStarted","Data":"073aa5506403c444e1f6aefde71865b32bdb319d34e522b60a90a25b5f8c9744"} May 26 01:12:24.567600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.567538 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" event={"ID":"0ba18d8c-0f90-4105-b1c1-80459bf1f16a","Type":"ContainerStarted","Data":"1d46d0efa85ed9a94e143fc5f8a077f25c81819cd5381ebdd788fd750fce9143"} May 26 01:12:24.567600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.567574 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" event={"ID":"0ba18d8c-0f90-4105-b1c1-80459bf1f16a","Type":"ContainerStarted","Data":"b66d9673c4ef0518de418dd65f0d12cd6e3de83214dfe574eef02b1f30614177"} May 26 01:12:24.582141 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:24.581884 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-mfg9l" podStartSLOduration=1.5818670670000001 podStartE2EDuration="1.581867067s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:12:24.581525988 +0000 UTC m=+100.927357454" watchObservedRunningTime="2026-05-26 01:12:24.581867067 +0000 UTC m=+100.927698534" May 26 01:12:25.003291 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:25.003240 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:25.003490 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:25.003415 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 01:12:25.003557 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:25.003498 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls podName:8f31582c-b319-46d8-a5cd-a87663039eb5 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:27.003475532 +0000 UTC m=+103.349306995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls") pod "cluster-samples-operator-697587599-rfwd2" (UID: "8f31582c-b319-46d8-a5cd-a87663039eb5") : secret "samples-operator-tls" not found May 26 01:12:27.020633 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.020532 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:27.021136 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:27.020718 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 01:12:27.021136 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:27.020805 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls podName:8f31582c-b319-46d8-a5cd-a87663039eb5 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:31.020783533 +0000 UTC m=+107.366614980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls") pod "cluster-samples-operator-697587599-rfwd2" (UID: "8f31582c-b319-46d8-a5cd-a87663039eb5") : secret "samples-operator-tls" not found May 26 01:12:27.576241 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.576210 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/0.log" May 26 01:12:27.576519 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.576261 2568 generic.go:358] "Generic (PLEG): container finished" podID="642df71f-8dd8-4419-b91b-df530f7394b5" containerID="f52e68300330a451dd57b04040bf739478d74c1c91b29a4c56c4bb2287aa5f6a" exitCode=255 May 26 01:12:27.576519 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.576360 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" event={"ID":"642df71f-8dd8-4419-b91b-df530f7394b5","Type":"ContainerDied","Data":"f52e68300330a451dd57b04040bf739478d74c1c91b29a4c56c4bb2287aa5f6a"} May 26 01:12:27.576657 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.576641 2568 scope.go:117] "RemoveContainer" containerID="f52e68300330a451dd57b04040bf739478d74c1c91b29a4c56c4bb2287aa5f6a" May 26 01:12:27.577912 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.577892 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" event={"ID":"43c25ccd-9171-456e-b070-a165c302ca48","Type":"ContainerStarted","Data":"4f8c3738679ad7ded8797aaab69b5b1fe72d22a1e5cf528a5445e2d996f6f97f"} May 26 01:12:27.579166 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.579143 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" event={"ID":"5637e8ce-bd05-445f-a9f0-027037e8e611","Type":"ContainerStarted","Data":"627f2e145df8662b7de466171c84c7bff4ba311a50798aa69aa3c578225b6fa3"} May 26 01:12:27.603905 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:27.603851 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" podStartSLOduration=1.623776728 podStartE2EDuration="4.603834007s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:23.679071291 +0000 UTC m=+100.024902735" lastFinishedPulling="2026-05-26 01:12:26.659128559 +0000 UTC m=+103.004960014" observedRunningTime="2026-05-26 01:12:27.602973868 +0000 UTC m=+103.948805334" watchObservedRunningTime="2026-05-26 01:12:27.603834007 +0000 UTC m=+103.949665475" May 26 01:12:28.583193 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/1.log" May 26 01:12:28.583572 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/0.log" May 26 01:12:28.583572 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583554 2568 generic.go:358] "Generic (PLEG): container finished" podID="642df71f-8dd8-4419-b91b-df530f7394b5" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" exitCode=255 May 26 01:12:28.583669 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583648 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" event={"ID":"642df71f-8dd8-4419-b91b-df530f7394b5","Type":"ContainerDied","Data":"c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5"} May 26 01:12:28.583705 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583688 2568 scope.go:117] "RemoveContainer" containerID="f52e68300330a451dd57b04040bf739478d74c1c91b29a4c56c4bb2287aa5f6a" May 26 01:12:28.583878 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.583858 2568 scope.go:117] "RemoveContainer" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" May 26 01:12:28.584140 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:28.584118 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:12:28.598919 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.598869 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" podStartSLOduration=2.638311519 podStartE2EDuration="5.598855256s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:23.695059701 +0000 UTC m=+100.040891145" lastFinishedPulling="2026-05-26 01:12:26.655603425 +0000 UTC m=+103.001434882" observedRunningTime="2026-05-26 01:12:27.616472284 +0000 UTC m=+103.962303762" watchObservedRunningTime="2026-05-26 01:12:28.598855256 +0000 UTC m=+104.944686722" May 26 01:12:28.625973 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:28.625946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k7k8b_59afbbc1-4406-4bf3-a61e-65bdf8149809/dns-node-resolver/0.log" May 26 01:12:29.547998 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.547963 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7"] May 26 01:12:29.552006 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.551987 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" May 26 01:12:29.554119 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.554083 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 26 01:12:29.554230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.554117 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dr2fg\"" May 26 01:12:29.554790 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.554774 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 26 01:12:29.559596 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.559568 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7"] May 26 01:12:29.587924 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.587902 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/1.log" May 26 01:12:29.588330 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.588315 2568 scope.go:117] "RemoveContainer" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" May 26 01:12:29.588510 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:29.588489 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:12:29.622426 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.622399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7g7f_36c4134c-230f-411c-ba4f-44f5fb52c215/node-ca/0.log" May 26 01:12:29.643988 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.643953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qn7t\" (UniqueName: \"kubernetes.io/projected/f3d24612-c7c4-464a-8ea3-a96f4e25346c-kube-api-access-2qn7t\") pod \"migrator-b985f5d89-78jb7\" (UID: \"f3d24612-c7c4-464a-8ea3-a96f4e25346c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" May 26 01:12:29.745278 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.745242 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qn7t\" (UniqueName: \"kubernetes.io/projected/f3d24612-c7c4-464a-8ea3-a96f4e25346c-kube-api-access-2qn7t\") pod \"migrator-b985f5d89-78jb7\" (UID: \"f3d24612-c7c4-464a-8ea3-a96f4e25346c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" May 26 01:12:29.753283 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.753249 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qn7t\" (UniqueName: \"kubernetes.io/projected/f3d24612-c7c4-464a-8ea3-a96f4e25346c-kube-api-access-2qn7t\") pod \"migrator-b985f5d89-78jb7\" (UID: \"f3d24612-c7c4-464a-8ea3-a96f4e25346c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" May 26 01:12:29.862011 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.861927 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" May 26 01:12:29.983416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:29.983383 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7"] May 26 01:12:29.986151 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:29.986124 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d24612_c7c4_464a_8ea3_a96f4e25346c.slice/crio-5921db22b480a853fa06730a8f976254ad4c84d414c8366478aabd47fd3bfa76 WatchSource:0}: Error finding container 5921db22b480a853fa06730a8f976254ad4c84d414c8366478aabd47fd3bfa76: Status 404 returned error can't find the container with id 5921db22b480a853fa06730a8f976254ad4c84d414c8366478aabd47fd3bfa76 May 26 01:12:30.591431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.591395 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" event={"ID":"f3d24612-c7c4-464a-8ea3-a96f4e25346c","Type":"ContainerStarted","Data":"5921db22b480a853fa06730a8f976254ad4c84d414c8366478aabd47fd3bfa76"} May 26 01:12:30.827839 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.827805 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rvlwr"] May 26 01:12:30.831037 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.831014 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:30.833525 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.833496 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 01:12:30.834372 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.834353 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 01:12:30.834473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.834376 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 01:12:30.834473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.834392 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 01:12:30.834473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.834355 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8bmp8\"" May 26 01:12:30.841757 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.839128 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rvlwr"] May 26 01:12:30.954104 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.954053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-key\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:30.954104 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.954091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-cabundle\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:30.954325 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:30.954256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69pcq\" (UniqueName: \"kubernetes.io/projected/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-kube-api-access-69pcq\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.055620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.055569 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69pcq\" (UniqueName: \"kubernetes.io/projected/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-kube-api-access-69pcq\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.055789 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.055686 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-key\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.055789 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.055715 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-cabundle\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.055789 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.055747 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:31.055958 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:31.055885 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 01:12:31.055958 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:31.055954 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls podName:8f31582c-b319-46d8-a5cd-a87663039eb5 nodeName:}" failed. No retries permitted until 2026-05-26 01:12:39.055935538 +0000 UTC m=+115.401766985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls") pod "cluster-samples-operator-697587599-rfwd2" (UID: "8f31582c-b319-46d8-a5cd-a87663039eb5") : secret "samples-operator-tls" not found May 26 01:12:31.056579 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.056499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-cabundle\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.058520 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.058494 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-signing-key\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.063643 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.063617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69pcq\" (UniqueName: \"kubernetes.io/projected/7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e-kube-api-access-69pcq\") pod \"service-ca-67d667c7d-rvlwr\" (UID: \"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e\") " pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.144918 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.144824 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" May 26 01:12:31.335384 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.335356 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rvlwr"] May 26 01:12:31.338249 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:31.338222 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5dbb3b_6e30_4cdc_9a09_88ab79429f8e.slice/crio-16dd2430a11777317cde72d2efb4307b26465f1e2c83c0f6b1f3d294253b1abb WatchSource:0}: Error finding container 16dd2430a11777317cde72d2efb4307b26465f1e2c83c0f6b1f3d294253b1abb: Status 404 returned error can't find the container with id 16dd2430a11777317cde72d2efb4307b26465f1e2c83c0f6b1f3d294253b1abb May 26 01:12:31.595252 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.595211 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" event={"ID":"f3d24612-c7c4-464a-8ea3-a96f4e25346c","Type":"ContainerStarted","Data":"411f25ce6fdea92b041a008c785a7e34142e50cee848f96eca87e85d4f2456c0"} May 26 01:12:31.595252 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.595257 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" event={"ID":"f3d24612-c7c4-464a-8ea3-a96f4e25346c","Type":"ContainerStarted","Data":"b6433156a0d7660da44c18fdec6a1252f43113694c2657ece3f244503db7cda8"} May 26 01:12:31.596611 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.596586 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" event={"ID":"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e","Type":"ContainerStarted","Data":"0b0def9dedf64004c232d709e040d4457d3f261ccde9594991bdaad7edb3e309"} May 26 01:12:31.596715 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.596616 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" event={"ID":"7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e","Type":"ContainerStarted","Data":"16dd2430a11777317cde72d2efb4307b26465f1e2c83c0f6b1f3d294253b1abb"} May 26 01:12:31.610832 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.610791 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-78jb7" podStartSLOduration=1.341582454 podStartE2EDuration="2.610779913s" podCreationTimestamp="2026-05-26 01:12:29 +0000 UTC" firstStartedPulling="2026-05-26 01:12:29.988025102 +0000 UTC m=+106.333856546" lastFinishedPulling="2026-05-26 01:12:31.257222555 +0000 UTC m=+107.603054005" observedRunningTime="2026-05-26 01:12:31.609746263 +0000 UTC m=+107.955577733" watchObservedRunningTime="2026-05-26 01:12:31.610779913 +0000 UTC m=+107.956611380" May 26 01:12:31.623493 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:31.623449 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-rvlwr" podStartSLOduration=1.623435426 podStartE2EDuration="1.623435426s" podCreationTimestamp="2026-05-26 01:12:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:12:31.622990928 +0000 UTC m=+107.968822393" watchObservedRunningTime="2026-05-26 01:12:31.623435426 +0000 UTC m=+107.969266892" May 26 01:12:33.445144 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:33.445084 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:33.445144 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:33.445147 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:33.445672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:33.445602 2568 scope.go:117] "RemoveContainer" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" May 26 01:12:33.445834 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:33.445812 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:12:39.122417 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:39.122375 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:39.124884 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:39.124859 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f31582c-b319-46d8-a5cd-a87663039eb5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rfwd2\" (UID: \"8f31582c-b319-46d8-a5cd-a87663039eb5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:39.247450 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:39.247413 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" May 26 01:12:39.368478 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:39.368434 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2"] May 26 01:12:39.618000 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:39.617966 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" event={"ID":"8f31582c-b319-46d8-a5cd-a87663039eb5","Type":"ContainerStarted","Data":"60dadede34668d22976547b26c1941c18ec6c3b9e628b58a0de08a21366082cf"} May 26 01:12:42.630337 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:42.630296 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" event={"ID":"8f31582c-b319-46d8-a5cd-a87663039eb5","Type":"ContainerStarted","Data":"da40c4a196a3e3fbf0b2424e9a817199edcedb5218d72431f5116cc044759505"} May 26 01:12:42.630739 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:42.630345 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" event={"ID":"8f31582c-b319-46d8-a5cd-a87663039eb5","Type":"ContainerStarted","Data":"1edff0106186ce7f8f28ad04cb4e124fb5729dad33ed36adb813287efb994e51"} May 26 01:12:42.645660 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:42.645605 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rfwd2" podStartSLOduration=17.305966165 podStartE2EDuration="19.645589108s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:39.407638861 +0000 UTC m=+115.753470305" lastFinishedPulling="2026-05-26 01:12:41.747261801 +0000 UTC m=+118.093093248" observedRunningTime="2026-05-26 01:12:42.645215822 +0000 UTC m=+118.991047480" watchObservedRunningTime="2026-05-26 01:12:42.645589108 +0000 UTC m=+118.991420574" May 26 01:12:48.268733 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.268698 2568 scope.go:117] "RemoveContainer" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" May 26 01:12:48.649456 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.649429 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:12:48.649774 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.649760 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/1.log" May 26 01:12:48.649824 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.649795 2568 generic.go:358] "Generic (PLEG): container finished" podID="642df71f-8dd8-4419-b91b-df530f7394b5" containerID="7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5" exitCode=255 May 26 01:12:48.649866 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.649838 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" event={"ID":"642df71f-8dd8-4419-b91b-df530f7394b5","Type":"ContainerDied","Data":"7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5"} May 26 01:12:48.649900 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.649874 2568 scope.go:117] "RemoveContainer" containerID="c84ac9873cebf6a62ff3be35382a5760625cc0bd48efac2318a37669f82c7cf5" May 26 01:12:48.650269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:48.650252 2568 scope.go:117] "RemoveContainer" containerID="7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5" May 26 01:12:48.650471 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:48.650450 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:12:49.653600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:49.653573 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:12:52.856465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.856435 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v27vq"] May 26 01:12:52.860963 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.860942 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:52.863524 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.863502 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 01:12:52.868671 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.865346 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 01:12:52.868671 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.865705 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 01:12:52.868671 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.866053 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4ktw\"" May 26 01:12:52.868671 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.866089 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 01:12:52.872726 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:52.872682 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v27vq"] May 26 01:12:53.028228 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.028182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f94fb629-5e99-4f09-b676-475cd0d10048-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.028399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.028248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f94fb629-5e99-4f09-b676-475cd0d10048-crio-socket\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.028399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.028269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hzx\" (UniqueName: \"kubernetes.io/projected/f94fb629-5e99-4f09-b676-475cd0d10048-kube-api-access-c6hzx\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.028399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.028303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f94fb629-5e99-4f09-b676-475cd0d10048-data-volume\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.028399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.028340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f94fb629-5e99-4f09-b676-475cd0d10048-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129266 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f94fb629-5e99-4f09-b676-475cd0d10048-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129328 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f94fb629-5e99-4f09-b676-475cd0d10048-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129363 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f94fb629-5e99-4f09-b676-475cd0d10048-crio-socket\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129608 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hzx\" (UniqueName: \"kubernetes.io/projected/f94fb629-5e99-4f09-b676-475cd0d10048-kube-api-access-c6hzx\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129608 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129417 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f94fb629-5e99-4f09-b676-475cd0d10048-data-volume\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129608 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f94fb629-5e99-4f09-b676-475cd0d10048-crio-socket\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129714 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f94fb629-5e99-4f09-b676-475cd0d10048-data-volume\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.129866 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.129838 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f94fb629-5e99-4f09-b676-475cd0d10048-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.131801 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.131780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f94fb629-5e99-4f09-b676-475cd0d10048-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.136971 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.136944 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hzx\" (UniqueName: \"kubernetes.io/projected/f94fb629-5e99-4f09-b676-475cd0d10048-kube-api-access-c6hzx\") pod \"insights-runtime-extractor-v27vq\" (UID: \"f94fb629-5e99-4f09-b676-475cd0d10048\") " pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.174275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.174246 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v27vq" May 26 01:12:53.321711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.321678 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v27vq"] May 26 01:12:53.324588 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:53.324562 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94fb629_5e99_4f09_b676_475cd0d10048.slice/crio-1f006a9f9b8e40faba66777b257c69ee5be4c4125df68912fc7f76a9c4c775a9 WatchSource:0}: Error finding container 1f006a9f9b8e40faba66777b257c69ee5be4c4125df68912fc7f76a9c4c775a9: Status 404 returned error can't find the container with id 1f006a9f9b8e40faba66777b257c69ee5be4c4125df68912fc7f76a9c4c775a9 May 26 01:12:53.444672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.444634 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:53.444672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.444672 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:12:53.445062 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.445039 2568 scope.go:117] "RemoveContainer" containerID="7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5" May 26 01:12:53.445281 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:12:53.445261 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:12:53.663587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.663507 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v27vq" event={"ID":"f94fb629-5e99-4f09-b676-475cd0d10048","Type":"ContainerStarted","Data":"5ae14e5f712bcf0f6d87a62a672ad0e02b8f0c887c1f9f4e03777473aecf9eb6"} May 26 01:12:53.663587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:53.663540 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v27vq" event={"ID":"f94fb629-5e99-4f09-b676-475cd0d10048","Type":"ContainerStarted","Data":"1f006a9f9b8e40faba66777b257c69ee5be4c4125df68912fc7f76a9c4c775a9"} May 26 01:12:54.036796 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.036758 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:12:54.039238 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.039204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96c69e1e-4e81-42a4-a126-18632305214b-metrics-certs\") pod \"network-metrics-daemon-8lcnj\" (UID: \"96c69e1e-4e81-42a4-a126-18632305214b\") " pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:12:54.282793 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.282710 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srh2n\"" May 26 01:12:54.291170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.291137 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8lcnj" May 26 01:12:54.424235 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.424202 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8lcnj"] May 26 01:12:54.426838 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:12:54.426805 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c69e1e_4e81_42a4_a126_18632305214b.slice/crio-d57c8cd83aac3d473affe8d46a74f511d4c7969d7d4db895aee8c7a03bdc7822 WatchSource:0}: Error finding container d57c8cd83aac3d473affe8d46a74f511d4c7969d7d4db895aee8c7a03bdc7822: Status 404 returned error can't find the container with id d57c8cd83aac3d473affe8d46a74f511d4c7969d7d4db895aee8c7a03bdc7822 May 26 01:12:54.668281 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.668220 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v27vq" event={"ID":"f94fb629-5e99-4f09-b676-475cd0d10048","Type":"ContainerStarted","Data":"8053b6ffb008b0e865b433054856ea1ffe30e9e333c5734c4218f26f2287182f"} May 26 01:12:54.669312 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:54.669281 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lcnj" event={"ID":"96c69e1e-4e81-42a4-a126-18632305214b","Type":"ContainerStarted","Data":"d57c8cd83aac3d473affe8d46a74f511d4c7969d7d4db895aee8c7a03bdc7822"} May 26 01:12:55.674001 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:55.673962 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v27vq" event={"ID":"f94fb629-5e99-4f09-b676-475cd0d10048","Type":"ContainerStarted","Data":"c7dc84930ffde49640479034ba749be3db1a7a443fa46432dfbf382de8534086"} May 26 01:12:55.691491 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:55.691443 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v27vq" podStartSLOduration=1.898564512 podStartE2EDuration="3.691426431s" podCreationTimestamp="2026-05-26 01:12:52 +0000 UTC" firstStartedPulling="2026-05-26 01:12:53.378309018 +0000 UTC m=+129.724140462" lastFinishedPulling="2026-05-26 01:12:55.171170938 +0000 UTC m=+131.517002381" observedRunningTime="2026-05-26 01:12:55.690374731 +0000 UTC m=+132.036206223" watchObservedRunningTime="2026-05-26 01:12:55.691426431 +0000 UTC m=+132.037257897" May 26 01:12:56.677686 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:56.677633 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lcnj" event={"ID":"96c69e1e-4e81-42a4-a126-18632305214b","Type":"ContainerStarted","Data":"8ab56347e12d95c095b7a9b726ac31c1bcb0caa4294adc4bf3c2e55b67c4d032"} May 26 01:12:56.677686 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:56.677679 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8lcnj" event={"ID":"96c69e1e-4e81-42a4-a126-18632305214b","Type":"ContainerStarted","Data":"3f905b2518d70ce376e8de6dca59ca52fced9d0e0daad7deb84b4827ccbfe38d"} May 26 01:12:56.693625 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:12:56.693563 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8lcnj" podStartSLOduration=130.863975859 podStartE2EDuration="2m12.693522346s" podCreationTimestamp="2026-05-26 01:10:44 +0000 UTC" firstStartedPulling="2026-05-26 01:12:54.429053658 +0000 UTC m=+130.774885107" lastFinishedPulling="2026-05-26 01:12:56.25860015 +0000 UTC m=+132.604431594" observedRunningTime="2026-05-26 01:12:56.693060345 +0000 UTC m=+133.038891807" watchObservedRunningTime="2026-05-26 01:12:56.693522346 +0000 UTC m=+133.039353812" May 26 01:13:00.853711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.853671 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb"] May 26 01:13:00.856859 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.856843 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:00.861249 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.861225 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 01:13:00.861424 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.861321 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 01:13:00.862218 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.862198 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zkc2s\"" May 26 01:13:00.862343 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.862225 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 01:13:00.862343 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.862237 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 01:13:00.862343 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.862198 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 01:13:00.864588 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.864567 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb"] May 26 01:13:00.993303 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.993257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:00.993489 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.993312 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:00.993489 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.993386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgq4\" (UniqueName: \"kubernetes.io/projected/8f57a7d7-bd80-4d98-b75f-7118a4154a25-kube-api-access-hqgq4\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:00.993489 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:00.993433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f57a7d7-bd80-4d98-b75f-7118a4154a25-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.093811 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.093769 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f57a7d7-bd80-4d98-b75f-7118a4154a25-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.093988 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.093870 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.093988 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.093897 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.093988 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.093917 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgq4\" (UniqueName: \"kubernetes.io/projected/8f57a7d7-bd80-4d98-b75f-7118a4154a25-kube-api-access-hqgq4\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.094566 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.094537 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f57a7d7-bd80-4d98-b75f-7118a4154a25-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.096580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.096558 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.096686 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.096610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f57a7d7-bd80-4d98-b75f-7118a4154a25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.102858 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.102834 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgq4\" (UniqueName: \"kubernetes.io/projected/8f57a7d7-bd80-4d98-b75f-7118a4154a25-kube-api-access-hqgq4\") pod \"prometheus-operator-7779bbdd78-r2wsb\" (UID: \"8f57a7d7-bd80-4d98-b75f-7118a4154a25\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.170498 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.170410 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" May 26 01:13:01.292533 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.292508 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb"] May 26 01:13:01.294637 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:01.294605 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f57a7d7_bd80_4d98_b75f_7118a4154a25.slice/crio-794583f1576e08cb129f6a905b0192a4d883d4249d8b73b7eabd5614e5d9a884 WatchSource:0}: Error finding container 794583f1576e08cb129f6a905b0192a4d883d4249d8b73b7eabd5614e5d9a884: Status 404 returned error can't find the container with id 794583f1576e08cb129f6a905b0192a4d883d4249d8b73b7eabd5614e5d9a884 May 26 01:13:01.692791 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:01.692752 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" event={"ID":"8f57a7d7-bd80-4d98-b75f-7118a4154a25","Type":"ContainerStarted","Data":"794583f1576e08cb129f6a905b0192a4d883d4249d8b73b7eabd5614e5d9a884"} May 26 01:13:03.701066 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:03.701021 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" event={"ID":"8f57a7d7-bd80-4d98-b75f-7118a4154a25","Type":"ContainerStarted","Data":"693b9e99add72fff669908d1d1d1060788c2299e1fec86faffa6fe241057455d"} May 26 01:13:03.701066 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:03.701067 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" event={"ID":"8f57a7d7-bd80-4d98-b75f-7118a4154a25","Type":"ContainerStarted","Data":"fb4089d6c247931ceb5edc2494c206d50310720737639044babfb1ef14271853"} May 26 01:13:03.717238 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:03.717166 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-r2wsb" podStartSLOduration=2.239844326 podStartE2EDuration="3.717146164s" podCreationTimestamp="2026-05-26 01:13:00 +0000 UTC" firstStartedPulling="2026-05-26 01:13:01.29644557 +0000 UTC m=+137.642277014" lastFinishedPulling="2026-05-26 01:13:02.773747391 +0000 UTC m=+139.119578852" observedRunningTime="2026-05-26 01:13:03.715652885 +0000 UTC m=+140.061484350" watchObservedRunningTime="2026-05-26 01:13:03.717146164 +0000 UTC m=+140.062977632" May 26 01:13:05.196920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.196882 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9cjnf"] May 26 01:13:05.200764 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.200744 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.203274 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.203168 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 01:13:05.203274 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.203168 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 01:13:05.203466 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.203350 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 01:13:05.203671 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.203650 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bkgsh\"" May 26 01:13:05.326859 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.326817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.326894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jst2t\" (UniqueName: \"kubernetes.io/projected/036a1e3b-38d1-459d-b561-9d6589a18d21-kube-api-access-jst2t\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.326926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-textfile\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.326956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.326984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327253 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.327052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-sys\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327253 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.327076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-wtmp\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327253 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.327201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-metrics-client-ca\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.327253 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.327239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-root\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.427947 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.427915 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-textfile\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.427947 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.427954 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428195 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.427972 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428195 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:13:05.428110 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 26 01:13:05.428195 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428139 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-sys\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428195 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428167 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-wtmp\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428195 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:13:05.428182 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls podName:036a1e3b-38d1-459d-b561-9d6589a18d21 nodeName:}" failed. No retries permitted until 2026-05-26 01:13:05.928163287 +0000 UTC m=+142.273994731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls") pod "node-exporter-9cjnf" (UID: "036a1e3b-38d1-459d-b561-9d6589a18d21") : secret "node-exporter-tls" not found May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428254 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-metrics-client-ca\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428284 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-root\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-sys\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-root\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-wtmp\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428422 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-textfile\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428785 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-accelerators-collector-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.428785 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.428614 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jst2t\" (UniqueName: \"kubernetes.io/projected/036a1e3b-38d1-459d-b561-9d6589a18d21-kube-api-access-jst2t\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.429054 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.429029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/036a1e3b-38d1-459d-b561-9d6589a18d21-metrics-client-ca\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.431134 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.431089 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.436397 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.436375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jst2t\" (UniqueName: \"kubernetes.io/projected/036a1e3b-38d1-459d-b561-9d6589a18d21-kube-api-access-jst2t\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.932061 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.932026 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:05.934501 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:05.934478 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/036a1e3b-38d1-459d-b561-9d6589a18d21-node-exporter-tls\") pod \"node-exporter-9cjnf\" (UID: \"036a1e3b-38d1-459d-b561-9d6589a18d21\") " pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:06.111311 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.111260 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9cjnf" May 26 01:13:06.120171 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:06.120139 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036a1e3b_38d1_459d_b561_9d6589a18d21.slice/crio-ec29cc45aa6fb51799450ff03d854ed720d49bd1f6b667057fcc1d716d2461e6 WatchSource:0}: Error finding container ec29cc45aa6fb51799450ff03d854ed720d49bd1f6b667057fcc1d716d2461e6: Status 404 returned error can't find the container with id ec29cc45aa6fb51799450ff03d854ed720d49bd1f6b667057fcc1d716d2461e6 May 26 01:13:06.248191 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.248090 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:13:06.254233 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.254211 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256702 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256745 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256772 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256789 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256822 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zh54m\"" May 26 01:13:06.256854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256747 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 01:13:06.257271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256771 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 01:13:06.257271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.256960 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 01:13:06.257271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.257131 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 01:13:06.257271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.257157 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 01:13:06.261860 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.261838 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:13:06.268127 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.268107 2568 scope.go:117] "RemoveContainer" containerID="7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5" May 26 01:13:06.268296 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:13:06.268278 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-n96tq_openshift-console-operator(642df71f-8dd8-4419-b91b-df530f7394b5)\"" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podUID="642df71f-8dd8-4419-b91b-df530f7394b5" May 26 01:13:06.436045 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436258 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436258 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436258 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436258 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436486 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbv7h\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.436598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.436566 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537601 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537471 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537601 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537595 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537825 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537630 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537825 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537660 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537825 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537706 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537969 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537904 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.537969 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.537940 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538072 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538017 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538072 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538055 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538080 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538144 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbv7h\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538177 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538203 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538531 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538506 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.538904 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.538878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.539452 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.539426 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.541735 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.541689 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.541881 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.541853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.542604 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.542579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.542792 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.542767 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.542792 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.542782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.543113 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.543055 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.544320 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.544245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.544537 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.544514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.544691 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.544664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.546370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.546350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbv7h\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h\") pod \"alertmanager-main-0\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.565640 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.565612 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:13:06.710725 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.710683 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cjnf" event={"ID":"036a1e3b-38d1-459d-b561-9d6589a18d21","Type":"ContainerStarted","Data":"ec29cc45aa6fb51799450ff03d854ed720d49bd1f6b667057fcc1d716d2461e6"} May 26 01:13:06.714704 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:06.714672 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:13:06.717946 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:06.717916 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd464863_d342_4ce8_9c91_096442df9646.slice/crio-6482acf1d630a2f953c836af0df0cb2f6ffaf62f0a962d6229bd96d6ffd01b5e WatchSource:0}: Error finding container 6482acf1d630a2f953c836af0df0cb2f6ffaf62f0a962d6229bd96d6ffd01b5e: Status 404 returned error can't find the container with id 6482acf1d630a2f953c836af0df0cb2f6ffaf62f0a962d6229bd96d6ffd01b5e May 26 01:13:07.167488 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.167450 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54c5f66c79-bs9mt"] May 26 01:13:07.171423 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.171358 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.173936 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.173906 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 26 01:13:07.173936 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.173930 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c3mtm7e5vg1ol\"" May 26 01:13:07.174167 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.173949 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 26 01:13:07.174167 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.173983 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 26 01:13:07.174275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.174214 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 26 01:13:07.174360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.174342 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 26 01:13:07.174734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.174465 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rflns\"" May 26 01:13:07.181622 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.181600 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54c5f66c79-bs9mt"] May 26 01:13:07.245084 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58884f46-540c-4cfc-93eb-daa984272ed0-metrics-client-ca\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-grpc-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gbv9\" (UniqueName: \"kubernetes.io/projected/58884f46-540c-4cfc-93eb-daa984272ed0-kube-api-access-6gbv9\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.245542 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.245434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.345900 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.345863 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.345923 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.345943 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58884f46-540c-4cfc-93eb-daa984272ed0-metrics-client-ca\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.345964 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.346011 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-grpc-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.346049 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gbv9\" (UniqueName: \"kubernetes.io/projected/58884f46-540c-4cfc-93eb-daa984272ed0-kube-api-access-6gbv9\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.346119 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.346360 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.346144 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.347078 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.347023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58884f46-540c-4cfc-93eb-daa984272ed0-metrics-client-ca\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349228 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349228 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349202 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349403 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349496 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349478 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-grpc-tls\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349653 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.349800 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.349785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58884f46-540c-4cfc-93eb-daa984272ed0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.353962 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.353941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gbv9\" (UniqueName: \"kubernetes.io/projected/58884f46-540c-4cfc-93eb-daa984272ed0-kube-api-access-6gbv9\") pod \"thanos-querier-54c5f66c79-bs9mt\" (UID: \"58884f46-540c-4cfc-93eb-daa984272ed0\") " pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.527349 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.527303 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:07.665895 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.665730 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54c5f66c79-bs9mt"] May 26 01:13:07.668985 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:07.668949 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58884f46_540c_4cfc_93eb_daa984272ed0.slice/crio-c2dad346fe5fbb31901b18b39801352790b46a35c67d9ce2091aeaed107c8a31 WatchSource:0}: Error finding container c2dad346fe5fbb31901b18b39801352790b46a35c67d9ce2091aeaed107c8a31: Status 404 returned error can't find the container with id c2dad346fe5fbb31901b18b39801352790b46a35c67d9ce2091aeaed107c8a31 May 26 01:13:07.716456 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.716417 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"6482acf1d630a2f953c836af0df0cb2f6ffaf62f0a962d6229bd96d6ffd01b5e"} May 26 01:13:07.717778 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.717748 2568 generic.go:358] "Generic (PLEG): container finished" podID="036a1e3b-38d1-459d-b561-9d6589a18d21" containerID="fb11011fbda7034c1258216e999197e75a9adff51e8cfe458f674a1089fd54ad" exitCode=0 May 26 01:13:07.717911 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.717831 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cjnf" event={"ID":"036a1e3b-38d1-459d-b561-9d6589a18d21","Type":"ContainerDied","Data":"fb11011fbda7034c1258216e999197e75a9adff51e8cfe458f674a1089fd54ad"} May 26 01:13:07.718926 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:07.718905 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"c2dad346fe5fbb31901b18b39801352790b46a35c67d9ce2091aeaed107c8a31"} May 26 01:13:08.726894 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:08.726836 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cjnf" event={"ID":"036a1e3b-38d1-459d-b561-9d6589a18d21","Type":"ContainerStarted","Data":"d2113e8e7c6b8a4d3f86a63e6c6f279e10353a48c0296f2bd5bd6a4ff6e68baa"} May 26 01:13:08.726894 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:08.726879 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9cjnf" event={"ID":"036a1e3b-38d1-459d-b561-9d6589a18d21","Type":"ContainerStarted","Data":"fa15be934e6dab972846590b0eef85ac4b17cd76f219fb0b026db1754bb167c8"} May 26 01:13:08.728444 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:08.728401 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92" exitCode=0 May 26 01:13:08.728577 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:08.728452 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92"} May 26 01:13:08.753186 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:08.753030 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9cjnf" podStartSLOduration=2.847829099 podStartE2EDuration="3.753015913s" podCreationTimestamp="2026-05-26 01:13:05 +0000 UTC" firstStartedPulling="2026-05-26 01:13:06.122359922 +0000 UTC m=+142.468191366" lastFinishedPulling="2026-05-26 01:13:07.027546726 +0000 UTC m=+143.373378180" observedRunningTime="2026-05-26 01:13:08.751366904 +0000 UTC m=+145.097198370" watchObservedRunningTime="2026-05-26 01:13:08.753015913 +0000 UTC m=+145.098847379" May 26 01:13:10.736472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:10.736436 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"baf78af102863ba4037444ef9b6e7593e0515a2e79fd235d3bcfc6e1d8566bfd"} May 26 01:13:10.736472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:10.736478 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"11cc7d021c9353875128c4749a3dd75320adebe331a8a1893f533a9956aacc16"} May 26 01:13:10.736907 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:10.736488 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"8ff16e3229811015c034c80b16d62e887171bf12af9a79ba50cefc4ea1579cf2"} May 26 01:13:11.743079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.742933 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"30a58fd687bfed6d7a2677ce2a733f8499dd9b30d252e8cdb106b0eeb5400c73"} May 26 01:13:11.743079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.742981 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"bf4823929a9e7a0e70df2c0ab1f5549620c34af3c2ec21b33abd9731b98d450f"} May 26 01:13:11.743079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.742993 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" event={"ID":"58884f46-540c-4cfc-93eb-daa984272ed0","Type":"ContainerStarted","Data":"0960222876d538488881ec847a93e18975185a3ad3af15769b8c5f49e19de93b"} May 26 01:13:11.746513 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746486 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a"} May 26 01:13:11.746513 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746515 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5"} May 26 01:13:11.746676 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746524 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f"} May 26 01:13:11.746676 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746532 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796"} May 26 01:13:11.746676 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746541 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783"} May 26 01:13:11.746676 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.746549 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerStarted","Data":"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b"} May 26 01:13:11.769293 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:11.769250 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" podStartSLOduration=1.396508292 podStartE2EDuration="4.769229732s" podCreationTimestamp="2026-05-26 01:13:07 +0000 UTC" firstStartedPulling="2026-05-26 01:13:07.6710743 +0000 UTC m=+144.016905744" lastFinishedPulling="2026-05-26 01:13:11.043795736 +0000 UTC m=+147.389627184" observedRunningTime="2026-05-26 01:13:11.767063334 +0000 UTC m=+148.112894825" watchObservedRunningTime="2026-05-26 01:13:11.769229732 +0000 UTC m=+148.115061200" May 26 01:13:12.749749 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:12.749711 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:18.757726 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:18.757698 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54c5f66c79-bs9mt" May 26 01:13:18.779321 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:18.779274 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.455978388 podStartE2EDuration="12.779259546s" podCreationTimestamp="2026-05-26 01:13:06 +0000 UTC" firstStartedPulling="2026-05-26 01:13:06.719906435 +0000 UTC m=+143.065737888" lastFinishedPulling="2026-05-26 01:13:11.043187595 +0000 UTC m=+147.389019046" observedRunningTime="2026-05-26 01:13:11.798305505 +0000 UTC m=+148.144136972" watchObservedRunningTime="2026-05-26 01:13:18.779259546 +0000 UTC m=+155.125091056" May 26 01:13:20.272129 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:20.268551 2568 scope.go:117] "RemoveContainer" containerID="7d90fda2c2e96f3d8f04b06e538e8a48545b2ffc9d10f6b705dad6c0dff6d5d5" May 26 01:13:20.774646 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:20.774618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:13:20.774801 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:20.774739 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" event={"ID":"642df71f-8dd8-4419-b91b-df530f7394b5","Type":"ContainerStarted","Data":"d4792efd0b68a699de817c4053f08c274ad6789dd456cc0d70f5183aedd77b47"} May 26 01:13:20.775033 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:20.775012 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:13:20.791191 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:20.791140 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" podStartSLOduration=54.712991439 podStartE2EDuration="57.791122831s" podCreationTimestamp="2026-05-26 01:12:23 +0000 UTC" firstStartedPulling="2026-05-26 01:12:23.574527002 +0000 UTC m=+99.920358448" lastFinishedPulling="2026-05-26 01:12:26.652658395 +0000 UTC m=+102.998489840" observedRunningTime="2026-05-26 01:13:20.789053526 +0000 UTC m=+157.134884992" watchObservedRunningTime="2026-05-26 01:13:20.791122831 +0000 UTC m=+157.136954299" May 26 01:13:21.049502 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:13:21.049457 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xf6kz" podUID="90253730-09e3-4f2e-8c5a-294a34a85a4f" May 26 01:13:21.055590 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:13:21.055557 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rzxnz" podUID="8f6a6674-5260-4618-b8bd-d6efe56141d3" May 26 01:13:21.171407 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.171379 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-n96tq" May 26 01:13:21.351206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.351118 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-vrppp"] May 26 01:13:21.354835 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.354811 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:21.356979 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.356959 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kccq2\"" May 26 01:13:21.356979 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.356966 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 26 01:13:21.357160 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.356963 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 26 01:13:21.362396 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.362365 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vrppp"] May 26 01:13:21.476260 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.476223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn29z\" (UniqueName: \"kubernetes.io/projected/f13d6f09-1edc-40fc-ab77-51e1b2982a2a-kube-api-access-fn29z\") pod \"downloads-57bd96b888-vrppp\" (UID: \"f13d6f09-1edc-40fc-ab77-51e1b2982a2a\") " pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:21.577424 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.577390 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn29z\" (UniqueName: \"kubernetes.io/projected/f13d6f09-1edc-40fc-ab77-51e1b2982a2a-kube-api-access-fn29z\") pod \"downloads-57bd96b888-vrppp\" (UID: \"f13d6f09-1edc-40fc-ab77-51e1b2982a2a\") " pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:21.586399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.586373 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn29z\" (UniqueName: \"kubernetes.io/projected/f13d6f09-1edc-40fc-ab77-51e1b2982a2a-kube-api-access-fn29z\") pod \"downloads-57bd96b888-vrppp\" (UID: \"f13d6f09-1edc-40fc-ab77-51e1b2982a2a\") " pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:21.665561 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.665474 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:21.778411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.778381 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:13:21.778411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.778400 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf6kz" May 26 01:13:21.793188 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:21.793129 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vrppp"] May 26 01:13:21.795750 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:21.795722 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13d6f09_1edc_40fc_ab77_51e1b2982a2a.slice/crio-d6662d46e5698bc75e962e0a4b123e90b2da9388ad1cae68f1a8af81aede4438 WatchSource:0}: Error finding container d6662d46e5698bc75e962e0a4b123e90b2da9388ad1cae68f1a8af81aede4438: Status 404 returned error can't find the container with id d6662d46e5698bc75e962e0a4b123e90b2da9388ad1cae68f1a8af81aede4438 May 26 01:13:22.783863 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:22.783818 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vrppp" event={"ID":"f13d6f09-1edc-40fc-ab77-51e1b2982a2a","Type":"ContainerStarted","Data":"d6662d46e5698bc75e962e0a4b123e90b2da9388ad1cae68f1a8af81aede4438"} May 26 01:13:25.918080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.918039 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:13:25.918546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.918119 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:13:25.920773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.920744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90253730-09e3-4f2e-8c5a-294a34a85a4f-metrics-tls\") pod \"dns-default-xf6kz\" (UID: \"90253730-09e3-4f2e-8c5a-294a34a85a4f\") " pod="openshift-dns/dns-default-xf6kz" May 26 01:13:25.920954 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.920933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6a6674-5260-4618-b8bd-d6efe56141d3-cert\") pod \"ingress-canary-rzxnz\" (UID: \"8f6a6674-5260-4618-b8bd-d6efe56141d3\") " pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:13:25.981832 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.981786 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bf7j4\"" May 26 01:13:25.982482 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.982462 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4xl9v\"" May 26 01:13:25.990210 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.990176 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf6kz" May 26 01:13:25.990339 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:25.990237 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rzxnz" May 26 01:13:26.160347 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:26.160317 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rzxnz"] May 26 01:13:26.162020 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:26.161986 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6a6674_5260_4618_b8bd_d6efe56141d3.slice/crio-90bee334667dec2a446438ab535aec68df00c29bd008c9fac2e07e643003a11a WatchSource:0}: Error finding container 90bee334667dec2a446438ab535aec68df00c29bd008c9fac2e07e643003a11a: Status 404 returned error can't find the container with id 90bee334667dec2a446438ab535aec68df00c29bd008c9fac2e07e643003a11a May 26 01:13:26.176380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:26.176335 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xf6kz"] May 26 01:13:26.178544 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:26.178514 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90253730_09e3_4f2e_8c5a_294a34a85a4f.slice/crio-68ab7d9581153ba34141675885578021baa298133083804132204a5583333d11 WatchSource:0}: Error finding container 68ab7d9581153ba34141675885578021baa298133083804132204a5583333d11: Status 404 returned error can't find the container with id 68ab7d9581153ba34141675885578021baa298133083804132204a5583333d11 May 26 01:13:26.798405 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:26.798244 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf6kz" event={"ID":"90253730-09e3-4f2e-8c5a-294a34a85a4f","Type":"ContainerStarted","Data":"68ab7d9581153ba34141675885578021baa298133083804132204a5583333d11"} May 26 01:13:26.799932 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:26.799896 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rzxnz" event={"ID":"8f6a6674-5260-4618-b8bd-d6efe56141d3","Type":"ContainerStarted","Data":"90bee334667dec2a446438ab535aec68df00c29bd008c9fac2e07e643003a11a"} May 26 01:13:28.810681 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.810634 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rzxnz" event={"ID":"8f6a6674-5260-4618-b8bd-d6efe56141d3","Type":"ContainerStarted","Data":"4611bb0873f2d260fdcbdcc6d7901a258b0f5f011459f7482b0cda6a249f3e65"} May 26 01:13:28.812470 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.812442 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf6kz" event={"ID":"90253730-09e3-4f2e-8c5a-294a34a85a4f","Type":"ContainerStarted","Data":"09e5d9763db51550d4d755175ec5985527e5061f372362ebf6ad8a1f9f382ec0"} May 26 01:13:28.812589 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.812473 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf6kz" event={"ID":"90253730-09e3-4f2e-8c5a-294a34a85a4f","Type":"ContainerStarted","Data":"1fc1012ddf7f7b3397d1c492cab632dd3ca31d4becb41c8f4ac999976ad75936"} May 26 01:13:28.812649 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.812615 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xf6kz" May 26 01:13:28.825991 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.825935 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rzxnz" podStartSLOduration=128.578056952 podStartE2EDuration="2m10.825918197s" podCreationTimestamp="2026-05-26 01:11:18 +0000 UTC" firstStartedPulling="2026-05-26 01:13:26.164435029 +0000 UTC m=+162.510266473" lastFinishedPulling="2026-05-26 01:13:28.41229627 +0000 UTC m=+164.758127718" observedRunningTime="2026-05-26 01:13:28.823874193 +0000 UTC m=+165.169705660" watchObservedRunningTime="2026-05-26 01:13:28.825918197 +0000 UTC m=+165.171749664" May 26 01:13:28.840863 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:28.839879 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xf6kz" podStartSLOduration=128.612070953 podStartE2EDuration="2m10.839860956s" podCreationTimestamp="2026-05-26 01:11:18 +0000 UTC" firstStartedPulling="2026-05-26 01:13:26.180727828 +0000 UTC m=+162.526559272" lastFinishedPulling="2026-05-26 01:13:28.408517826 +0000 UTC m=+164.754349275" observedRunningTime="2026-05-26 01:13:28.838512253 +0000 UTC m=+165.184343718" watchObservedRunningTime="2026-05-26 01:13:28.839860956 +0000 UTC m=+165.185692423" May 26 01:13:31.467382 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.467301 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:13:31.471079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.471053 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.474222 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474135 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 26 01:13:31.474222 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474161 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 26 01:13:31.474416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474136 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 26 01:13:31.474416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474134 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 26 01:13:31.474416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474134 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 26 01:13:31.474416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.474140 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4sdp\"" May 26 01:13:31.480076 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.480030 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:13:31.570753 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.570714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.570944 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.570766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.570944 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.570811 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.570944 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.570877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.571078 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.571015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.571078 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.571064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjn6n\" (UniqueName: \"kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672524 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672546 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjn6n\" (UniqueName: \"kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672616 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672656 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.672770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.672687 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.673386 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.673336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.673483 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.673432 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.673591 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.673565 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.675683 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.675642 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.676028 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.676008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.687494 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.687468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjn6n\" (UniqueName: \"kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n\") pod \"console-57d794c8f5-f8rsk\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:31.784673 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:31.784584 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:13:37.560121 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.560066 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:13:37.562983 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:37.562958 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e2c63e_346b_4f86_b8c5_bc61bd43c5f5.slice/crio-4bf80b19a632c5e5e1fa15259b38c79db325b1e7e2e837bbce1d63728c03183a WatchSource:0}: Error finding container 4bf80b19a632c5e5e1fa15259b38c79db325b1e7e2e837bbce1d63728c03183a: Status 404 returned error can't find the container with id 4bf80b19a632c5e5e1fa15259b38c79db325b1e7e2e837bbce1d63728c03183a May 26 01:13:37.846135 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.846068 2568 generic.go:358] "Generic (PLEG): container finished" podID="5637e8ce-bd05-445f-a9f0-027037e8e611" containerID="627f2e145df8662b7de466171c84c7bff4ba311a50798aa69aa3c578225b6fa3" exitCode=0 May 26 01:13:37.846320 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.846212 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" event={"ID":"5637e8ce-bd05-445f-a9f0-027037e8e611","Type":"ContainerDied","Data":"627f2e145df8662b7de466171c84c7bff4ba311a50798aa69aa3c578225b6fa3"} May 26 01:13:37.846938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.846592 2568 scope.go:117] "RemoveContainer" containerID="627f2e145df8662b7de466171c84c7bff4ba311a50798aa69aa3c578225b6fa3" May 26 01:13:37.848316 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.848256 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vrppp" event={"ID":"f13d6f09-1edc-40fc-ab77-51e1b2982a2a","Type":"ContainerStarted","Data":"31e3fe67d2548c805828643f32c8177d097d5aed054dbe470feb644f0627caac"} May 26 01:13:37.848507 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.848484 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:37.850580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.850530 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d794c8f5-f8rsk" event={"ID":"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5","Type":"ContainerStarted","Data":"4bf80b19a632c5e5e1fa15259b38c79db325b1e7e2e837bbce1d63728c03183a"} May 26 01:13:37.854953 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.854926 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-vrppp" May 26 01:13:37.885182 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:37.884719 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-vrppp" podStartSLOduration=1.180250365 podStartE2EDuration="16.884700452s" podCreationTimestamp="2026-05-26 01:13:21 +0000 UTC" firstStartedPulling="2026-05-26 01:13:21.797616103 +0000 UTC m=+158.143447554" lastFinishedPulling="2026-05-26 01:13:37.502066195 +0000 UTC m=+173.847897641" observedRunningTime="2026-05-26 01:13:37.882937831 +0000 UTC m=+174.228769310" watchObservedRunningTime="2026-05-26 01:13:37.884700452 +0000 UTC m=+174.230531918" May 26 01:13:38.819368 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:38.819256 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xf6kz" May 26 01:13:38.858193 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:38.858154 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sw54l" event={"ID":"5637e8ce-bd05-445f-a9f0-027037e8e611","Type":"ContainerStarted","Data":"6c9d8b575705e06e4a95ec4d9fa0343dba9e231604618c9eba1f9015b50954f0"} May 26 01:13:40.061237 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.060228 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:13:40.090434 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.090389 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:13:40.090610 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.090552 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.098505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.098475 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 26 01:13:40.253628 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5v7\" (UniqueName: \"kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253794 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.253892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.253853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355299 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355323 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355387 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355434 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5v7\" (UniqueName: \"kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355471 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.356413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.355506 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.357597 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.356923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.357597 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.357394 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.357597 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.357562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.357845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.357815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.359012 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.358992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.364085 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.363877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.364732 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.364709 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5v7\" (UniqueName: \"kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7\") pod \"console-5477bd4ff7-l7lrf\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:40.405756 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:40.405718 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:41.178158 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:41.178128 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:13:41.181270 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:13:41.181235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41f5099_a41c_4f9b_b8dd_365bde67030b.slice/crio-4cecb7dc818557829a5782da9b4c2f2b044e56cdcd5edada23721548aac00c66 WatchSource:0}: Error finding container 4cecb7dc818557829a5782da9b4c2f2b044e56cdcd5edada23721548aac00c66: Status 404 returned error can't find the container with id 4cecb7dc818557829a5782da9b4c2f2b044e56cdcd5edada23721548aac00c66 May 26 01:13:41.873512 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:41.873474 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d794c8f5-f8rsk" event={"ID":"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5","Type":"ContainerStarted","Data":"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd"} May 26 01:13:41.874734 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:41.874707 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477bd4ff7-l7lrf" event={"ID":"c41f5099-a41c-4f9b-b8dd-365bde67030b","Type":"ContainerStarted","Data":"4cecb7dc818557829a5782da9b4c2f2b044e56cdcd5edada23721548aac00c66"} May 26 01:13:41.890292 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:41.890239 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57d794c8f5-f8rsk" podStartSLOduration=6.964489 podStartE2EDuration="10.890223019s" podCreationTimestamp="2026-05-26 01:13:31 +0000 UTC" firstStartedPulling="2026-05-26 01:13:37.564934801 +0000 UTC m=+173.910766244" lastFinishedPulling="2026-05-26 01:13:41.490668815 +0000 UTC m=+177.836500263" observedRunningTime="2026-05-26 01:13:41.887679871 +0000 UTC m=+178.233511338" watchObservedRunningTime="2026-05-26 01:13:41.890223019 +0000 UTC m=+178.236054487" May 26 01:13:42.880003 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:42.879955 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477bd4ff7-l7lrf" event={"ID":"c41f5099-a41c-4f9b-b8dd-365bde67030b","Type":"ContainerStarted","Data":"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d"} May 26 01:13:42.881864 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:42.881829 2568 generic.go:358] "Generic (PLEG): container finished" podID="43c25ccd-9171-456e-b070-a165c302ca48" containerID="4f8c3738679ad7ded8797aaab69b5b1fe72d22a1e5cf528a5445e2d996f6f97f" exitCode=0 May 26 01:13:42.882012 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:42.881905 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" event={"ID":"43c25ccd-9171-456e-b070-a165c302ca48","Type":"ContainerDied","Data":"4f8c3738679ad7ded8797aaab69b5b1fe72d22a1e5cf528a5445e2d996f6f97f"} May 26 01:13:42.882344 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:42.882321 2568 scope.go:117] "RemoveContainer" containerID="4f8c3738679ad7ded8797aaab69b5b1fe72d22a1e5cf528a5445e2d996f6f97f" May 26 01:13:42.896954 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:42.896904 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5477bd4ff7-l7lrf" podStartSLOduration=2.287134259 podStartE2EDuration="2.896887217s" podCreationTimestamp="2026-05-26 01:13:40 +0000 UTC" firstStartedPulling="2026-05-26 01:13:41.183697746 +0000 UTC m=+177.529529197" lastFinishedPulling="2026-05-26 01:13:41.793450698 +0000 UTC m=+178.139282155" observedRunningTime="2026-05-26 01:13:42.895140165 +0000 UTC m=+179.240971636" watchObservedRunningTime="2026-05-26 01:13:42.896887217 +0000 UTC m=+179.242718684" May 26 01:13:43.887650 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:43.887606 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dmss7" event={"ID":"43c25ccd-9171-456e-b070-a165c302ca48","Type":"ContainerStarted","Data":"f39b39a04a72555cc4fe621c91d344bb278e4129bc73a4c2460f1a5656658864"} May 26 01:13:50.406529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:50.406483 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:50.406529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:50.406546 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:50.412003 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:50.411979 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:50.914292 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:50.914258 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:13:50.955419 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:50.955381 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:13:51.785453 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:13:51.785417 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:14:15.976387 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:15.976326 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57d794c8f5-f8rsk" podUID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" containerName="console" containerID="cri-o://51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd" gracePeriod=15 May 26 01:14:16.240580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.240550 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d794c8f5-f8rsk_17e2c63e-346b-4f86-b8c5-bc61bd43c5f5/console/0.log" May 26 01:14:16.240719 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.240626 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:14:16.372763 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372732 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.372938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372777 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.372938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372818 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjn6n\" (UniqueName: \"kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.372938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372838 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.372938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372854 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.372938 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.372895 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert\") pod \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\" (UID: \"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5\") " May 26 01:14:16.373620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.373410 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:14:16.373620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.373436 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config" (OuterVolumeSpecName: "console-config") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:14:16.373620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.373567 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:14:16.375370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.375345 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:16.375670 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.375647 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:16.375767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.375664 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n" (OuterVolumeSpecName: "kube-api-access-qjn6n") pod "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" (UID: "17e2c63e-346b-4f86-b8c5-bc61bd43c5f5"). InnerVolumeSpecName "kube-api-access-qjn6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:14:16.474394 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474348 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjn6n\" (UniqueName: \"kubernetes.io/projected/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-kube-api-access-qjn6n\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.474394 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474388 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-service-ca\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.474394 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474401 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.474630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474412 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-oauth-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.474630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474425 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.474630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.474437 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5-console-oauth-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:16.989296 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d794c8f5-f8rsk_17e2c63e-346b-4f86-b8c5-bc61bd43c5f5/console/0.log" May 26 01:14:16.989745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989307 2568 generic.go:358] "Generic (PLEG): container finished" podID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" containerID="51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd" exitCode=2 May 26 01:14:16.989745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989377 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d794c8f5-f8rsk" May 26 01:14:16.989745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989375 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d794c8f5-f8rsk" event={"ID":"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5","Type":"ContainerDied","Data":"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd"} May 26 01:14:16.989745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989494 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d794c8f5-f8rsk" event={"ID":"17e2c63e-346b-4f86-b8c5-bc61bd43c5f5","Type":"ContainerDied","Data":"4bf80b19a632c5e5e1fa15259b38c79db325b1e7e2e837bbce1d63728c03183a"} May 26 01:14:16.989745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.989517 2568 scope.go:117] "RemoveContainer" containerID="51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd" May 26 01:14:16.998034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.998016 2568 scope.go:117] "RemoveContainer" containerID="51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd" May 26 01:14:16.998396 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:16.998376 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd\": container with ID starting with 51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd not found: ID does not exist" containerID="51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd" May 26 01:14:16.998472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:16.998404 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd"} err="failed to get container status \"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd\": rpc error: code = NotFound desc = could not find container \"51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd\": container with ID starting with 51c4686137dda68fe748e40bce87c4c20e9f9f0a15685eb99737165668c054fd not found: ID does not exist" May 26 01:14:17.010000 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:17.009974 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:14:17.012978 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:17.012951 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57d794c8f5-f8rsk"] May 26 01:14:18.272379 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:18.272340 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" path="/var/lib/kubelet/pods/17e2c63e-346b-4f86-b8c5-bc61bd43c5f5/volumes" May 26 01:14:25.454829 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.454791 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:25.455395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455223 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="alertmanager" containerID="cri-o://56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" gracePeriod=120 May 26 01:14:25.455395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455316 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-web" containerID="cri-o://a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" gracePeriod=120 May 26 01:14:25.455395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455357 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="prom-label-proxy" containerID="cri-o://593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" gracePeriod=120 May 26 01:14:25.455395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455303 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-metric" containerID="cri-o://0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" gracePeriod=120 May 26 01:14:25.455600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455374 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="config-reloader" containerID="cri-o://c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" gracePeriod=120 May 26 01:14:25.455600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:25.455328 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy" containerID="cri-o://573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" gracePeriod=120 May 26 01:14:26.022113 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022068 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" exitCode=0 May 26 01:14:26.022113 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022120 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" exitCode=0 May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022126 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" exitCode=0 May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022132 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" exitCode=0 May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022129 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a"} May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022167 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f"} May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022178 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783"} May 26 01:14:26.022324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.022187 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b"} May 26 01:14:26.808249 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.808183 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:26.965670 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965634 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965682 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965720 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965750 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbv7h\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965785 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965811 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.965844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965836 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965871 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965897 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965933 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.965970 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966001 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966052 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config\") pod \"dd464863-d342-4ce8-9c91-096442df9646\" (UID: \"dd464863-d342-4ce8-9c91-096442df9646\") " May 26 01:14:26.966194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966181 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:14:26.966590 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966326 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:14:26.966590 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966499 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-metrics-client-ca\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:26.966590 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.966521 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-main-db\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:26.967959 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.967925 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:14:26.969269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969227 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h" (OuterVolumeSpecName: "kube-api-access-hbv7h") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "kube-api-access-hbv7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:14:26.969503 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969474 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.969610 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969561 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.969610 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969590 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out" (OuterVolumeSpecName: "config-out") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:14:26.969769 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969642 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.969892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.969874 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume" (OuterVolumeSpecName: "config-volume") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.970866 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.970841 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:14:26.970924 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.970900 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.974083 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.974059 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:26.980037 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:26.980014 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config" (OuterVolumeSpecName: "web-config") pod "dd464863-d342-4ce8-9c91-096442df9646" (UID: "dd464863-d342-4ce8-9c91-096442df9646"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:14:27.027730 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027697 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" exitCode=0 May 26 01:14:27.027730 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027725 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd464863-d342-4ce8-9c91-096442df9646" containerID="a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" exitCode=0 May 26 01:14:27.027929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027794 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5"} May 26 01:14:27.027929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027825 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.027929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027844 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796"} May 26 01:14:27.027929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027863 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd464863-d342-4ce8-9c91-096442df9646","Type":"ContainerDied","Data":"6482acf1d630a2f953c836af0df0cb2f6ffaf62f0a962d6229bd96d6ffd01b5e"} May 26 01:14:27.027929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.027882 2568 scope.go:117] "RemoveContainer" containerID="593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" May 26 01:14:27.035771 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.035751 2568 scope.go:117] "RemoveContainer" containerID="0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" May 26 01:14:27.042930 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.042912 2568 scope.go:117] "RemoveContainer" containerID="573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" May 26 01:14:27.049879 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.049856 2568 scope.go:117] "RemoveContainer" containerID="a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" May 26 01:14:27.050173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.050131 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:27.056737 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.056717 2568 scope.go:117] "RemoveContainer" containerID="c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" May 26 01:14:27.058449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.058404 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:27.063440 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.063419 2568 scope.go:117] "RemoveContainer" containerID="56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" May 26 01:14:27.067685 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067663 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-tls-assets\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067755 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067693 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067755 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067709 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd464863-d342-4ce8-9c91-096442df9646-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067755 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067725 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-cluster-tls-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067755 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067739 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-config-volume\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067755 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067755 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd464863-d342-4ce8-9c91-096442df9646-config-out\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067768 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbv7h\" (UniqueName: \"kubernetes.io/projected/dd464863-d342-4ce8-9c91-096442df9646-kube-api-access-hbv7h\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067784 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067798 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-web-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067813 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.067920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.067828 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd464863-d342-4ce8-9c91-096442df9646-secret-alertmanager-main-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:14:27.070066 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.070043 2568 scope.go:117] "RemoveContainer" containerID="97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92" May 26 01:14:27.077260 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077241 2568 scope.go:117] "RemoveContainer" containerID="593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" May 26 01:14:27.077499 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.077479 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a\": container with ID starting with 593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a not found: ID does not exist" containerID="593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" May 26 01:14:27.077552 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077508 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a"} err="failed to get container status \"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a\": rpc error: code = NotFound desc = could not find container \"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a\": container with ID starting with 593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a not found: ID does not exist" May 26 01:14:27.077552 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077530 2568 scope.go:117] "RemoveContainer" containerID="0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" May 26 01:14:27.077695 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.077681 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5\": container with ID starting with 0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5 not found: ID does not exist" containerID="0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" May 26 01:14:27.077742 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077703 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5"} err="failed to get container status \"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5\": rpc error: code = NotFound desc = could not find container \"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5\": container with ID starting with 0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5 not found: ID does not exist" May 26 01:14:27.077742 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077722 2568 scope.go:117] "RemoveContainer" containerID="573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" May 26 01:14:27.077972 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.077951 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f\": container with ID starting with 573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f not found: ID does not exist" containerID="573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" May 26 01:14:27.078064 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.077980 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f"} err="failed to get container status \"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f\": rpc error: code = NotFound desc = could not find container \"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f\": container with ID starting with 573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f not found: ID does not exist" May 26 01:14:27.078064 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078003 2568 scope.go:117] "RemoveContainer" containerID="a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" May 26 01:14:27.078396 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.078379 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796\": container with ID starting with a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796 not found: ID does not exist" containerID="a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" May 26 01:14:27.078460 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078402 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796"} err="failed to get container status \"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796\": rpc error: code = NotFound desc = could not find container \"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796\": container with ID starting with a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796 not found: ID does not exist" May 26 01:14:27.078460 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078418 2568 scope.go:117] "RemoveContainer" containerID="c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" May 26 01:14:27.078635 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.078620 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783\": container with ID starting with c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783 not found: ID does not exist" containerID="c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" May 26 01:14:27.078672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078639 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783"} err="failed to get container status \"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783\": rpc error: code = NotFound desc = could not find container \"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783\": container with ID starting with c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783 not found: ID does not exist" May 26 01:14:27.078672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078652 2568 scope.go:117] "RemoveContainer" containerID="56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" May 26 01:14:27.078858 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.078840 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b\": container with ID starting with 56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b not found: ID does not exist" containerID="56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" May 26 01:14:27.078896 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078862 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b"} err="failed to get container status \"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b\": rpc error: code = NotFound desc = could not find container \"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b\": container with ID starting with 56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b not found: ID does not exist" May 26 01:14:27.078896 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.078879 2568 scope.go:117] "RemoveContainer" containerID="97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92" May 26 01:14:27.079122 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:14:27.079082 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92\": container with ID starting with 97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92 not found: ID does not exist" containerID="97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92" May 26 01:14:27.079198 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079126 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92"} err="failed to get container status \"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92\": rpc error: code = NotFound desc = could not find container \"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92\": container with ID starting with 97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92 not found: ID does not exist" May 26 01:14:27.079198 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079147 2568 scope.go:117] "RemoveContainer" containerID="593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a" May 26 01:14:27.079376 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079359 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a"} err="failed to get container status \"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a\": rpc error: code = NotFound desc = could not find container \"593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a\": container with ID starting with 593fb34b8d11035276f8cacb3898ee19bde0cee9119286e89b7c97250c89165a not found: ID does not exist" May 26 01:14:27.079423 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079377 2568 scope.go:117] "RemoveContainer" containerID="0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5" May 26 01:14:27.079577 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079562 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5"} err="failed to get container status \"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5\": rpc error: code = NotFound desc = could not find container \"0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5\": container with ID starting with 0d6fbcc49c164b4017526cc1ba51b642d5b3332a3a32435f9df99dce2d211dc5 not found: ID does not exist" May 26 01:14:27.079616 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079577 2568 scope.go:117] "RemoveContainer" containerID="573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f" May 26 01:14:27.079842 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079822 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f"} err="failed to get container status \"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f\": rpc error: code = NotFound desc = could not find container \"573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f\": container with ID starting with 573d8ae5737143b6e7b8e65833251b41964798fe8f6de2750a8ba8ee05ed4e0f not found: ID does not exist" May 26 01:14:27.079842 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.079842 2568 scope.go:117] "RemoveContainer" containerID="a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796" May 26 01:14:27.080067 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080049 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796"} err="failed to get container status \"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796\": rpc error: code = NotFound desc = could not find container \"a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796\": container with ID starting with a114de7bc900db1aadafdeaa0f68ba96c1927c25dcd470b5713812ebaeb56796 not found: ID does not exist" May 26 01:14:27.080200 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080071 2568 scope.go:117] "RemoveContainer" containerID="c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783" May 26 01:14:27.080402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080372 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783"} err="failed to get container status \"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783\": rpc error: code = NotFound desc = could not find container \"c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783\": container with ID starting with c9efc69b0f35861b8cf24319557ce391e606bc7bd9aff25a325812176e174783 not found: ID does not exist" May 26 01:14:27.080402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080394 2568 scope.go:117] "RemoveContainer" containerID="56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b" May 26 01:14:27.080848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080826 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b"} err="failed to get container status \"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b\": rpc error: code = NotFound desc = could not find container \"56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b\": container with ID starting with 56fc37af55bdd6bb2617319ec3d1e5d04148a5ef9b4262e769adc8fa0ad0631b not found: ID does not exist" May 26 01:14:27.080848 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.080848 2568 scope.go:117] "RemoveContainer" containerID="97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92" May 26 01:14:27.081133 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.081069 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92"} err="failed to get container status \"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92\": rpc error: code = NotFound desc = could not find container \"97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92\": container with ID starting with 97ee6e88948907c6baf1ee1fcafbeb5c9aab8d6c2005d0ee3839521ece799d92 not found: ID does not exist" May 26 01:14:27.083132 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083089 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:27.083399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083385 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="config-reloader" May 26 01:14:27.083399 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083398 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="config-reloader" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083421 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-web" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083427 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-web" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083437 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="prom-label-proxy" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083443 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="prom-label-proxy" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083454 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="alertmanager" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083459 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="alertmanager" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083464 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-metric" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083469 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-metric" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083476 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="init-config-reloader" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083480 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="init-config-reloader" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083488 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" containerName="console" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083492 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" containerName="console" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083499 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy" May 26 01:14:27.083508 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083504 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083547 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-web" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083557 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="17e2c63e-346b-4f86-b8c5-bc61bd43c5f5" containerName="console" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083564 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083571 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="config-reloader" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083576 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="kube-rbac-proxy-metric" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083584 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="prom-label-proxy" May 26 01:14:27.083876 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.083590 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd464863-d342-4ce8-9c91-096442df9646" containerName="alertmanager" May 26 01:14:27.088553 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.088533 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.090769 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090749 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 01:14:27.090877 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090793 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 01:14:27.090877 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090821 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 01:14:27.090877 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090874 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 01:14:27.091034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090874 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 01:14:27.091034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090894 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zh54m\"" May 26 01:14:27.091034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.090748 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 01:14:27.091211 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.091037 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 01:14:27.091271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.091246 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 01:14:27.096854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.096179 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 01:14:27.096854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.096636 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:27.168516 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168516 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168741 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.168762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.169037 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wgl\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-kube-api-access-r2wgl\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.169037 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.168870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269352 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269318 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269352 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269353 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269374 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269401 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269426 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269448 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269526 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wgl\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-kube-api-access-r2wgl\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269565 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269595 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269625 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269650 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.269680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269676 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.270291 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.269804 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.270347 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.270331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.270743 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.270697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.272762 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.272731 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-out\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.272884 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.272793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-web-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.272884 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.272793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.273056 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.273033 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.273138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.273076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.273456 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.273435 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.273561 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.273546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.273757 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.273734 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.274917 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.274900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.278447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.278429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wgl\" (UniqueName: \"kubernetes.io/projected/0a8d6077-6dcd-450c-8dc0-b9ad23c24b88-kube-api-access-r2wgl\") pod \"alertmanager-main-0\" (UID: \"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88\") " pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.398828 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.398745 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 01:14:27.540983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:27.540956 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 01:14:27.543627 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:14:27.543597 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8d6077_6dcd_450c_8dc0_b9ad23c24b88.slice/crio-cf68e9967048d0f332951b9d12789ad984b6d6255197ce0504b0f0e3317391dc WatchSource:0}: Error finding container cf68e9967048d0f332951b9d12789ad984b6d6255197ce0504b0f0e3317391dc: Status 404 returned error can't find the container with id cf68e9967048d0f332951b9d12789ad984b6d6255197ce0504b0f0e3317391dc May 26 01:14:28.033169 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:28.033137 2568 generic.go:358] "Generic (PLEG): container finished" podID="0a8d6077-6dcd-450c-8dc0-b9ad23c24b88" containerID="901a458e53d570e2df95e171708a43c38a7564888782ed43a7d634fd3d6dfa3b" exitCode=0 May 26 01:14:28.033536 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:28.033210 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerDied","Data":"901a458e53d570e2df95e171708a43c38a7564888782ed43a7d634fd3d6dfa3b"} May 26 01:14:28.033536 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:28.033245 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"cf68e9967048d0f332951b9d12789ad984b6d6255197ce0504b0f0e3317391dc"} May 26 01:14:28.271871 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:28.271841 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd464863-d342-4ce8-9c91-096442df9646" path="/var/lib/kubelet/pods/dd464863-d342-4ce8-9c91-096442df9646/volumes" May 26 01:14:29.039291 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039256 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"887d6e3c184e0f4bd7fb65cb5bc92cf40ddd16e9d85fdd67df50535cc09a00b0"} May 26 01:14:29.039652 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039296 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"8e5cf354cfb1d39d36951d21cc0a170610fc5fb966dcba18c4c3268038882120"} May 26 01:14:29.039652 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039311 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"83deaed535d66bf27549421532c164f60ef987802ee40c773c323526020bf014"} May 26 01:14:29.039652 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039327 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"90319c4b77523ec70f8d4df36bd5549de2e9aa04177b9aa07c4d452bfed47fcc"} May 26 01:14:29.039652 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039340 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"5d740a3552d52577a44034789a19d8e9dca16119208eecd513030062cead43f4"} May 26 01:14:29.039652 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.039351 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a8d6077-6dcd-450c-8dc0-b9ad23c24b88","Type":"ContainerStarted","Data":"7247830437e1f333784081dbfbdb6ac3f8528bb0cef473862c889c780e91fe6a"} May 26 01:14:29.088237 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.088149 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.088130808 podStartE2EDuration="2.088130808s" podCreationTimestamp="2026-05-26 01:14:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:14:29.085553602 +0000 UTC m=+225.431385068" watchObservedRunningTime="2026-05-26 01:14:29.088130808 +0000 UTC m=+225.433962274" May 26 01:14:29.476395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.476315 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78886dcfbf-wmrkg"] May 26 01:14:29.480219 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.480189 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.483622 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.483592 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 26 01:14:29.483622 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.483606 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 26 01:14:29.485080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.484407 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l89nm\"" May 26 01:14:29.485080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.484590 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 26 01:14:29.485080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.484719 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 26 01:14:29.485080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.484842 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 26 01:14:29.488758 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.488733 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 26 01:14:29.492915 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.492886 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78886dcfbf-wmrkg"] May 26 01:14:29.589551 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589725 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589725 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-metrics-client-ca\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589853 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsvxv\" (UniqueName: \"kubernetes.io/projected/aba5a029-034c-4edb-bd35-5bb9fd8d3829-kube-api-access-xsvxv\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589853 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-federate-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.589950 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.589930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-serving-certs-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.690983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.690947 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.690983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.690988 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-metrics-client-ca\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691035 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsvxv\" (UniqueName: \"kubernetes.io/projected/aba5a029-034c-4edb-bd35-5bb9fd8d3829-kube-api-access-xsvxv\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691073 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691154 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-federate-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691179 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691205 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-serving-certs-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691247 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.691854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.691818 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-metrics-client-ca\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.692555 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.692523 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-serving-certs-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.693173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.693153 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.694670 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.694647 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-telemeter-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.694921 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.694827 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.695810 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.695784 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.696045 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.696028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/aba5a029-034c-4edb-bd35-5bb9fd8d3829-federate-client-tls\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.700433 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.700407 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsvxv\" (UniqueName: \"kubernetes.io/projected/aba5a029-034c-4edb-bd35-5bb9fd8d3829-kube-api-access-xsvxv\") pod \"telemeter-client-78886dcfbf-wmrkg\" (UID: \"aba5a029-034c-4edb-bd35-5bb9fd8d3829\") " pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.794445 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.794405 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" May 26 01:14:29.942804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:29.942776 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78886dcfbf-wmrkg"] May 26 01:14:29.944671 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:14:29.944645 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba5a029_034c_4edb_bd35_5bb9fd8d3829.slice/crio-a81773c260a62f5fffde4e0324cea96fd25a71159e78ed372ab2011469804ceb WatchSource:0}: Error finding container a81773c260a62f5fffde4e0324cea96fd25a71159e78ed372ab2011469804ceb: Status 404 returned error can't find the container with id a81773c260a62f5fffde4e0324cea96fd25a71159e78ed372ab2011469804ceb May 26 01:14:30.043641 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:30.043605 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" event={"ID":"aba5a029-034c-4edb-bd35-5bb9fd8d3829","Type":"ContainerStarted","Data":"a81773c260a62f5fffde4e0324cea96fd25a71159e78ed372ab2011469804ceb"} May 26 01:14:33.054447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.054414 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" event={"ID":"aba5a029-034c-4edb-bd35-5bb9fd8d3829","Type":"ContainerStarted","Data":"d719a760b9bddf2d80827cbff1dcdae1d332cab5e11701d53c25dd2b24469d1e"} May 26 01:14:33.054447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.054452 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" event={"ID":"aba5a029-034c-4edb-bd35-5bb9fd8d3829","Type":"ContainerStarted","Data":"f1588544d61308a740274845d2660be5b79834f781c708f9c761da72237902f4"} May 26 01:14:33.054447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.054461 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" event={"ID":"aba5a029-034c-4edb-bd35-5bb9fd8d3829","Type":"ContainerStarted","Data":"3781b04632ab8b07b35879217a364ab0a74139274ef42982483d05cd6c9faf85"} May 26 01:14:33.079444 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.079382 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78886dcfbf-wmrkg" podStartSLOduration=1.450750056 podStartE2EDuration="4.079362858s" podCreationTimestamp="2026-05-26 01:14:29 +0000 UTC" firstStartedPulling="2026-05-26 01:14:29.947235543 +0000 UTC m=+226.293066990" lastFinishedPulling="2026-05-26 01:14:32.575848345 +0000 UTC m=+228.921679792" observedRunningTime="2026-05-26 01:14:33.078184554 +0000 UTC m=+229.424016013" watchObservedRunningTime="2026-05-26 01:14:33.079362858 +0000 UTC m=+229.425194325" May 26 01:14:33.986359 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.986322 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:14:33.989864 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.989841 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:33.997911 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:33.997877 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:14:34.138418 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138581 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh7kg\" (UniqueName: \"kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.138845 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.138688 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239435 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239350 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239435 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239387 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239435 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239406 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh7kg\" (UniqueName: \"kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239705 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239457 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239705 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239705 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.239705 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.239608 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.240260 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.240234 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.240372 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.240273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.240465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.240439 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.240465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.240459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.242385 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.242360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.242586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.242566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.246587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.246565 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh7kg\" (UniqueName: \"kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg\") pod \"console-7dfcc6d57b-6dkls\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.301654 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.301600 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:34.432823 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:34.432786 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:14:34.435761 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:14:34.435727 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3718bfa_4040_45cf_a9f0_4a2b46dd5da3.slice/crio-d9ec1d57f903d05a3140820a04480dcbb22534a1c16ef81b264975cc8dbc6db9 WatchSource:0}: Error finding container d9ec1d57f903d05a3140820a04480dcbb22534a1c16ef81b264975cc8dbc6db9: Status 404 returned error can't find the container with id d9ec1d57f903d05a3140820a04480dcbb22534a1c16ef81b264975cc8dbc6db9 May 26 01:14:35.062568 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:35.062533 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfcc6d57b-6dkls" event={"ID":"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3","Type":"ContainerStarted","Data":"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8"} May 26 01:14:35.062568 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:35.062568 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfcc6d57b-6dkls" event={"ID":"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3","Type":"ContainerStarted","Data":"d9ec1d57f903d05a3140820a04480dcbb22534a1c16ef81b264975cc8dbc6db9"} May 26 01:14:35.077567 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:35.077393 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7dfcc6d57b-6dkls" podStartSLOduration=2.07737859 podStartE2EDuration="2.07737859s" podCreationTimestamp="2026-05-26 01:14:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:14:35.077068307 +0000 UTC m=+231.422899797" watchObservedRunningTime="2026-05-26 01:14:35.07737859 +0000 UTC m=+231.423210059" May 26 01:14:44.302482 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:44.302440 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:44.302860 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:44.302496 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:44.307080 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:44.307057 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:45.096731 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:45.096704 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:14:45.138736 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:14:45.138702 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:15:10.164021 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.163980 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5477bd4ff7-l7lrf" podUID="c41f5099-a41c-4f9b-b8dd-365bde67030b" containerName="console" containerID="cri-o://dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d" gracePeriod=15 May 26 01:15:10.412272 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.412248 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5477bd4ff7-l7lrf_c41f5099-a41c-4f9b-b8dd-365bde67030b/console/0.log" May 26 01:15:10.412417 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.412313 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:15:10.533467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533369 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533429 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr5v7\" (UniqueName: \"kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533447 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533472 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533492 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533534 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533773 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533548 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config\") pod \"c41f5099-a41c-4f9b-b8dd-365bde67030b\" (UID: \"c41f5099-a41c-4f9b-b8dd-365bde67030b\") " May 26 01:15:10.533994 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533967 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config" (OuterVolumeSpecName: "console-config") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:15:10.534057 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.533989 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:15:10.534057 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.534001 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:15:10.534057 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.534010 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca" (OuterVolumeSpecName: "service-ca") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:15:10.535965 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.535941 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:15:10.536262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.536231 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:15:10.536262 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.536244 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7" (OuterVolumeSpecName: "kube-api-access-lr5v7") pod "c41f5099-a41c-4f9b-b8dd-365bde67030b" (UID: "c41f5099-a41c-4f9b-b8dd-365bde67030b"). InnerVolumeSpecName "kube-api-access-lr5v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:15:10.634981 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.634929 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr5v7\" (UniqueName: \"kubernetes.io/projected/c41f5099-a41c-4f9b-b8dd-365bde67030b-kube-api-access-lr5v7\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.634981 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.634975 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.634981 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.634987 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-oauth-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.634981 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.634995 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-trusted-ca-bundle\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.635294 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.635005 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41f5099-a41c-4f9b-b8dd-365bde67030b-service-ca\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.635294 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.635013 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-oauth-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:10.635294 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:10.635022 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41f5099-a41c-4f9b-b8dd-365bde67030b-console-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:15:11.172994 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.172962 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5477bd4ff7-l7lrf_c41f5099-a41c-4f9b-b8dd-365bde67030b/console/0.log" May 26 01:15:11.173402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.173008 2568 generic.go:358] "Generic (PLEG): container finished" podID="c41f5099-a41c-4f9b-b8dd-365bde67030b" containerID="dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d" exitCode=2 May 26 01:15:11.173402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.173091 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477bd4ff7-l7lrf" event={"ID":"c41f5099-a41c-4f9b-b8dd-365bde67030b","Type":"ContainerDied","Data":"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d"} May 26 01:15:11.173402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.173118 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5477bd4ff7-l7lrf" May 26 01:15:11.173402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.173132 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5477bd4ff7-l7lrf" event={"ID":"c41f5099-a41c-4f9b-b8dd-365bde67030b","Type":"ContainerDied","Data":"4cecb7dc818557829a5782da9b4c2f2b044e56cdcd5edada23721548aac00c66"} May 26 01:15:11.173402 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.173158 2568 scope.go:117] "RemoveContainer" containerID="dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d" May 26 01:15:11.184390 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.184364 2568 scope.go:117] "RemoveContainer" containerID="dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d" May 26 01:15:11.184713 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:15:11.184682 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d\": container with ID starting with dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d not found: ID does not exist" containerID="dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d" May 26 01:15:11.184824 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.184719 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d"} err="failed to get container status \"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d\": rpc error: code = NotFound desc = could not find container \"dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d\": container with ID starting with dd4c9ecfc857fef2579351850acdf62a25d4bf9a8bd737536d9afbaee952c82d not found: ID does not exist" May 26 01:15:11.193619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.193587 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:15:11.196475 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:11.196455 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5477bd4ff7-l7lrf"] May 26 01:15:12.272322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:12.272289 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41f5099-a41c-4f9b-b8dd-365bde67030b" path="/var/lib/kubelet/pods/c41f5099-a41c-4f9b-b8dd-365bde67030b/volumes" May 26 01:15:44.169702 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:44.169673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:15:44.172203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:44.172185 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:15:44.172466 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:44.172446 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:15:44.174927 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:44.174909 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:15:44.179642 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:15:44.179627 2568 kubelet.go:1628] "Image garbage collection succeeded" May 26 01:16:21.554271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.554222 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:16:21.556684 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.554602 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41f5099-a41c-4f9b-b8dd-365bde67030b" containerName="console" May 26 01:16:21.556684 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.554616 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41f5099-a41c-4f9b-b8dd-365bde67030b" containerName="console" May 26 01:16:21.556684 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.554676 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="c41f5099-a41c-4f9b-b8dd-365bde67030b" containerName="console" May 26 01:16:21.557609 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.557589 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.566588 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.566564 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:16:21.621309 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621476 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621476 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621476 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621476 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjn5v\" (UniqueName: \"kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.621612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.621579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722586 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722599 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722626 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722671 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjn5v\" (UniqueName: \"kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722712 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.722776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722771 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.723035 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.722803 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.723361 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.723331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.723645 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.723539 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.723645 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.723539 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.723765 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.723669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.725269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.725251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.725423 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.725406 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.729840 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.729823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjn5v\" (UniqueName: \"kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v\") pod \"console-7f5cbd7b65-9kn55\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:21.869319 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:21.869209 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:22.004886 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:22.004859 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:16:22.007078 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:16:22.007050 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e99192_6e0f_4570_8063_66d6548d59ff.slice/crio-dc8bb628f323850eb0d85613d81fc540c96a08689e24f2c8c2808e48cadeab5e WatchSource:0}: Error finding container dc8bb628f323850eb0d85613d81fc540c96a08689e24f2c8c2808e48cadeab5e: Status 404 returned error can't find the container with id dc8bb628f323850eb0d85613d81fc540c96a08689e24f2c8c2808e48cadeab5e May 26 01:16:22.008957 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:22.008937 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 01:16:22.382338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:22.382297 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cbd7b65-9kn55" event={"ID":"e7e99192-6e0f-4570-8063-66d6548d59ff","Type":"ContainerStarted","Data":"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421"} May 26 01:16:22.382338 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:22.382336 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cbd7b65-9kn55" event={"ID":"e7e99192-6e0f-4570-8063-66d6548d59ff","Type":"ContainerStarted","Data":"dc8bb628f323850eb0d85613d81fc540c96a08689e24f2c8c2808e48cadeab5e"} May 26 01:16:22.398812 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:22.398761 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f5cbd7b65-9kn55" podStartSLOduration=1.398745031 podStartE2EDuration="1.398745031s" podCreationTimestamp="2026-05-26 01:16:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:16:22.397413208 +0000 UTC m=+338.743244674" watchObservedRunningTime="2026-05-26 01:16:22.398745031 +0000 UTC m=+338.744576497" May 26 01:16:31.869631 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:31.869530 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:31.870153 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:31.869679 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:31.874383 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:31.874359 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:32.414646 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:32.414615 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:16:32.454775 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:32.454739 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:16:57.475746 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.475680 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7dfcc6d57b-6dkls" podUID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" containerName="console" containerID="cri-o://4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8" gracePeriod=15 May 26 01:16:57.725370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.725343 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dfcc6d57b-6dkls_d3718bfa-4040-45cf-a9f0-4a2b46dd5da3/console/0.log" May 26 01:16:57.725499 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.725414 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:16:57.825841 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.825804 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826030 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.825861 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh7kg\" (UniqueName: \"kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826030 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.825887 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826030 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.825923 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826224 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826078 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826224 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826177 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826224 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826214 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config\") pod \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\" (UID: \"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3\") " May 26 01:16:57.826373 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826256 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:16:57.826373 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826316 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:16:57.826594 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826568 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:16:57.826663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826578 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config" (OuterVolumeSpecName: "console-config") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:16:57.826663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826608 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-service-ca\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.826663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.826628 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-trusted-ca-bundle\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.828414 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.828384 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg" (OuterVolumeSpecName: "kube-api-access-qh7kg") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "kube-api-access-qh7kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:16:57.828525 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.828413 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:16:57.828525 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.828424 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" (UID: "d3718bfa-4040-45cf-a9f0-4a2b46dd5da3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:16:57.927754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.927714 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh7kg\" (UniqueName: \"kubernetes.io/projected/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-kube-api-access-qh7kg\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.927754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.927749 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-oauth-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.927754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.927758 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.927754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.927767 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-oauth-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:57.928013 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:57.927777 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3-console-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:16:58.493712 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493684 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dfcc6d57b-6dkls_d3718bfa-4040-45cf-a9f0-4a2b46dd5da3/console/0.log" May 26 01:16:58.494173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493724 2568 generic.go:358] "Generic (PLEG): container finished" podID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" containerID="4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8" exitCode=2 May 26 01:16:58.494173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493794 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfcc6d57b-6dkls" May 26 01:16:58.494173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493795 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfcc6d57b-6dkls" event={"ID":"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3","Type":"ContainerDied","Data":"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8"} May 26 01:16:58.494173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493923 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfcc6d57b-6dkls" event={"ID":"d3718bfa-4040-45cf-a9f0-4a2b46dd5da3","Type":"ContainerDied","Data":"d9ec1d57f903d05a3140820a04480dcbb22534a1c16ef81b264975cc8dbc6db9"} May 26 01:16:58.494173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.493957 2568 scope.go:117] "RemoveContainer" containerID="4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8" May 26 01:16:58.501933 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.501919 2568 scope.go:117] "RemoveContainer" containerID="4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8" May 26 01:16:58.502185 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:16:58.502160 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8\": container with ID starting with 4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8 not found: ID does not exist" containerID="4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8" May 26 01:16:58.502280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.502196 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8"} err="failed to get container status \"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8\": rpc error: code = NotFound desc = could not find container \"4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8\": container with ID starting with 4f8abc11f7c8bd23db9d6fcf72bd99231a7e995fb3b20acc3d07a81e9c7806c8 not found: ID does not exist" May 26 01:16:58.509929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.509897 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:16:58.513715 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:16:58.513688 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dfcc6d57b-6dkls"] May 26 01:17:00.272425 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:17:00.272393 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" path="/var/lib/kubelet/pods/d3718bfa-4040-45cf-a9f0-4a2b46dd5da3/volumes" May 26 01:19:53.092194 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.092117 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-97b699ff4-h8t26"] May 26 01:19:53.092674 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.092516 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" containerName="console" May 26 01:19:53.092674 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.092534 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" containerName="console" May 26 01:19:53.092674 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.092597 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3718bfa-4040-45cf-a9f0-4a2b46dd5da3" containerName="console" May 26 01:19:53.095689 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.095664 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.110750 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.110722 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97b699ff4-h8t26"] May 26 01:19:53.160743 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.160903 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-oauth-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.160903 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-trusted-ca-bundle\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.160903 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160868 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcwv\" (UniqueName: \"kubernetes.io/projected/c58b50da-b5ba-4c5f-854a-3484c0395a09-kube-api-access-trcwv\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.160903 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-service-ca\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.161040 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.161040 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.160946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-oauth-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261412 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261369 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261613 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261432 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-oauth-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261613 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261466 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-trusted-ca-bundle\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261613 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261498 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trcwv\" (UniqueName: \"kubernetes.io/projected/c58b50da-b5ba-4c5f-854a-3484c0395a09-kube-api-access-trcwv\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261779 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261638 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-service-ca\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261779 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261685 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.261779 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.261720 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-oauth-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.262406 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.262374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-oauth-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.262530 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.262408 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-trusted-ca-bundle\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.262530 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.262374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-service-ca\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.262530 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.262437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.264247 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.264220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-serving-cert\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.264247 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.264230 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c58b50da-b5ba-4c5f-854a-3484c0395a09-console-oauth-config\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.268732 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.268712 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcwv\" (UniqueName: \"kubernetes.io/projected/c58b50da-b5ba-4c5f-854a-3484c0395a09-kube-api-access-trcwv\") pod \"console-97b699ff4-h8t26\" (UID: \"c58b50da-b5ba-4c5f-854a-3484c0395a09\") " pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.408742 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.408650 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:19:53.539054 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:53.539024 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97b699ff4-h8t26"] May 26 01:19:53.541178 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:19:53.541148 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58b50da_b5ba_4c5f_854a_3484c0395a09.slice/crio-42bb808168b2fc1c3609a64d73f350f41446034c53e84747847a0c3ee2cce9b0 WatchSource:0}: Error finding container 42bb808168b2fc1c3609a64d73f350f41446034c53e84747847a0c3ee2cce9b0: Status 404 returned error can't find the container with id 42bb808168b2fc1c3609a64d73f350f41446034c53e84747847a0c3ee2cce9b0 May 26 01:19:54.017570 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:54.017528 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97b699ff4-h8t26" event={"ID":"c58b50da-b5ba-4c5f-854a-3484c0395a09","Type":"ContainerStarted","Data":"5d563800f67db73a8f6a83a1c696e34e5a4eb29526283c332654ea5a8dc052d0"} May 26 01:19:54.017570 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:54.017562 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97b699ff4-h8t26" event={"ID":"c58b50da-b5ba-4c5f-854a-3484c0395a09","Type":"ContainerStarted","Data":"42bb808168b2fc1c3609a64d73f350f41446034c53e84747847a0c3ee2cce9b0"} May 26 01:19:54.033827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:19:54.033766 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-97b699ff4-h8t26" podStartSLOduration=1.033747339 podStartE2EDuration="1.033747339s" podCreationTimestamp="2026-05-26 01:19:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:19:54.032524842 +0000 UTC m=+550.378356307" watchObservedRunningTime="2026-05-26 01:19:54.033747339 +0000 UTC m=+550.379578808" May 26 01:20:03.409133 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:03.409006 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:20:03.409133 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:03.409065 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:20:03.413812 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:03.413787 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:20:04.050864 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:04.050837 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97b699ff4-h8t26" May 26 01:20:04.090546 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:04.090509 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:20:29.111227 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.111160 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f5cbd7b65-9kn55" podUID="e7e99192-6e0f-4570-8063-66d6548d59ff" containerName="console" containerID="cri-o://7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421" gracePeriod=15 May 26 01:20:29.358591 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.358563 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5cbd7b65-9kn55_e7e99192-6e0f-4570-8063-66d6548d59ff/console/0.log" May 26 01:20:29.358729 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.358627 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:20:29.475710 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475618 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475710 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475692 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjn5v\" (UniqueName: \"kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475718 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475739 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475767 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475785 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.475943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.475811 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config\") pod \"e7e99192-6e0f-4570-8063-66d6548d59ff\" (UID: \"e7e99192-6e0f-4570-8063-66d6548d59ff\") " May 26 01:20:29.476236 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.476142 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:20:29.476305 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.476277 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:20:29.476305 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.476286 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config" (OuterVolumeSpecName: "console-config") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:20:29.476425 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.476302 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:20:29.478161 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.478135 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:20:29.478293 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.478272 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v" (OuterVolumeSpecName: "kube-api-access-bjn5v") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "kube-api-access-bjn5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:20:29.478357 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.478341 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e7e99192-6e0f-4570-8063-66d6548d59ff" (UID: "e7e99192-6e0f-4570-8063-66d6548d59ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:20:29.576982 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.576930 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-trusted-ca-bundle\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.576982 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.576983 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjn5v\" (UniqueName: \"kubernetes.io/projected/e7e99192-6e0f-4570-8063-66d6548d59ff-kube-api-access-bjn5v\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.576982 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.576998 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-service-ca\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.577275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.577013 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.577275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.577030 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-console-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.577275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.577042 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7e99192-6e0f-4570-8063-66d6548d59ff-oauth-serving-cert\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:29.577275 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:29.577053 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7e99192-6e0f-4570-8063-66d6548d59ff-console-oauth-config\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:20:30.126632 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126599 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5cbd7b65-9kn55_e7e99192-6e0f-4570-8063-66d6548d59ff/console/0.log" May 26 01:20:30.127058 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126647 2568 generic.go:358] "Generic (PLEG): container finished" podID="e7e99192-6e0f-4570-8063-66d6548d59ff" containerID="7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421" exitCode=2 May 26 01:20:30.127058 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126714 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5cbd7b65-9kn55" May 26 01:20:30.127058 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126738 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cbd7b65-9kn55" event={"ID":"e7e99192-6e0f-4570-8063-66d6548d59ff","Type":"ContainerDied","Data":"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421"} May 26 01:20:30.127058 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126777 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5cbd7b65-9kn55" event={"ID":"e7e99192-6e0f-4570-8063-66d6548d59ff","Type":"ContainerDied","Data":"dc8bb628f323850eb0d85613d81fc540c96a08689e24f2c8c2808e48cadeab5e"} May 26 01:20:30.127058 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.126794 2568 scope.go:117] "RemoveContainer" containerID="7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421" May 26 01:20:30.136012 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.135994 2568 scope.go:117] "RemoveContainer" containerID="7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421" May 26 01:20:30.136340 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:20:30.136321 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421\": container with ID starting with 7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421 not found: ID does not exist" containerID="7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421" May 26 01:20:30.136410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.136353 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421"} err="failed to get container status \"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421\": rpc error: code = NotFound desc = could not find container \"7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421\": container with ID starting with 7ea52a9096759000da16c1ae04e5e0741e7d3f163aa8a8cda978c29be9ed6421 not found: ID does not exist" May 26 01:20:30.146486 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.146457 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:20:30.149202 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.149177 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5cbd7b65-9kn55"] May 26 01:20:30.272239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:30.272206 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e99192-6e0f-4570-8063-66d6548d59ff" path="/var/lib/kubelet/pods/e7e99192-6e0f-4570-8063-66d6548d59ff/volumes" May 26 01:20:44.194479 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:44.194447 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:20:44.194963 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:44.194809 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:20:44.196812 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:44.196782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:20:44.196925 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:20:44.196852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:25:44.216745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:25:44.216674 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:25:44.217284 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:25:44.217137 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:25:44.219390 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:25:44.219372 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:25:44.219694 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:25:44.219681 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:27:56.841896 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.841858 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:27:56.842529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.842352 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e99192-6e0f-4570-8063-66d6548d59ff" containerName="console" May 26 01:27:56.842529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.842372 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e99192-6e0f-4570-8063-66d6548d59ff" containerName="console" May 26 01:27:56.842529 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.842474 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7e99192-6e0f-4570-8063-66d6548d59ff" containerName="console" May 26 01:27:56.845407 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.845377 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:27:56.847634 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.847615 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 26 01:27:56.847741 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.847710 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 26 01:27:56.854416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.848815 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-4m6m4\"" May 26 01:27:56.858943 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.858920 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:27:56.897196 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.897162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbbz\" (UniqueName: \"kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz\") pod \"feast-operator-controller-manager-7dd4845fb-dzw6q\" (UID: \"6d14005a-681f-4130-bd65-d228eb669cb1\") " pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:27:56.997906 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:56.997868 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbbz\" (UniqueName: \"kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz\") pod \"feast-operator-controller-manager-7dd4845fb-dzw6q\" (UID: \"6d14005a-681f-4130-bd65-d228eb669cb1\") " pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:27:57.006407 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:57.006372 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbbz\" (UniqueName: \"kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz\") pod \"feast-operator-controller-manager-7dd4845fb-dzw6q\" (UID: \"6d14005a-681f-4130-bd65-d228eb669cb1\") " pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:27:57.159018 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:57.158926 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:27:57.289668 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:57.289639 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:27:57.291824 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:27:57.291797 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d14005a_681f_4130_bd65_d228eb669cb1.slice/crio-cda2a79d240b7c8d2a808d762d51313424ef35b8c7eb32960817f45bd678a914 WatchSource:0}: Error finding container cda2a79d240b7c8d2a808d762d51313424ef35b8c7eb32960817f45bd678a914: Status 404 returned error can't find the container with id cda2a79d240b7c8d2a808d762d51313424ef35b8c7eb32960817f45bd678a914 May 26 01:27:57.293736 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:57.293715 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 01:27:57.434566 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:27:57.434483 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" event={"ID":"6d14005a-681f-4130-bd65-d228eb669cb1","Type":"ContainerStarted","Data":"cda2a79d240b7c8d2a808d762d51313424ef35b8c7eb32960817f45bd678a914"} May 26 01:28:01.447983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:01.447940 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" event={"ID":"6d14005a-681f-4130-bd65-d228eb669cb1","Type":"ContainerStarted","Data":"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3"} May 26 01:28:01.448411 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:01.448007 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:28:01.468160 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:01.468116 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" podStartSLOduration=2.304730572 podStartE2EDuration="5.46807778s" podCreationTimestamp="2026-05-26 01:27:56 +0000 UTC" firstStartedPulling="2026-05-26 01:27:57.293898296 +0000 UTC m=+1033.639729746" lastFinishedPulling="2026-05-26 01:28:00.45724551 +0000 UTC m=+1036.803076954" observedRunningTime="2026-05-26 01:28:01.467838957 +0000 UTC m=+1037.813670423" watchObservedRunningTime="2026-05-26 01:28:01.46807778 +0000 UTC m=+1037.813909245" May 26 01:28:12.454551 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:12.454521 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:28:40.353661 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.353570 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:28:40.357112 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.357079 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.359744 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.359720 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" May 26 01:28:40.360225 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360175 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 26 01:28:40.360607 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360589 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" May 26 01:28:40.360728 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360705 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" May 26 01:28:40.360893 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360670 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 26 01:28:40.360964 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360877 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" May 26 01:28:40.361040 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360619 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" May 26 01:28:40.361129 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.360790 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rxmmd\"" May 26 01:28:40.370206 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.370185 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:28:40.474205 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.474410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.474410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xlr\" (UniqueName: \"kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.474410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.474410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.474410 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.474391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575372 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575458 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575486 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xlr\" (UniqueName: \"kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575519 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575548 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575587 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575583 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.575844 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:28:40.575716 2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found May 26 01:28:40.575844 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:28:40.575716 2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found May 26 01:28:40.575844 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:28:40.575787 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls podName:6cd81081-43b4-4529-938c-f4f78f1a94aa nodeName:}" failed. No retries permitted until 2026-05-26 01:28:41.075766026 +0000 UTC m=+1077.421597474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls") pod "feast-simple-feast-setup-64794c68fb-pdtzk" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa") : secret "feast-simple-feast-setup-offline-tls" not found May 26 01:28:40.575844 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:28:40.575804 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls podName:6cd81081-43b4-4529-938c-f4f78f1a94aa nodeName:}" failed. No retries permitted until 2026-05-26 01:28:41.075795338 +0000 UTC m=+1077.421626785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls") pod "feast-simple-feast-setup-64794c68fb-pdtzk" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa") : secret "feast-simple-feast-setup-registry-tls" not found May 26 01:28:40.575844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.575813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.578217 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.578192 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.578331 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.578218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:40.591617 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:40.591596 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xlr\" (UniqueName: \"kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.080680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.080642 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.080680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.080689 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.083250 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.083225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.083364 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.083323 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-pdtzk\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.279543 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.279502 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:28:41.443281 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:28:41.443235 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd81081_43b4_4529_938c_f4f78f1a94aa.slice/crio-50e25a8a273afe5a27a57d34ba48bb9eda65d223466b753a4f66d419217c9777 WatchSource:0}: Error finding container 50e25a8a273afe5a27a57d34ba48bb9eda65d223466b753a4f66d419217c9777: Status 404 returned error can't find the container with id 50e25a8a273afe5a27a57d34ba48bb9eda65d223466b753a4f66d419217c9777 May 26 01:28:41.446935 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.446913 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:28:41.571382 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:28:41.571344 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"50e25a8a273afe5a27a57d34ba48bb9eda65d223466b753a4f66d419217c9777"} May 26 01:29:11.673954 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:11.673917 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"e9363f93e298f73d69e7b8e08ff115d3da6c219bb56b617ad4f37755a8526808"} May 26 01:29:16.690654 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:16.690618 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="e9363f93e298f73d69e7b8e08ff115d3da6c219bb56b617ad4f37755a8526808" exitCode=0 May 26 01:29:16.691042 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:16.690689 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"e9363f93e298f73d69e7b8e08ff115d3da6c219bb56b617ad4f37755a8526808"} May 26 01:29:17.696336 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:17.696297 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"23c6308d0a4758c20862240217fe3c71f8c7d794ab46a4aa49bc061b45ae55f9"} May 26 01:29:22.713927 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:22.713894 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="23c6308d0a4758c20862240217fe3c71f8c7d794ab46a4aa49bc061b45ae55f9" exitCode=0 May 26 01:29:22.714371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:22.713926 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"23c6308d0a4758c20862240217fe3c71f8c7d794ab46a4aa49bc061b45ae55f9"} May 26 01:29:22.723056 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:22.723035 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" May 26 01:29:23.738535 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:23.738486 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"84608d5092fd1aee602efe559b868bb53a78ab64f18807b8e5f4deada6b4bc92"} May 26 01:29:23.738535 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:23.738541 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"bd3e72e50e76f5998e1baad70758e31ec9baf8b8dcc9868bc78d81e2f2df1c6b"} May 26 01:29:23.739071 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:23.738556 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"b6e9ca6ddb8c8a70a09cc8da6e3cf26bca4085a2031f97dd3129974de83d8db2"} May 26 01:29:23.739071 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:23.738570 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerStarted","Data":"09496a63e0463f0b520bbed9b5c4d8ba4ba72c9322ee4745df4204e8b720b4a3"} May 26 01:29:23.762258 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:23.762196 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podStartSLOduration=13.929222342 podStartE2EDuration="43.762178119s" podCreationTimestamp="2026-05-26 01:28:40 +0000 UTC" firstStartedPulling="2026-05-26 01:28:41.446133782 +0000 UTC m=+1077.791965227" lastFinishedPulling="2026-05-26 01:29:11.27908956 +0000 UTC m=+1107.624921004" observedRunningTime="2026-05-26 01:29:23.760801873 +0000 UTC m=+1120.106633340" watchObservedRunningTime="2026-05-26 01:29:23.762178119 +0000 UTC m=+1120.108009586" May 26 01:29:26.280833 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.280589 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:26.280833 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.280636 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:26.280833 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.280650 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:26.281446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.281130 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:26.283127 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.283038 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" May 26 01:29:26.283244 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.283130 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" May 26 01:29:26.283244 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.283069 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" May 26 01:29:26.283244 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:26.283069 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" May 26 01:29:29.281437 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.281400 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.281875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.281571 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.281875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.281852 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.281989 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.281959 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.282044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.281995 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.282044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.282009 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.282465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.282444 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.282536 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.282503 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.282571 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.282543 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.286465 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.286448 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.763732 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.763693 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:29:29.766565 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:29:29.766544 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:30:31.600388 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.600346 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:30:31.600886 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.600830 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="registry" containerID="cri-o://09496a63e0463f0b520bbed9b5c4d8ba4ba72c9322ee4745df4204e8b720b4a3" gracePeriod=30 May 26 01:30:31.601126 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.600895 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" containerID="cri-o://b6e9ca6ddb8c8a70a09cc8da6e3cf26bca4085a2031f97dd3129974de83d8db2" gracePeriod=30 May 26 01:30:31.601269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.600895 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="offline" containerID="cri-o://bd3e72e50e76f5998e1baad70758e31ec9baf8b8dcc9868bc78d81e2f2df1c6b" gracePeriod=30 May 26 01:30:31.601269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.600902 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" containerID="cri-o://84608d5092fd1aee602efe559b868bb53a78ab64f18807b8e5f4deada6b4bc92" gracePeriod=30 May 26 01:30:31.978040 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.977934 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:30:31.983351 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.983312 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:31.985491 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.985465 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7wf7c\"" May 26 01:30:31.995935 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:31.995898 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:30:32.039082 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.039299 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.039299 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.039299 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.039299 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp9j8\" (UniqueName: \"kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.039491 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.039342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140570 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140533 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140577 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140627 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140656 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140683 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gp9j8\" (UniqueName: \"kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.140767 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.140731 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.141172 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.141136 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.143428 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.143392 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.143428 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.143419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.143789 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.143766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.143895 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.143872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.150946 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.150914 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp9j8\" (UniqueName: \"kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8\") pod \"feast-simple-feast-setup-64794c68fb-lfgzs\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.297863 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.297832 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:32.439380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.439351 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:30:32.442218 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:30:32.442191 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c2174de_f236_470c_be83_3040c9f8c066.slice/crio-f93b4566291f368443990691bec78ec879971ff301c94ebea9f59fc0cf621a9b WatchSource:0}: Error finding container f93b4566291f368443990691bec78ec879971ff301c94ebea9f59fc0cf621a9b: Status 404 returned error can't find the container with id f93b4566291f368443990691bec78ec879971ff301c94ebea9f59fc0cf621a9b May 26 01:30:32.961448 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.961408 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640"} May 26 01:30:32.961448 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.961454 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"f93b4566291f368443990691bec78ec879971ff301c94ebea9f59fc0cf621a9b"} May 26 01:30:32.964666 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.964625 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="84608d5092fd1aee602efe559b868bb53a78ab64f18807b8e5f4deada6b4bc92" exitCode=0 May 26 01:30:32.964666 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.964660 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="b6e9ca6ddb8c8a70a09cc8da6e3cf26bca4085a2031f97dd3129974de83d8db2" exitCode=0 May 26 01:30:32.964864 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.964692 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"84608d5092fd1aee602efe559b868bb53a78ab64f18807b8e5f4deada6b4bc92"} May 26 01:30:32.964864 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:32.964735 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"b6e9ca6ddb8c8a70a09cc8da6e3cf26bca4085a2031f97dd3129974de83d8db2"} May 26 01:30:37.981043 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:37.981006 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640" exitCode=0 May 26 01:30:37.981531 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:37.981071 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640"} May 26 01:30:38.986152 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:38.986108 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea"} May 26 01:30:39.282922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:39.282812 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" May 26 01:30:39.764619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:39.764570 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" May 26 01:30:44.005188 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.005045 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea" exitCode=0 May 26 01:30:44.005188 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.005145 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea"} May 26 01:30:44.345059 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.345013 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:30:44.345401 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.345220 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:30:44.351516 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.351480 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:30:44.352042 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:44.352022 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:30:45.013342 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:45.013273 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351"} May 26 01:30:45.013808 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:45.013352 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794"} May 26 01:30:45.013808 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:45.013368 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff"} May 26 01:30:45.013808 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:45.013383 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerStarted","Data":"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf"} May 26 01:30:45.036783 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:45.036716 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podStartSLOduration=14.036695854 podStartE2EDuration="14.036695854s" podCreationTimestamp="2026-05-26 01:30:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:30:45.034784481 +0000 UTC m=+1201.380615947" watchObservedRunningTime="2026-05-26 01:30:45.036695854 +0000 UTC m=+1201.382527321" May 26 01:30:47.298283 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.298238 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:47.298772 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.298296 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:47.298772 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.298310 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:47.298772 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.298324 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:47.300437 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.300394 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" May 26 01:30:47.300581 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.300441 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" May 26 01:30:47.300581 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.300564 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused" May 26 01:30:47.300702 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:47.300393 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" May 26 01:30:49.283170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:49.283082 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" May 26 01:30:49.764294 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:49.764232 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" May 26 01:30:50.299135 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.299074 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:50.299617 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.299587 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:50.299761 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.299629 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:50.299761 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.299736 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:50.299875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.299806 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:50.303823 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:50.303801 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.037513 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.037478 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.037513 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.037516 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.037776 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.037527 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.037962 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.037942 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.038175 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.038154 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:51.040484 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:51.040469 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:30:59.282330 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:59.282279 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" May 26 01:30:59.282729 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:59.282426 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:30:59.764852 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:59.764805 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" May 26 01:30:59.765034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:30:59.764942 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:31:02.074754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.074718 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="bd3e72e50e76f5998e1baad70758e31ec9baf8b8dcc9868bc78d81e2f2df1c6b" exitCode=137 May 26 01:31:02.074754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.074749 2568 generic.go:358] "Generic (PLEG): container finished" podID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerID="09496a63e0463f0b520bbed9b5c4d8ba4ba72c9322ee4745df4204e8b720b4a3" exitCode=137 May 26 01:31:02.075188 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.074791 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"bd3e72e50e76f5998e1baad70758e31ec9baf8b8dcc9868bc78d81e2f2df1c6b"} May 26 01:31:02.075188 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.074829 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"09496a63e0463f0b520bbed9b5c4d8ba4ba72c9322ee4745df4204e8b720b4a3"} May 26 01:31:02.257349 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.257323 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:31:02.415606 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415518 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.415606 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415556 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6xlr\" (UniqueName: \"kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.415606 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415604 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.415875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415639 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.415875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415847 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.415987 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.415907 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") pod \"6cd81081-43b4-4529-938c-f4f78f1a94aa\" (UID: \"6cd81081-43b4-4529-938c-f4f78f1a94aa\") " May 26 01:31:02.416244 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.416215 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data" (OuterVolumeSpecName: "feast-data") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:31:02.418610 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.418582 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr" (OuterVolumeSpecName: "kube-api-access-c6xlr") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "kube-api-access-c6xlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:31:02.418610 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.418583 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:31:02.419028 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.418997 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls" (OuterVolumeSpecName: "online-tls") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:31:02.419122 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.419043 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:31:02.419237 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.419219 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6cd81081-43b4-4529-938c-f4f78f1a94aa" (UID: "6cd81081-43b4-4529-938c-f4f78f1a94aa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:31:02.517585 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517538 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:02.517585 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517582 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6xlr\" (UniqueName: \"kubernetes.io/projected/6cd81081-43b4-4529-938c-f4f78f1a94aa-kube-api-access-c6xlr\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:02.517585 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517592 2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-ui-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:02.517585 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517601 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd81081-43b4-4529-938c-f4f78f1a94aa-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:02.517852 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517611 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:02.517852 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:02.517619 2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6cd81081-43b4-4529-938c-f4f78f1a94aa-offline-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:31:03.080761 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.080732 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" May 26 01:31:03.081193 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.080723 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk" event={"ID":"6cd81081-43b4-4529-938c-f4f78f1a94aa","Type":"ContainerDied","Data":"50e25a8a273afe5a27a57d34ba48bb9eda65d223466b753a4f66d419217c9777"} May 26 01:31:03.081193 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.080856 2568 scope.go:117] "RemoveContainer" containerID="84608d5092fd1aee602efe559b868bb53a78ab64f18807b8e5f4deada6b4bc92" May 26 01:31:03.090181 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.090163 2568 scope.go:117] "RemoveContainer" containerID="bd3e72e50e76f5998e1baad70758e31ec9baf8b8dcc9868bc78d81e2f2df1c6b" May 26 01:31:03.098142 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.098088 2568 scope.go:117] "RemoveContainer" containerID="b6e9ca6ddb8c8a70a09cc8da6e3cf26bca4085a2031f97dd3129974de83d8db2" May 26 01:31:03.102624 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.102595 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:31:03.105676 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.105648 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-pdtzk"] May 26 01:31:03.108121 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.108083 2568 scope.go:117] "RemoveContainer" containerID="09496a63e0463f0b520bbed9b5c4d8ba4ba72c9322ee4745df4204e8b720b4a3" May 26 01:31:03.115746 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.115730 2568 scope.go:117] "RemoveContainer" containerID="23c6308d0a4758c20862240217fe3c71f8c7d794ab46a4aa49bc061b45ae55f9" May 26 01:31:03.123026 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:03.123010 2568 scope.go:117] "RemoveContainer" containerID="e9363f93e298f73d69e7b8e08ff115d3da6c219bb56b617ad4f37755a8526808" May 26 01:31:04.272584 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:04.272553 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" path="/var/lib/kubelet/pods/6cd81081-43b4-4529-938c-f4f78f1a94aa/volumes" May 26 01:31:53.515173 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515137 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515502 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="feast-init" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515513 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="feast-init" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515522 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="registry" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515532 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="registry" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515545 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515552 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515564 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515569 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515583 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="offline" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515588 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="offline" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515595 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="feast-apply" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515600 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="feast-apply" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515657 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="online" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515669 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="registry" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515678 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="offline" May 26 01:31:53.515747 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.515686 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cd81081-43b4-4529-938c-f4f78f1a94aa" containerName="ui" May 26 01:31:53.520392 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.520369 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.522588 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.522560 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" May 26 01:31:53.522738 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.522717 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" May 26 01:31:53.522898 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.522879 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" May 26 01:31:53.522967 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.522948 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" May 26 01:31:53.523118 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.523085 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9p5zg\"" May 26 01:31:53.523205 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.523188 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" May 26 01:31:53.523427 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.523396 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" May 26 01:31:53.523598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.523582 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" May 26 01:31:53.528770 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.528669 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:31:53.665820 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.666008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.666008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.666008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.666008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.666008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.665983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjpn\" (UniqueName: \"kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.766947 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.766849 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.766947 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.766906 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.766947 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.766928 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.767307 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.766956 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.767307 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.766997 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.767307 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.767021 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjpn\" (UniqueName: \"kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.767307 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:31:53.767081 2568 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found May 26 01:31:53.767307 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:31:53.767209 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls podName:7347ec31-3158-45e8-86d3-12e9e939442b nodeName:}" failed. No retries permitted until 2026-05-26 01:31:54.267170607 +0000 UTC m=+1270.613002065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls") pod "feast-simple-feast-remote-setup-7565566f94-xfjmr" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b") : secret "feast-simple-feast-remote-setup-ui-tls" not found May 26 01:31:53.767532 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.767506 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.767695 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.767678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.770113 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.770066 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.770252 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.770233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:53.775373 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:53.775352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjpn\" (UniqueName: \"kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:54.270447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:54.270411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:54.273185 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:54.273148 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") pod \"feast-simple-feast-remote-setup-7565566f94-xfjmr\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:54.433313 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:54.433253 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:31:54.571699 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:54.571537 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:31:54.574045 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:31:54.574020 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7347ec31_3158_45e8_86d3_12e9e939442b.slice/crio-d0fef71fcd5eb6034b29e0b4022ec6dc92befbc4537bd1f5d232d4d2f185a697 WatchSource:0}: Error finding container d0fef71fcd5eb6034b29e0b4022ec6dc92befbc4537bd1f5d232d4d2f185a697: Status 404 returned error can't find the container with id d0fef71fcd5eb6034b29e0b4022ec6dc92befbc4537bd1f5d232d4d2f185a697 May 26 01:31:55.237866 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:55.237822 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb"} May 26 01:31:55.238042 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:55.237872 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"d0fef71fcd5eb6034b29e0b4022ec6dc92befbc4537bd1f5d232d4d2f185a697"} May 26 01:31:59.250175 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:59.250136 2568 generic.go:358] "Generic (PLEG): container finished" podID="7347ec31-3158-45e8-86d3-12e9e939442b" containerID="e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb" exitCode=0 May 26 01:31:59.250599 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:31:59.250187 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb"} May 26 01:32:00.254873 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:00.254837 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2"} May 26 01:32:05.272573 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:05.272493 2568 generic.go:358] "Generic (PLEG): container finished" podID="7347ec31-3158-45e8-86d3-12e9e939442b" containerID="61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2" exitCode=0 May 26 01:32:05.272573 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:05.272554 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2"} May 26 01:32:06.282199 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.282162 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703"} May 26 01:32:06.282601 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.282210 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9"} May 26 01:32:06.282601 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.282224 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerStarted","Data":"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e"} May 26 01:32:06.303160 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.303074 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podStartSLOduration=13.303054328 podStartE2EDuration="13.303054328s" podCreationTimestamp="2026-05-26 01:31:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:32:06.3023469 +0000 UTC m=+1282.648178368" watchObservedRunningTime="2026-05-26 01:32:06.303054328 +0000 UTC m=+1282.648885795" May 26 01:32:06.433983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.433941 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:06.434181 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.433998 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:06.434181 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.434014 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:06.435756 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.435711 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" May 26 01:32:06.435870 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.435785 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" May 26 01:32:06.435870 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:06.435725 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" May 26 01:32:09.434217 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:09.434168 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" May 26 01:32:09.434681 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:09.434229 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" May 26 01:32:09.434681 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:09.434194 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" May 26 01:32:12.434277 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.434243 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.434799 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.434504 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.434799 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.434603 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.434799 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.434640 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.435036 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.435017 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.435112 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.435066 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:12.438580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:12.438558 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:13.306316 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:13.306276 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:32:13.309330 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:32:13.309310 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:33:14.838830 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.838783 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:33:14.841474 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.839244 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" containerID="cri-o://b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e" gracePeriod=30 May 26 01:33:14.841474 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.839394 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" containerID="cri-o://3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703" gracePeriod=30 May 26 01:33:14.841474 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.839405 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" containerID="cri-o://713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9" gracePeriod=30 May 26 01:33:14.935930 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.935896 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:33:14.936276 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.936247 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="registry" containerID="cri-o://72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" gracePeriod=30 May 26 01:33:14.936390 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.936333 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="offline" containerID="cri-o://c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" gracePeriod=30 May 26 01:33:14.936615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.936337 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" containerID="cri-o://804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" gracePeriod=30 May 26 01:33:14.936939 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:14.936429 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" containerID="cri-o://6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" gracePeriod=30 May 26 01:33:15.504053 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:15.504016 2568 generic.go:358] "Generic (PLEG): container finished" podID="7347ec31-3158-45e8-86d3-12e9e939442b" containerID="3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703" exitCode=0 May 26 01:33:15.504239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:15.504055 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703"} May 26 01:33:16.511014 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.510977 2568 generic.go:358] "Generic (PLEG): container finished" podID="7347ec31-3158-45e8-86d3-12e9e939442b" containerID="b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e" exitCode=0 May 26 01:33:16.511458 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.511044 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e"} May 26 01:33:16.513441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.513419 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" exitCode=0 May 26 01:33:16.513441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.513437 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" exitCode=0 May 26 01:33:16.513580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.513490 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351"} May 26 01:33:16.513580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:16.513515 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff"} May 26 01:33:21.038536 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:21.038489 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" May 26 01:33:21.039064 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:21.038500 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" May 26 01:33:22.434741 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:22.434693 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" May 26 01:33:23.307392 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:23.307342 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" May 26 01:33:31.038458 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:31.038414 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" May 26 01:33:31.038920 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:31.038405 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" May 26 01:33:32.434949 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:32.434910 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" May 26 01:33:33.307034 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:33.306987 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" May 26 01:33:41.038497 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:41.038448 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" May 26 01:33:41.039047 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:41.038461 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" May 26 01:33:41.039047 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:41.038594 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:33:41.039047 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:41.038643 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:33:42.434806 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:42.434766 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" May 26 01:33:42.435243 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:42.434893 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:33:43.307447 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:43.307398 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" May 26 01:33:43.307627 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:43.307548 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:33:45.057028 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.057004 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:33:45.226874 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226790 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.226874 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226825 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.227079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226878 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.227079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226916 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.227079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226948 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.227079 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.226976 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjjpn\" (UniqueName: \"kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn\") pod \"7347ec31-3158-45e8-86d3-12e9e939442b\" (UID: \"7347ec31-3158-45e8-86d3-12e9e939442b\") " May 26 01:33:45.227472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.227447 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 01:33:45.227567 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.227507 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data" (OuterVolumeSpecName: "feast-data") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:33:45.229463 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.229429 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls" (OuterVolumeSpecName: "online-tls") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.229463 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.229437 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn" (OuterVolumeSpecName: "kube-api-access-hjjpn") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "kube-api-access-hjjpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:33:45.229596 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.229480 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.229596 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.229502 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7347ec31-3158-45e8-86d3-12e9e939442b" (UID: "7347ec31-3158-45e8-86d3-12e9e939442b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.328516 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328472 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjjpn\" (UniqueName: \"kubernetes.io/projected/7347ec31-3158-45e8-86d3-12e9e939442b-kube-api-access-hjjpn\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.328516 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328512 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7347ec31-3158-45e8-86d3-12e9e939442b-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.328719 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328527 2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-offline-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.328719 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328540 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.328719 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328551 2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7347ec31-3158-45e8-86d3-12e9e939442b-ui-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.328719 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.328563 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7347ec31-3158-45e8-86d3-12e9e939442b-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.583708 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.583685 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:33:45.602449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602422 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" exitCode=137 May 26 01:33:45.602449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602445 2568 generic.go:358] "Generic (PLEG): container finished" podID="5c2174de-f236-470c-be83-3040c9f8c066" containerID="72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" exitCode=137 May 26 01:33:45.602663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602506 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" May 26 01:33:45.602663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602513 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794"} May 26 01:33:45.602663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602546 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf"} May 26 01:33:45.602663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602558 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs" event={"ID":"5c2174de-f236-470c-be83-3040c9f8c066","Type":"ContainerDied","Data":"f93b4566291f368443990691bec78ec879971ff301c94ebea9f59fc0cf621a9b"} May 26 01:33:45.602663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.602572 2568 scope.go:117] "RemoveContainer" containerID="6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" May 26 01:33:45.604839 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.604818 2568 generic.go:358] "Generic (PLEG): container finished" podID="7347ec31-3158-45e8-86d3-12e9e939442b" containerID="713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9" exitCode=137 May 26 01:33:45.604946 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.604846 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9"} May 26 01:33:45.604946 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.604865 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" event={"ID":"7347ec31-3158-45e8-86d3-12e9e939442b","Type":"ContainerDied","Data":"d0fef71fcd5eb6034b29e0b4022ec6dc92befbc4537bd1f5d232d4d2f185a697"} May 26 01:33:45.604946 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.604882 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr" May 26 01:33:45.612908 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.612884 2568 scope.go:117] "RemoveContainer" containerID="c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" May 26 01:33:45.622935 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.622909 2568 scope.go:117] "RemoveContainer" containerID="804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" May 26 01:33:45.626835 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.626809 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:33:45.630203 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630181 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.630353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630222 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.630353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630269 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.630353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630289 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp9j8\" (UniqueName: \"kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.630353 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630320 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.630662 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630426 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7565566f94-xfjmr"] May 26 01:33:45.630771 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630729 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data" (OuterVolumeSpecName: "feast-data") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:33:45.630871 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.630851 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls\") pod \"5c2174de-f236-470c-be83-3040c9f8c066\" (UID: \"5c2174de-f236-470c-be83-3040c9f8c066\") " May 26 01:33:45.631172 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.631153 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5c2174de-f236-470c-be83-3040c9f8c066-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.633010 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.632995 2568 scope.go:117] "RemoveContainer" containerID="72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" May 26 01:33:45.633638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.633618 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.640741 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.640724 2568 scope.go:117] "RemoveContainer" containerID="ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea" May 26 01:33:45.641407 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.641388 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.647891 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.647871 2568 scope.go:117] "RemoveContainer" containerID="e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640" May 26 01:33:45.653509 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.653481 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls" (OuterVolumeSpecName: "online-tls") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.653604 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.653538 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:33:45.653604 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.653543 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8" (OuterVolumeSpecName: "kube-api-access-gp9j8") pod "5c2174de-f236-470c-be83-3040c9f8c066" (UID: "5c2174de-f236-470c-be83-3040c9f8c066"). InnerVolumeSpecName "kube-api-access-gp9j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:33:45.655658 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.655640 2568 scope.go:117] "RemoveContainer" containerID="6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" May 26 01:33:45.655932 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.655915 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351\": container with ID starting with 6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351 not found: ID does not exist" containerID="6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" May 26 01:33:45.655978 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.655942 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351"} err="failed to get container status \"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351\": rpc error: code = NotFound desc = could not find container \"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351\": container with ID starting with 6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351 not found: ID does not exist" May 26 01:33:45.655978 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.655966 2568 scope.go:117] "RemoveContainer" containerID="c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" May 26 01:33:45.656238 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.656219 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794\": container with ID starting with c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794 not found: ID does not exist" containerID="c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" May 26 01:33:45.656296 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656242 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794"} err="failed to get container status \"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794\": rpc error: code = NotFound desc = could not find container \"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794\": container with ID starting with c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794 not found: ID does not exist" May 26 01:33:45.656296 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656260 2568 scope.go:117] "RemoveContainer" containerID="804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" May 26 01:33:45.656484 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.656468 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff\": container with ID starting with 804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff not found: ID does not exist" containerID="804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" May 26 01:33:45.656526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656491 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff"} err="failed to get container status \"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff\": rpc error: code = NotFound desc = could not find container \"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff\": container with ID starting with 804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff not found: ID does not exist" May 26 01:33:45.656526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656514 2568 scope.go:117] "RemoveContainer" containerID="72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" May 26 01:33:45.656729 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.656714 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf\": container with ID starting with 72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf not found: ID does not exist" containerID="72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" May 26 01:33:45.656774 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656731 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf"} err="failed to get container status \"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf\": rpc error: code = NotFound desc = could not find container \"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf\": container with ID starting with 72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf not found: ID does not exist" May 26 01:33:45.656774 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656746 2568 scope.go:117] "RemoveContainer" containerID="ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea" May 26 01:33:45.656922 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.656907 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea\": container with ID starting with ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea not found: ID does not exist" containerID="ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea" May 26 01:33:45.656962 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656925 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea"} err="failed to get container status \"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea\": rpc error: code = NotFound desc = could not find container \"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea\": container with ID starting with ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea not found: ID does not exist" May 26 01:33:45.656962 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.656938 2568 scope.go:117] "RemoveContainer" containerID="e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640" May 26 01:33:45.657169 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.657143 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640\": container with ID starting with e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640 not found: ID does not exist" containerID="e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640" May 26 01:33:45.657225 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657172 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640"} err="failed to get container status \"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640\": rpc error: code = NotFound desc = could not find container \"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640\": container with ID starting with e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640 not found: ID does not exist" May 26 01:33:45.657225 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657186 2568 scope.go:117] "RemoveContainer" containerID="6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351" May 26 01:33:45.657380 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657360 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351"} err="failed to get container status \"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351\": rpc error: code = NotFound desc = could not find container \"6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351\": container with ID starting with 6eb491498a1a8e8e9d1b395c52e08eafbe6d6a3cc358448765298cdedc8d2351 not found: ID does not exist" May 26 01:33:45.657446 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657383 2568 scope.go:117] "RemoveContainer" containerID="c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794" May 26 01:33:45.657574 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657558 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794"} err="failed to get container status \"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794\": rpc error: code = NotFound desc = could not find container \"c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794\": container with ID starting with c4188cbd918a2c67a653bececd3cb272e882fa31b78d1f7a31743485100b5794 not found: ID does not exist" May 26 01:33:45.657620 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657576 2568 scope.go:117] "RemoveContainer" containerID="804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff" May 26 01:33:45.657760 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657741 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff"} err="failed to get container status \"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff\": rpc error: code = NotFound desc = could not find container \"804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff\": container with ID starting with 804d35333a931633ffdb2e8f587690a242ca1e01b9d20233d7616fa0c991a8ff not found: ID does not exist" May 26 01:33:45.657808 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657762 2568 scope.go:117] "RemoveContainer" containerID="72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf" May 26 01:33:45.657945 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657925 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf"} err="failed to get container status \"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf\": rpc error: code = NotFound desc = could not find container \"72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf\": container with ID starting with 72b8558f647a3dda0c375cf6a9f62ca9aa25a11c872a946af0ead1b13a925ccf not found: ID does not exist" May 26 01:33:45.658015 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.657946 2568 scope.go:117] "RemoveContainer" containerID="ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea" May 26 01:33:45.658191 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.658175 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea"} err="failed to get container status \"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea\": rpc error: code = NotFound desc = could not find container \"ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea\": container with ID starting with ccb052b3bf29392630363121172e568159dfc4d79cf10eb3febef7e013e144ea not found: ID does not exist" May 26 01:33:45.658243 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.658192 2568 scope.go:117] "RemoveContainer" containerID="e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640" May 26 01:33:45.658381 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.658362 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640"} err="failed to get container status \"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640\": rpc error: code = NotFound desc = could not find container \"e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640\": container with ID starting with e763fa45eb809a6bf9b4685bb2419e56b1cf1c9ea41507d5ee1c9ea69e280640 not found: ID does not exist" May 26 01:33:45.658450 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.658383 2568 scope.go:117] "RemoveContainer" containerID="3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703" May 26 01:33:45.667554 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.667522 2568 scope.go:117] "RemoveContainer" containerID="713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9" May 26 01:33:45.675209 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.675188 2568 scope.go:117] "RemoveContainer" containerID="b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e" May 26 01:33:45.682312 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.682295 2568 scope.go:117] "RemoveContainer" containerID="61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2" May 26 01:33:45.689478 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.689459 2568 scope.go:117] "RemoveContainer" containerID="e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb" May 26 01:33:45.696588 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.696571 2568 scope.go:117] "RemoveContainer" containerID="3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703" May 26 01:33:45.696868 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.696840 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703\": container with ID starting with 3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703 not found: ID does not exist" containerID="3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703" May 26 01:33:45.696916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.696876 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703"} err="failed to get container status \"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703\": rpc error: code = NotFound desc = could not find container \"3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703\": container with ID starting with 3e169630a5d57774fa16953bd846dcb309187b7e690a98c7d07000a7396f4703 not found: ID does not exist" May 26 01:33:45.696916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.696899 2568 scope.go:117] "RemoveContainer" containerID="713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9" May 26 01:33:45.697169 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.697143 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9\": container with ID starting with 713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9 not found: ID does not exist" containerID="713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9" May 26 01:33:45.697228 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697177 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9"} err="failed to get container status \"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9\": rpc error: code = NotFound desc = could not find container \"713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9\": container with ID starting with 713c938ec7204a4bbbad3f348fd154667ef3a04e038f7fc421948b13e05642b9 not found: ID does not exist" May 26 01:33:45.697228 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697193 2568 scope.go:117] "RemoveContainer" containerID="b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e" May 26 01:33:45.697427 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.697411 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e\": container with ID starting with b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e not found: ID does not exist" containerID="b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e" May 26 01:33:45.697467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697442 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e"} err="failed to get container status \"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e\": rpc error: code = NotFound desc = could not find container \"b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e\": container with ID starting with b88b813cf93bafd39e0f92e06a763a9cc767b4716f473348e8c21bab8dc05e1e not found: ID does not exist" May 26 01:33:45.697467 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697457 2568 scope.go:117] "RemoveContainer" containerID="61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2" May 26 01:33:45.697663 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.697644 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2\": container with ID starting with 61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2 not found: ID does not exist" containerID="61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2" May 26 01:33:45.697701 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697668 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2"} err="failed to get container status \"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2\": rpc error: code = NotFound desc = could not find container \"61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2\": container with ID starting with 61812aa7caec7ab92cec9aa37020fbb6ce23411c0e6afd402d4ba3877f51ede2 not found: ID does not exist" May 26 01:33:45.697701 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697681 2568 scope.go:117] "RemoveContainer" containerID="e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb" May 26 01:33:45.697886 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:33:45.697849 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb\": container with ID starting with e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb not found: ID does not exist" containerID="e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb" May 26 01:33:45.697886 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.697864 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb"} err="failed to get container status \"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb\": rpc error: code = NotFound desc = could not find container \"e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb\": container with ID starting with e8cd26ebde1b208909d0cf9e39411700aa40ab4ebdccb32893e683c1810935fb not found: ID does not exist" May 26 01:33:45.732419 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.732383 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.732419 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.732414 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.732419 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.732424 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp9j8\" (UniqueName: \"kubernetes.io/projected/5c2174de-f236-470c-be83-3040c9f8c066-kube-api-access-gp9j8\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.732638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.732435 2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-ui-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.732638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.732444 2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5c2174de-f236-470c-be83-3040c9f8c066-offline-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:33:45.924664 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.924633 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:33:45.929623 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:45.929597 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-64794c68fb-lfgzs"] May 26 01:33:46.275175 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:46.273486 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c2174de-f236-470c-be83-3040c9f8c066" path="/var/lib/kubelet/pods/5c2174de-f236-470c-be83-3040c9f8c066/volumes" May 26 01:33:46.275175 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:46.274409 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" path="/var/lib/kubelet/pods/7347ec31-3158-45e8-86d3-12e9e939442b/volumes" May 26 01:33:57.775086 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775044 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:33:57.775623 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775595 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="offline" May 26 01:33:57.775623 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775622 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="offline" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775641 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775649 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775658 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775666 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775686 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775693 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775710 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="feast-init" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775725 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="feast-init" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775732 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="feast-init" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775737 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="feast-init" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775745 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="feast-apply" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775752 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="feast-apply" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775763 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="feast-apply" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775770 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="feast-apply" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775788 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775795 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775803 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775810 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775818 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="registry" May 26 01:33:57.775827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775826 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="registry" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775915 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="online" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775932 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="registry" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775941 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="offline" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775957 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="ui" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775966 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="offline" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775976 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c2174de-f236-470c-be83-3040c9f8c066" containerName="ui" May 26 01:33:57.776630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.775986 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="7347ec31-3158-45e8-86d3-12e9e939442b" containerName="online" May 26 01:33:57.781280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.781255 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.784138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.784082 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 26 01:33:57.784615 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.784123 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" May 26 01:33:57.784765 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.784314 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 26 01:33:57.785265 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.784897 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:33:57.785265 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.784356 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-hszxh\"" May 26 01:33:57.815227 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.815195 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:33:57.818374 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.818357 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:33:57.823226 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.823202 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:33:57.836122 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.836066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.836122 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.836115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srsnx\" (UniqueName: \"kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.936663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.936619 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.936663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.936660 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srsnx\" (UniqueName: \"kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.936875 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.936714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5r4f\" (UniqueName: \"kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f\") pod \"redis-854544c579-xjs7d\" (UID: \"00972c5f-6903-4ef7-aa8d-99dff87d848e\") " pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:33:57.937052 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.937032 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:57.944553 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:57.944518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srsnx\" (UniqueName: \"kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx\") pod \"postgres-7c7656cc6d-tcx2z\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:58.037449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.037351 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5r4f\" (UniqueName: \"kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f\") pod \"redis-854544c579-xjs7d\" (UID: \"00972c5f-6903-4ef7-aa8d-99dff87d848e\") " pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:33:58.045197 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.045172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5r4f\" (UniqueName: \"kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f\") pod \"redis-854544c579-xjs7d\" (UID: \"00972c5f-6903-4ef7-aa8d-99dff87d848e\") " pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:33:58.101131 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.101054 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:33:58.129057 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.129028 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:33:58.241778 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.241744 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:33:58.244471 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:33:58.244430 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode295e07f_7b23_442c_9c89_9bd9a348aa8c.slice/crio-f7ae0e02d59e24a9f48b14fa7c0d78bee971493cff014493fd67e344828e45a5 WatchSource:0}: Error finding container f7ae0e02d59e24a9f48b14fa7c0d78bee971493cff014493fd67e344828e45a5: Status 404 returned error can't find the container with id f7ae0e02d59e24a9f48b14fa7c0d78bee971493cff014493fd67e344828e45a5 May 26 01:33:58.246444 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.246427 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 01:33:58.270034 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:33:58.270003 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00972c5f_6903_4ef7_aa8d_99dff87d848e.slice/crio-683710f1c293228ef39262333a3f87d19623f476a50c7fceab2bcd5d9c66d37f WatchSource:0}: Error finding container 683710f1c293228ef39262333a3f87d19623f476a50c7fceab2bcd5d9c66d37f: Status 404 returned error can't find the container with id 683710f1c293228ef39262333a3f87d19623f476a50c7fceab2bcd5d9c66d37f May 26 01:33:58.271941 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.271922 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:33:58.645431 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.645389 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-xjs7d" event={"ID":"00972c5f-6903-4ef7-aa8d-99dff87d848e","Type":"ContainerStarted","Data":"683710f1c293228ef39262333a3f87d19623f476a50c7fceab2bcd5d9c66d37f"} May 26 01:33:58.646609 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:33:58.646581 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" event={"ID":"e295e07f-7b23-442c-9c89-9bd9a348aa8c","Type":"ContainerStarted","Data":"f7ae0e02d59e24a9f48b14fa7c0d78bee971493cff014493fd67e344828e45a5"} May 26 01:34:00.655815 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:00.655769 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-xjs7d" event={"ID":"00972c5f-6903-4ef7-aa8d-99dff87d848e","Type":"ContainerStarted","Data":"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0"} May 26 01:34:00.671413 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:00.671364 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-xjs7d" podStartSLOduration=2.04861256 podStartE2EDuration="3.671350426s" podCreationTimestamp="2026-05-26 01:33:57 +0000 UTC" firstStartedPulling="2026-05-26 01:33:58.27191582 +0000 UTC m=+1394.617747264" lastFinishedPulling="2026-05-26 01:33:59.894653683 +0000 UTC m=+1396.240485130" observedRunningTime="2026-05-26 01:34:00.669831813 +0000 UTC m=+1397.015663278" watchObservedRunningTime="2026-05-26 01:34:00.671350426 +0000 UTC m=+1397.017181891" May 26 01:34:04.669847 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:04.669810 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" event={"ID":"e295e07f-7b23-442c-9c89-9bd9a348aa8c","Type":"ContainerStarted","Data":"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b"} May 26 01:34:04.683731 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:04.683676 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" podStartSLOduration=1.895613225 podStartE2EDuration="7.683656609s" podCreationTimestamp="2026-05-26 01:33:57 +0000 UTC" firstStartedPulling="2026-05-26 01:33:58.246556911 +0000 UTC m=+1394.592388355" lastFinishedPulling="2026-05-26 01:34:04.034600293 +0000 UTC m=+1400.380431739" observedRunningTime="2026-05-26 01:34:04.68316619 +0000 UTC m=+1401.028997656" watchObservedRunningTime="2026-05-26 01:34:04.683656609 +0000 UTC m=+1401.029488075" May 26 01:34:08.516663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.516629 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:34:08.522182 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.522160 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.524045 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.524024 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" May 26 01:34:08.524313 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.524297 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" May 26 01:34:08.524444 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.524424 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" May 26 01:34:08.524500 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.524490 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 26 01:34:08.524548 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.524516 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-ndb8b\"" May 26 01:34:08.529008 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.528989 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:34:08.630718 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.630680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.630718 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.630726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.630955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.630746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skq7x\" (UniqueName: \"kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.630955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.630866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.630955 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.630900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732156 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skq7x\" (UniqueName: \"kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732202 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732226 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732263 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732290 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.732771 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.732744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.734890 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.734867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.734983 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.734912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.735051 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.735029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.739171 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.739151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skq7x\" (UniqueName: \"kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x\") pod \"feast-credit-scoring-797885465-ghnh4\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.832945 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.832904 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:08.974180 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:08.974154 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:34:08.976857 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:34:08.976823 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded487354_7677_4adc_ab8b_7e69b15a9ca6.slice/crio-42db19ca3742c9414538e441a78dbcf42d3034bf2d28b40daa4de2f6282baac0 WatchSource:0}: Error finding container 42db19ca3742c9414538e441a78dbcf42d3034bf2d28b40daa4de2f6282baac0: Status 404 returned error can't find the container with id 42db19ca3742c9414538e441a78dbcf42d3034bf2d28b40daa4de2f6282baac0 May 26 01:34:09.686334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:09.686297 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b"} May 26 01:34:09.686334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:09.686340 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"42db19ca3742c9414538e441a78dbcf42d3034bf2d28b40daa4de2f6282baac0"} May 26 01:34:10.690834 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:10.690736 2568 generic.go:358] "Generic (PLEG): container finished" podID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerID="1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b" exitCode=0 May 26 01:34:10.690834 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:10.690812 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b"} May 26 01:34:11.696012 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:11.695980 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5"} May 26 01:34:17.716113 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:17.716069 2568 generic.go:358] "Generic (PLEG): container finished" podID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerID="d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5" exitCode=0 May 26 01:34:17.716524 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:17.716144 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5"} May 26 01:34:18.722904 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.722857 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9"} May 26 01:34:18.723297 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.722919 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8"} May 26 01:34:18.723297 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.722937 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerStarted","Data":"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338"} May 26 01:34:18.749630 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.749568 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podStartSLOduration=10.749546787 podStartE2EDuration="10.749546787s" podCreationTimestamp="2026-05-26 01:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:34:18.74667799 +0000 UTC m=+1415.092509478" watchObservedRunningTime="2026-05-26 01:34:18.749546787 +0000 UTC m=+1415.095378253" May 26 01:34:18.833879 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.833844 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:18.834070 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.833909 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:18.834070 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:18.833941 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:20.833919 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.833874 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:20.834414 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.833933 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:20.834414 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.833948 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:20.835280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.835252 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" May 26 01:34:20.835280 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.835258 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused" May 26 01:34:20.835458 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:20.835267 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" May 26 01:34:23.834216 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:23.834115 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" May 26 01:34:23.834804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:23.834776 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:23.835795 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:23.835769 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:23.969949 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:23.969911 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:24.747684 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:24.747652 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:26.834163 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:26.834087 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" May 26 01:34:29.833609 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:29.833581 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:34:29.834261 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:34:29.834243 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:35:31.184139 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.184085 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:35:31.184561 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.184504 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" containerID="cri-o://8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" gracePeriod=30 May 26 01:35:31.184637 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.184562 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" containerID="cri-o://adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" gracePeriod=30 May 26 01:35:31.184637 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.184577 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="offline" containerID="cri-o://dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" gracePeriod=30 May 26 01:35:31.200390 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.200364 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:35:31.200556 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.200538 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" podUID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" containerName="postgres" containerID="cri-o://a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b" gracePeriod=30 May 26 01:35:31.204743 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.204721 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:35:31.204915 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.204895 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-xjs7d" podUID="00972c5f-6903-4ef7-aa8d-99dff87d848e" containerName="redis" containerID="cri-o://1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0" gracePeriod=30 May 26 01:35:31.473276 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.473246 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:35:31.476865 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.476842 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:35:31.555140 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.555074 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata\") pod \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " May 26 01:35:31.555344 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.555160 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srsnx\" (UniqueName: \"kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx\") pod \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\" (UID: \"e295e07f-7b23-442c-9c89-9bd9a348aa8c\") " May 26 01:35:31.555344 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.555196 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5r4f\" (UniqueName: \"kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f\") pod \"00972c5f-6903-4ef7-aa8d-99dff87d848e\" (UID: \"00972c5f-6903-4ef7-aa8d-99dff87d848e\") " May 26 01:35:31.557534 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.557495 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f" (OuterVolumeSpecName: "kube-api-access-f5r4f") pod "00972c5f-6903-4ef7-aa8d-99dff87d848e" (UID: "00972c5f-6903-4ef7-aa8d-99dff87d848e"). InnerVolumeSpecName "kube-api-access-f5r4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:35:31.557684 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.557538 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx" (OuterVolumeSpecName: "kube-api-access-srsnx") pod "e295e07f-7b23-442c-9c89-9bd9a348aa8c" (UID: "e295e07f-7b23-442c-9c89-9bd9a348aa8c"). InnerVolumeSpecName "kube-api-access-srsnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:35:31.583988 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.583928 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "e295e07f-7b23-442c-9c89-9bd9a348aa8c" (UID: "e295e07f-7b23-442c-9c89-9bd9a348aa8c"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:35:31.655959 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.655903 2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e295e07f-7b23-442c-9c89-9bd9a348aa8c-postgresdata\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:35:31.655959 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.655942 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srsnx\" (UniqueName: \"kubernetes.io/projected/e295e07f-7b23-442c-9c89-9bd9a348aa8c-kube-api-access-srsnx\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:35:31.655959 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.655953 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5r4f\" (UniqueName: \"kubernetes.io/projected/00972c5f-6903-4ef7-aa8d-99dff87d848e-kube-api-access-f5r4f\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:35:31.957486 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.957450 2568 generic.go:358] "Generic (PLEG): container finished" podID="00972c5f-6903-4ef7-aa8d-99dff87d848e" containerID="1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0" exitCode=0 May 26 01:35:31.957663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.957526 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-xjs7d" event={"ID":"00972c5f-6903-4ef7-aa8d-99dff87d848e","Type":"ContainerDied","Data":"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0"} May 26 01:35:31.957663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.957567 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-xjs7d" event={"ID":"00972c5f-6903-4ef7-aa8d-99dff87d848e","Type":"ContainerDied","Data":"683710f1c293228ef39262333a3f87d19623f476a50c7fceab2bcd5d9c66d37f"} May 26 01:35:31.957663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.957530 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-xjs7d" May 26 01:35:31.957663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.957634 2568 scope.go:117] "RemoveContainer" containerID="1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0" May 26 01:35:31.958717 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.958628 2568 generic.go:358] "Generic (PLEG): container finished" podID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" containerID="a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b" exitCode=0 May 26 01:35:31.958717 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.958682 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" May 26 01:35:31.958717 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.958705 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" event={"ID":"e295e07f-7b23-442c-9c89-9bd9a348aa8c","Type":"ContainerDied","Data":"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b"} May 26 01:35:31.958836 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.958736 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-tcx2z" event={"ID":"e295e07f-7b23-442c-9c89-9bd9a348aa8c","Type":"ContainerDied","Data":"f7ae0e02d59e24a9f48b14fa7c0d78bee971493cff014493fd67e344828e45a5"} May 26 01:35:31.979286 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.979253 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:35:31.982512 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.982486 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-tcx2z"] May 26 01:35:31.992378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.992349 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:35:31.996603 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.996513 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-xjs7d"] May 26 01:35:31.999531 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.999510 2568 scope.go:117] "RemoveContainer" containerID="1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0" May 26 01:35:31.999872 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:35:31.999848 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0\": container with ID starting with 1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0 not found: ID does not exist" containerID="1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0" May 26 01:35:31.999966 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.999885 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0"} err="failed to get container status \"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0\": rpc error: code = NotFound desc = could not find container \"1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0\": container with ID starting with 1cf57d4bcfd7f0eeb9263036b74cac9d3d4ef482411bc40f56f75bab3961c9d0 not found: ID does not exist" May 26 01:35:31.999966 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:31.999912 2568 scope.go:117] "RemoveContainer" containerID="a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b" May 26 01:35:32.007332 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.007309 2568 scope.go:117] "RemoveContainer" containerID="a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b" May 26 01:35:32.007574 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:35:32.007556 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b\": container with ID starting with a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b not found: ID does not exist" containerID="a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b" May 26 01:35:32.007631 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.007580 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b"} err="failed to get container status \"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b\": rpc error: code = NotFound desc = could not find container \"a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b\": container with ID starting with a7ca9cd82a09399e01ba6b20b2e87b129161a9fb35ffd018ce188048a8efee1b not found: ID does not exist" May 26 01:35:32.272598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.272567 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00972c5f-6903-4ef7-aa8d-99dff87d848e" path="/var/lib/kubelet/pods/00972c5f-6903-4ef7-aa8d-99dff87d848e/volumes" May 26 01:35:32.272927 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.272914 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" path="/var/lib/kubelet/pods/e295e07f-7b23-442c-9c89-9bd9a348aa8c/volumes" May 26 01:35:32.965790 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.965755 2568 generic.go:358] "Generic (PLEG): container finished" podID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerID="adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" exitCode=0 May 26 01:35:32.966046 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:32.965848 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8"} May 26 01:35:34.744804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:34.744757 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" May 26 01:35:44.381873 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:44.381846 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:35:44.384365 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:44.384338 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:35:44.386649 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:44.386626 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:35:44.389191 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:44.389171 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:35:44.745250 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:44.745160 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" May 26 01:35:54.745286 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:54.745241 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" May 26 01:35:54.745853 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:35:54.745394 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:36:01.832928 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.832904 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:36:01.911153 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.911119 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data\") pod \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " May 26 01:36:01.911324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.911197 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skq7x\" (UniqueName: \"kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x\") pod \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " May 26 01:36:01.911324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.911226 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls\") pod \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " May 26 01:36:01.911324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.911241 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls\") pod \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " May 26 01:36:01.911324 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.911311 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls\") pod \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\" (UID: \"ed487354-7677-4adc-ab8b-7e69b15a9ca6\") " May 26 01:36:01.913592 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.913558 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ed487354-7677-4adc-ab8b-7e69b15a9ca6" (UID: "ed487354-7677-4adc-ab8b-7e69b15a9ca6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:36:01.913725 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.913566 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ed487354-7677-4adc-ab8b-7e69b15a9ca6" (UID: "ed487354-7677-4adc-ab8b-7e69b15a9ca6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:36:01.913856 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.913840 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x" (OuterVolumeSpecName: "kube-api-access-skq7x") pod "ed487354-7677-4adc-ab8b-7e69b15a9ca6" (UID: "ed487354-7677-4adc-ab8b-7e69b15a9ca6"). InnerVolumeSpecName "kube-api-access-skq7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:36:01.913912 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.913852 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls" (OuterVolumeSpecName: "online-tls") pod "ed487354-7677-4adc-ab8b-7e69b15a9ca6" (UID: "ed487354-7677-4adc-ab8b-7e69b15a9ca6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:36:01.919114 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:01.919066 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data" (OuterVolumeSpecName: "feast-data") pod "ed487354-7677-4adc-ab8b-7e69b15a9ca6" (UID: "ed487354-7677-4adc-ab8b-7e69b15a9ca6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:36:02.012619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.012532 2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-offline-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:36:02.012619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.012565 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ed487354-7677-4adc-ab8b-7e69b15a9ca6-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:36:02.012619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.012576 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skq7x\" (UniqueName: \"kubernetes.io/projected/ed487354-7677-4adc-ab8b-7e69b15a9ca6-kube-api-access-skq7x\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:36:02.012619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.012587 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:36:02.012619 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.012596 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ed487354-7677-4adc-ab8b-7e69b15a9ca6-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:36:02.059682 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059649 2568 generic.go:358] "Generic (PLEG): container finished" podID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerID="dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" exitCode=137 May 26 01:36:02.059682 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059675 2568 generic.go:358] "Generic (PLEG): container finished" podID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerID="8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" exitCode=137 May 26 01:36:02.059922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059701 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9"} May 26 01:36:02.059922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059741 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338"} May 26 01:36:02.059922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059744 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" May 26 01:36:02.059922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059763 2568 scope.go:117] "RemoveContainer" containerID="dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" May 26 01:36:02.059922 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.059753 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-797885465-ghnh4" event={"ID":"ed487354-7677-4adc-ab8b-7e69b15a9ca6","Type":"ContainerDied","Data":"42db19ca3742c9414538e441a78dbcf42d3034bf2d28b40daa4de2f6282baac0"} May 26 01:36:02.068668 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.068615 2568 scope.go:117] "RemoveContainer" containerID="adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" May 26 01:36:02.076545 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.076526 2568 scope.go:117] "RemoveContainer" containerID="8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" May 26 01:36:02.081909 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.081888 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:36:02.084958 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.084937 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-797885465-ghnh4"] May 26 01:36:02.085485 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.085461 2568 scope.go:117] "RemoveContainer" containerID="d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5" May 26 01:36:02.092783 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.092765 2568 scope.go:117] "RemoveContainer" containerID="1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b" May 26 01:36:02.100315 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.100286 2568 scope.go:117] "RemoveContainer" containerID="dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" May 26 01:36:02.100572 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:36:02.100552 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9\": container with ID starting with dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9 not found: ID does not exist" containerID="dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" May 26 01:36:02.100617 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.100582 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9"} err="failed to get container status \"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9\": rpc error: code = NotFound desc = could not find container \"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9\": container with ID starting with dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9 not found: ID does not exist" May 26 01:36:02.100617 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.100603 2568 scope.go:117] "RemoveContainer" containerID="adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" May 26 01:36:02.100847 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:36:02.100827 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8\": container with ID starting with adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8 not found: ID does not exist" containerID="adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" May 26 01:36:02.100891 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.100855 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8"} err="failed to get container status \"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8\": rpc error: code = NotFound desc = could not find container \"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8\": container with ID starting with adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8 not found: ID does not exist" May 26 01:36:02.100891 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.100874 2568 scope.go:117] "RemoveContainer" containerID="8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" May 26 01:36:02.101078 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:36:02.101060 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338\": container with ID starting with 8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338 not found: ID does not exist" containerID="8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" May 26 01:36:02.101149 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101083 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338"} err="failed to get container status \"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338\": rpc error: code = NotFound desc = could not find container \"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338\": container with ID starting with 8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338 not found: ID does not exist" May 26 01:36:02.101149 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101121 2568 scope.go:117] "RemoveContainer" containerID="d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5" May 26 01:36:02.101348 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:36:02.101332 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5\": container with ID starting with d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5 not found: ID does not exist" containerID="d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5" May 26 01:36:02.101389 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101352 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5"} err="failed to get container status \"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5\": rpc error: code = NotFound desc = could not find container \"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5\": container with ID starting with d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5 not found: ID does not exist" May 26 01:36:02.101389 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101366 2568 scope.go:117] "RemoveContainer" containerID="1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b" May 26 01:36:02.101569 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:36:02.101550 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b\": container with ID starting with 1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b not found: ID does not exist" containerID="1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b" May 26 01:36:02.101612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101577 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b"} err="failed to get container status \"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b\": rpc error: code = NotFound desc = could not find container \"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b\": container with ID starting with 1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b not found: ID does not exist" May 26 01:36:02.101612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101591 2568 scope.go:117] "RemoveContainer" containerID="dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9" May 26 01:36:02.101801 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101781 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9"} err="failed to get container status \"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9\": rpc error: code = NotFound desc = could not find container \"dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9\": container with ID starting with dd1af96f7221048a7aec026c8acd3f5a977557dfd6f9d427a662d423c41941b9 not found: ID does not exist" May 26 01:36:02.101844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.101802 2568 scope.go:117] "RemoveContainer" containerID="adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8" May 26 01:36:02.102022 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102004 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8"} err="failed to get container status \"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8\": rpc error: code = NotFound desc = could not find container \"adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8\": container with ID starting with adf9de9f4efae69683456339cae2e4e924dfd35d92c13de43cdfe214396689e8 not found: ID does not exist" May 26 01:36:02.102022 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102022 2568 scope.go:117] "RemoveContainer" containerID="8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338" May 26 01:36:02.102248 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102214 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338"} err="failed to get container status \"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338\": rpc error: code = NotFound desc = could not find container \"8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338\": container with ID starting with 8f1d47b07a8c5a24c6c86682f100b14bb8fe72f25b16a49108a00407bc94e338 not found: ID does not exist" May 26 01:36:02.102298 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102250 2568 scope.go:117] "RemoveContainer" containerID="d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5" May 26 01:36:02.102477 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102460 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5"} err="failed to get container status \"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5\": rpc error: code = NotFound desc = could not find container \"d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5\": container with ID starting with d8327cb9cadd438a87eb75bd746c389050063f8bae27ba8ae0a7c2267aa4c4e5 not found: ID does not exist" May 26 01:36:02.102523 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102479 2568 scope.go:117] "RemoveContainer" containerID="1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b" May 26 01:36:02.102683 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.102664 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b"} err="failed to get container status \"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b\": rpc error: code = NotFound desc = could not find container \"1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b\": container with ID starting with 1adf95e8c90822dc308fe19463b019fa85855d0deb3d94858aa5096ea862f51b not found: ID does not exist" May 26 01:36:02.272901 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:36:02.272822 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" path="/var/lib/kubelet/pods/ed487354-7677-4adc-ab8b-7e69b15a9ca6/volumes" May 26 01:37:34.425021 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.424941 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425278 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425290 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425306 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00972c5f-6903-4ef7-aa8d-99dff87d848e" containerName="redis" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425312 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00972c5f-6903-4ef7-aa8d-99dff87d848e" containerName="redis" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425317 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" containerName="postgres" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425322 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" containerName="postgres" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425329 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="offline" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425334 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="offline" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425349 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="feast-apply" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425354 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="feast-apply" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425359 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425364 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425370 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="feast-init" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425377 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="feast-init" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425422 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="offline" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425432 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="registry" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425439 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="00972c5f-6903-4ef7-aa8d-99dff87d848e" containerName="redis" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425446 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed487354-7677-4adc-ab8b-7e69b15a9ca6" containerName="online" May 26 01:37:34.425505 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.425454 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="e295e07f-7b23-442c-9c89-9bd9a348aa8c" containerName="postgres" May 26 01:37:34.427514 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.427492 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:37:34.429633 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.429608 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-7vzk9\"" May 26 01:37:34.429759 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.429631 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" May 26 01:37:34.430357 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.430336 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" May 26 01:37:34.440670 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.440647 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:37:34.480892 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.480853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxt2\" (UniqueName: \"kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2\") pod \"redis-854544c579-h4bgj\" (UID: \"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e\") " pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:37:34.582140 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.582083 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxt2\" (UniqueName: \"kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2\") pod \"redis-854544c579-h4bgj\" (UID: \"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e\") " pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:37:34.590310 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.590288 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxt2\" (UniqueName: \"kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2\") pod \"redis-854544c579-h4bgj\" (UID: \"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e\") " pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:37:34.747870 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.747774 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:37:34.872493 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:34.872467 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:37:34.874997 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:37:34.874967 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96bbf3bd_e678_4bd1_84e8_ddd93ed4ba0e.slice/crio-3f3086af4f3c640268c109091fc37cc5930b863be3090a048a78339f11f7631c WatchSource:0}: Error finding container 3f3086af4f3c640268c109091fc37cc5930b863be3090a048a78339f11f7631c: Status 404 returned error can't find the container with id 3f3086af4f3c640268c109091fc37cc5930b863be3090a048a78339f11f7631c May 26 01:37:35.336475 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:35.336440 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-h4bgj" event={"ID":"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e","Type":"ContainerStarted","Data":"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76"} May 26 01:37:35.336475 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:35.336474 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-h4bgj" event={"ID":"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e","Type":"ContainerStarted","Data":"3f3086af4f3c640268c109091fc37cc5930b863be3090a048a78339f11f7631c"} May 26 01:37:35.351362 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:35.351304 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-h4bgj" podStartSLOduration=1.351289157 podStartE2EDuration="1.351289157s" podCreationTimestamp="2026-05-26 01:37:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:37:35.350772048 +0000 UTC m=+1611.696603515" watchObservedRunningTime="2026-05-26 01:37:35.351289157 +0000 UTC m=+1611.697120623" May 26 01:37:39.857660 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.857617 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:37:39.859828 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.859808 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:39.861952 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.861928 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" May 26 01:37:39.868813 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.868788 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:37:39.926118 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.926058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:39.926118 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:39.926118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkgm\" (UniqueName: \"kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.027551 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.027513 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.027551 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.027555 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkgm\" (UniqueName: \"kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.027984 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.027957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.034844 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.034819 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkgm\" (UniqueName: \"kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm\") pod \"postgres-7c7656cc6d-vf49b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.171171 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.171032 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:37:40.298509 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.298472 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:37:40.304696 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:37:40.303334 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa30c2a2_cf9f_4e84_9139_a8433ea29e2b.slice/crio-b8cad7d2ec7021aaa99fbf4895ea1907f4dfcec34da227f381771fff5da8dd6c WatchSource:0}: Error finding container b8cad7d2ec7021aaa99fbf4895ea1907f4dfcec34da227f381771fff5da8dd6c: Status 404 returned error can't find the container with id b8cad7d2ec7021aaa99fbf4895ea1907f4dfcec34da227f381771fff5da8dd6c May 26 01:37:40.355454 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:40.355425 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" event={"ID":"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b","Type":"ContainerStarted","Data":"b8cad7d2ec7021aaa99fbf4895ea1907f4dfcec34da227f381771fff5da8dd6c"} May 26 01:37:41.360022 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:41.359985 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" event={"ID":"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b","Type":"ContainerStarted","Data":"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391"} May 26 01:37:41.375266 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:41.375206 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" podStartSLOduration=2.37518391 podStartE2EDuration="2.37518391s" podCreationTimestamp="2026-05-26 01:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:37:41.372581094 +0000 UTC m=+1617.718412559" watchObservedRunningTime="2026-05-26 01:37:41.37518391 +0000 UTC m=+1617.721015377" May 26 01:37:45.537375 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.537314 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:37:45.541233 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.541214 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.543588 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.543561 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" May 26 01:37:45.543717 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.543571 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" May 26 01:37:45.543717 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.543709 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" May 26 01:37:45.543838 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.543821 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-mpvn8\"" May 26 01:37:45.549638 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.549614 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:37:45.679312 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.679274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.679472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.679401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.679472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.679433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.679472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.679455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22j4c\" (UniqueName: \"kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.780267 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.780231 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.780267 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.780267 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.780487 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.780288 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22j4c\" (UniqueName: \"kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.780487 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.780336 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.780735 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.780711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.782900 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.782875 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.783040 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.783019 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.788274 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.788219 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22j4c\" (UniqueName: \"kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c\") pod \"feast-credit-scoring-777997c5c9-q5dzq\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.852117 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.852052 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:45.984911 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:45.984878 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:37:45.987380 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:37:45.987354 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9f0120_1707_4b01_a6d3_e244bb80e0a8.slice/crio-542d979f5d6245fc22847dd48cdabeeb7849de9f7ae9f6d27c899f85d6d07676 WatchSource:0}: Error finding container 542d979f5d6245fc22847dd48cdabeeb7849de9f7ae9f6d27c899f85d6d07676: Status 404 returned error can't find the container with id 542d979f5d6245fc22847dd48cdabeeb7849de9f7ae9f6d27c899f85d6d07676 May 26 01:37:46.376330 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:46.376240 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerStarted","Data":"dfa1d0b32439d046d8642bbac17e8a1d307a2b3f5230eb3086668a63012cdf19"} May 26 01:37:46.376330 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:46.376280 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerStarted","Data":"542d979f5d6245fc22847dd48cdabeeb7849de9f7ae9f6d27c899f85d6d07676"} May 26 01:37:47.380492 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:47.380459 2568 generic.go:358] "Generic (PLEG): container finished" podID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerID="dfa1d0b32439d046d8642bbac17e8a1d307a2b3f5230eb3086668a63012cdf19" exitCode=0 May 26 01:37:47.380855 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:47.380545 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerDied","Data":"dfa1d0b32439d046d8642bbac17e8a1d307a2b3f5230eb3086668a63012cdf19"} May 26 01:37:48.385209 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:48.385169 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerStarted","Data":"661d6d9233371bba932d59615d76a89f29e9bfb1efec3cbe01c763fbe17785ea"} May 26 01:37:55.409706 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:55.409673 2568 generic.go:358] "Generic (PLEG): container finished" podID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerID="661d6d9233371bba932d59615d76a89f29e9bfb1efec3cbe01c763fbe17785ea" exitCode=0 May 26 01:37:55.410132 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:55.409747 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerDied","Data":"661d6d9233371bba932d59615d76a89f29e9bfb1efec3cbe01c763fbe17785ea"} May 26 01:37:56.415170 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:56.415133 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerStarted","Data":"863ef2c8e6ba22a87747f50734cebe956e6ee9ce1d8bd1bcf67d31d8e204c1be"} May 26 01:37:56.415537 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:56.415183 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerStarted","Data":"524c5fd2f2833f36cd4825d295f141c1d0a4fa0bd751182edab26da85bcd24c1"} May 26 01:37:56.435555 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:56.435492 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podStartSLOduration=11.435472283 podStartE2EDuration="11.435472283s" podCreationTimestamp="2026-05-26 01:37:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:37:56.433912343 +0000 UTC m=+1632.779743810" watchObservedRunningTime="2026-05-26 01:37:56.435472283 +0000 UTC m=+1632.781303750" May 26 01:37:57.852271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:57.852237 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:57.852271 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:57.852277 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:37:57.853793 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:57.853759 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused" May 26 01:37:57.853931 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:37:57.853791 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused" May 26 01:38:00.852541 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:00.852479 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused" May 26 01:38:00.853024 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:00.852502 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused" May 26 01:38:03.852949 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:03.852898 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused" May 26 01:38:03.860326 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:03.860295 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:03.860820 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:03.860787 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:03.864420 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:03.864399 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:05.852795 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:05.852755 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:06.853264 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:06.853232 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:07.451116 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:07.451074 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:38:11.344138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.344078 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:38:11.347603 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.347580 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.350122 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.350074 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" May 26 01:38:11.350282 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.350058 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" May 26 01:38:11.350282 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.350212 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-czrpt\"" May 26 01:38:11.350412 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.350386 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" May 26 01:38:11.355609 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.355585 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:38:11.397645 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.397609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.397813 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.397671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.397813 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.397722 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.397813 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.397799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj454\" (UniqueName: \"kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.498306 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.498254 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj454\" (UniqueName: \"kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.498515 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.498319 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.498515 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.498355 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.498515 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.498399 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.498695 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:38:11.498537 2568 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found May 26 01:38:11.498695 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:38:11.498633 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls podName:9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db nodeName:}" failed. No retries permitted until 2026-05-26 01:38:11.998609648 +0000 UTC m=+1648.344441111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls") pod "feast-driver-ranking-6489cbbb4-j69zq" (UID: "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db") : secret "feast-driver-ranking-registry-tls" not found May 26 01:38:11.498797 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.498769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.501002 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.500976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:11.506603 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:11.506575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj454\" (UniqueName: \"kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:12.001368 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.001322 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:12.003887 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.003866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") pod \"feast-driver-ranking-6489cbbb4-j69zq\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:12.259657 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.259559 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:12.393600 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.393560 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:38:12.395633 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:38:12.395603 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad6b54f_0ab5_4afb_a347_f0b5c78cc4db.slice/crio-6219704bfa79e4f3e6c2678428df44dbd382ac18dea319d14a1fa106a10150e4 WatchSource:0}: Error finding container 6219704bfa79e4f3e6c2678428df44dbd382ac18dea319d14a1fa106a10150e4: Status 404 returned error can't find the container with id 6219704bfa79e4f3e6c2678428df44dbd382ac18dea319d14a1fa106a10150e4 May 26 01:38:12.468703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.468660 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerStarted","Data":"1dfff71fc264722ccd4ed150603eb974b46032c4f601622bdc9069b7c51bb293"} May 26 01:38:12.468703 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:12.468701 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerStarted","Data":"6219704bfa79e4f3e6c2678428df44dbd382ac18dea319d14a1fa106a10150e4"} May 26 01:38:17.486414 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:17.486378 2568 generic.go:358] "Generic (PLEG): container finished" podID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerID="1dfff71fc264722ccd4ed150603eb974b46032c4f601622bdc9069b7c51bb293" exitCode=0 May 26 01:38:17.486834 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:17.486451 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerDied","Data":"1dfff71fc264722ccd4ed150603eb974b46032c4f601622bdc9069b7c51bb293"} May 26 01:38:18.490881 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:18.490845 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerStarted","Data":"d447c61a6e5fc13a04f6367a770aa0e7b1835a369ef0d3e2ff582bfc025bc093"} May 26 01:38:24.513721 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:24.513684 2568 generic.go:358] "Generic (PLEG): container finished" podID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerID="d447c61a6e5fc13a04f6367a770aa0e7b1835a369ef0d3e2ff582bfc025bc093" exitCode=0 May 26 01:38:24.514190 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:24.513726 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerDied","Data":"d447c61a6e5fc13a04f6367a770aa0e7b1835a369ef0d3e2ff582bfc025bc093"} May 26 01:38:25.519794 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:25.519752 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerStarted","Data":"117c157c6005f1876b9bfafeba05c4338bbe1b5f9729e9b764da5cd7443eca57"} May 26 01:38:25.519794 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:25.519795 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerStarted","Data":"6f3c4bc6a281a82387f422e549ccabdbc77a4aada43fac537b4a9000152c8e1a"} May 26 01:38:25.541037 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:25.540986 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podStartSLOduration=14.540968412 podStartE2EDuration="14.540968412s" podCreationTimestamp="2026-05-26 01:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:38:25.538989272 +0000 UTC m=+1661.884820743" watchObservedRunningTime="2026-05-26 01:38:25.540968412 +0000 UTC m=+1661.886799886" May 26 01:38:27.260117 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:27.260053 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:27.260517 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:27.260130 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:27.261672 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:27.261641 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused" May 26 01:38:27.261792 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:27.261689 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused" May 26 01:38:30.260193 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:30.260137 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused" May 26 01:38:30.703269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:30.703233 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:30.703781 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:30.703757 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:30.706726 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:30.706704 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:32.259905 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:32.259861 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:33.260714 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:33.260670 2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused" May 26 01:38:36.260677 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:36.260639 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:38:36.261354 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:38:36.261332 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:39:51.218084 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.218050 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:39:51.218562 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.218279 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" podUID="6d14005a-681f-4130-bd65-d228eb669cb1" containerName="manager" containerID="cri-o://38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3" gracePeriod=10 May 26 01:39:51.452883 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.452841 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:39:51.453308 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.453276 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" containerID="cri-o://524c5fd2f2833f36cd4825d295f141c1d0a4fa0bd751182edab26da85bcd24c1" gracePeriod=30 May 26 01:39:51.453527 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.453345 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" containerID="cri-o://863ef2c8e6ba22a87747f50734cebe956e6ee9ce1d8bd1bcf67d31d8e204c1be" gracePeriod=30 May 26 01:39:51.469178 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.469087 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:39:51.469441 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.469416 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" containerID="cri-o://6f3c4bc6a281a82387f422e549ccabdbc77a4aada43fac537b4a9000152c8e1a" gracePeriod=30 May 26 01:39:51.469521 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.469467 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" containerID="cri-o://117c157c6005f1876b9bfafeba05c4338bbe1b5f9729e9b764da5cd7443eca57" gracePeriod=30 May 26 01:39:51.511444 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.511416 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:39:51.686871 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.686835 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzbbz\" (UniqueName: \"kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz\") pod \"6d14005a-681f-4130-bd65-d228eb669cb1\" (UID: \"6d14005a-681f-4130-bd65-d228eb669cb1\") " May 26 01:39:51.689176 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.689146 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz" (OuterVolumeSpecName: "kube-api-access-tzbbz") pod "6d14005a-681f-4130-bd65-d228eb669cb1" (UID: "6d14005a-681f-4130-bd65-d228eb669cb1"). InnerVolumeSpecName "kube-api-access-tzbbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:39:51.787723 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.787643 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzbbz\" (UniqueName: \"kubernetes.io/projected/6d14005a-681f-4130-bd65-d228eb669cb1-kube-api-access-tzbbz\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:39:51.801230 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.801198 2568 generic.go:358] "Generic (PLEG): container finished" podID="6d14005a-681f-4130-bd65-d228eb669cb1" containerID="38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3" exitCode=0 May 26 01:39:51.801393 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.801259 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" event={"ID":"6d14005a-681f-4130-bd65-d228eb669cb1","Type":"ContainerDied","Data":"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3"} May 26 01:39:51.801393 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.801272 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" May 26 01:39:51.801393 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.801286 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q" event={"ID":"6d14005a-681f-4130-bd65-d228eb669cb1","Type":"ContainerDied","Data":"cda2a79d240b7c8d2a808d762d51313424ef35b8c7eb32960817f45bd678a914"} May 26 01:39:51.801393 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.801302 2568 scope.go:117] "RemoveContainer" containerID="38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3" May 26 01:39:51.813870 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.813840 2568 scope.go:117] "RemoveContainer" containerID="38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3" May 26 01:39:51.814189 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:39:51.814163 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3\": container with ID starting with 38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3 not found: ID does not exist" containerID="38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3" May 26 01:39:51.814272 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.814199 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3"} err="failed to get container status \"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3\": rpc error: code = NotFound desc = could not find container \"38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3\": container with ID starting with 38a51ce6a5b02e56f18492502cda1610912aa1a1fec11d712609e44e4c17cad3 not found: ID does not exist" May 26 01:39:51.824313 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.824286 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:39:51.829539 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:51.829514 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7dd4845fb-dzw6q"] May 26 01:39:52.272495 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:52.272468 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d14005a-681f-4130-bd65-d228eb669cb1" path="/var/lib/kubelet/pods/6d14005a-681f-4130-bd65-d228eb669cb1/volumes" May 26 01:39:52.805937 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:52.805897 2568 generic.go:358] "Generic (PLEG): container finished" podID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerID="863ef2c8e6ba22a87747f50734cebe956e6ee9ce1d8bd1bcf67d31d8e204c1be" exitCode=0 May 26 01:39:52.806138 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:52.805967 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerDied","Data":"863ef2c8e6ba22a87747f50734cebe956e6ee9ce1d8bd1bcf67d31d8e204c1be"} May 26 01:39:52.808606 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:52.808584 2568 generic.go:358] "Generic (PLEG): container finished" podID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerID="117c157c6005f1876b9bfafeba05c4338bbe1b5f9729e9b764da5cd7443eca57" exitCode=0 May 26 01:39:52.808718 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:52.808650 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerDied","Data":"117c157c6005f1876b9bfafeba05c4338bbe1b5f9729e9b764da5cd7443eca57"} May 26 01:39:53.385455 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.385415 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:39:53.385854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.385614 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" podUID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" containerName="postgres" containerID="cri-o://e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391" gracePeriod=30 May 26 01:39:53.390484 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.390461 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:39:53.390729 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.390704 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-h4bgj" podUID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" containerName="redis" containerID="cri-o://1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76" gracePeriod=30 May 26 01:39:53.658531 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.658510 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:39:53.661908 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.661891 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:39:53.702130 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.702086 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmkgm\" (UniqueName: \"kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm\") pod \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " May 26 01:39:53.702302 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.702147 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata\") pod \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\" (UID: \"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b\") " May 26 01:39:53.702302 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.702244 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbxt2\" (UniqueName: \"kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2\") pod \"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e\" (UID: \"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e\") " May 26 01:39:53.704541 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.704509 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm" (OuterVolumeSpecName: "kube-api-access-qmkgm") pod "fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" (UID: "fa30c2a2-cf9f-4e84-9139-a8433ea29e2b"). InnerVolumeSpecName "kube-api-access-qmkgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:39:53.704541 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.704532 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2" (OuterVolumeSpecName: "kube-api-access-mbxt2") pod "96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" (UID: "96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e"). InnerVolumeSpecName "kube-api-access-mbxt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:39:53.735921 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.735888 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" (UID: "fa30c2a2-cf9f-4e84-9139-a8433ea29e2b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:39:53.803697 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.803668 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbxt2\" (UniqueName: \"kubernetes.io/projected/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e-kube-api-access-mbxt2\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:39:53.803697 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.803694 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmkgm\" (UniqueName: \"kubernetes.io/projected/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-kube-api-access-qmkgm\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:39:53.803697 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.803704 2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b-postgresdata\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:39:53.813149 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.813083 2568 generic.go:358] "Generic (PLEG): container finished" podID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" containerID="e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391" exitCode=0 May 26 01:39:53.813285 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.813147 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" event={"ID":"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b","Type":"ContainerDied","Data":"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391"} May 26 01:39:53.813285 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.813186 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" event={"ID":"fa30c2a2-cf9f-4e84-9139-a8433ea29e2b","Type":"ContainerDied","Data":"b8cad7d2ec7021aaa99fbf4895ea1907f4dfcec34da227f381771fff5da8dd6c"} May 26 01:39:53.813285 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.813189 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-vf49b" May 26 01:39:53.813285 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.813202 2568 scope.go:117] "RemoveContainer" containerID="e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391" May 26 01:39:53.814464 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.814441 2568 generic.go:358] "Generic (PLEG): container finished" podID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" containerID="1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76" exitCode=0 May 26 01:39:53.814584 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.814494 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-h4bgj" May 26 01:39:53.814584 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.814515 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-h4bgj" event={"ID":"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e","Type":"ContainerDied","Data":"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76"} May 26 01:39:53.814584 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.814542 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-h4bgj" event={"ID":"96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e","Type":"ContainerDied","Data":"3f3086af4f3c640268c109091fc37cc5930b863be3090a048a78339f11f7631c"} May 26 01:39:53.821568 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.821549 2568 scope.go:117] "RemoveContainer" containerID="e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391" May 26 01:39:53.821889 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:39:53.821870 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391\": container with ID starting with e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391 not found: ID does not exist" containerID="e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391" May 26 01:39:53.821986 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.821896 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391"} err="failed to get container status \"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391\": rpc error: code = NotFound desc = could not find container \"e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391\": container with ID starting with e817283f14a69d72500d06eab0cfe0fa279f2af6cf1e5c82f4d355d7ff55e391 not found: ID does not exist" May 26 01:39:53.821986 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.821911 2568 scope.go:117] "RemoveContainer" containerID="1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76" May 26 01:39:53.829526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.829510 2568 scope.go:117] "RemoveContainer" containerID="1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76" May 26 01:39:53.829752 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:39:53.829734 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76\": container with ID starting with 1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76 not found: ID does not exist" containerID="1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76" May 26 01:39:53.829806 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.829760 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76"} err="failed to get container status \"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76\": rpc error: code = NotFound desc = could not find container \"1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76\": container with ID starting with 1f0df114c48e8538c14847422fd2a5668d54a7b087daea89b1fecaa5669bbf76 not found: ID does not exist" May 26 01:39:53.836087 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.836065 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:39:53.839007 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.838989 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-vf49b"] May 26 01:39:53.850239 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.850219 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:39:53.852874 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.852855 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-h4bgj"] May 26 01:39:53.860821 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:53.860799 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused" May 26 01:39:54.271963 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:54.271933 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" path="/var/lib/kubelet/pods/96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e/volumes" May 26 01:39:54.272343 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:39:54.272328 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" path="/var/lib/kubelet/pods/fa30c2a2-cf9f-4e84-9139-a8433ea29e2b/volumes" May 26 01:40:00.704580 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:00.704534 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused" May 26 01:40:03.861047 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:03.860999 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused" May 26 01:40:10.704591 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:10.704539 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused" May 26 01:40:13.861897 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:13.861843 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused" May 26 01:40:13.862334 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:13.861986 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:40:20.704392 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:20.704345 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused" May 26 01:40:20.704778 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:20.704483 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:40:21.905343 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:21.905309 2568 generic.go:358] "Generic (PLEG): container finished" podID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerID="6f3c4bc6a281a82387f422e549ccabdbc77a4aada43fac537b4a9000152c8e1a" exitCode=137 May 26 01:40:21.905769 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:21.905383 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerDied","Data":"6f3c4bc6a281a82387f422e549ccabdbc77a4aada43fac537b4a9000152c8e1a"} May 26 01:40:21.907581 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:21.907556 2568 generic.go:358] "Generic (PLEG): container finished" podID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerID="524c5fd2f2833f36cd4825d295f141c1d0a4fa0bd751182edab26da85bcd24c1" exitCode=137 May 26 01:40:21.907712 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:21.907628 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerDied","Data":"524c5fd2f2833f36cd4825d295f141c1d0a4fa0bd751182edab26da85bcd24c1"} May 26 01:40:22.107182 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.107157 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:40:22.133376 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.133352 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:40:22.249050 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.248959 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls\") pod \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " May 26 01:40:22.249050 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249000 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data\") pod \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " May 26 01:40:22.249050 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249041 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22j4c\" (UniqueName: \"kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c\") pod \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " May 26 01:40:22.249371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249073 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") pod \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " May 26 01:40:22.249371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249143 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls\") pod \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\" (UID: \"8f9f0120-1707-4b01-a6d3-e244bb80e0a8\") " May 26 01:40:22.249371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249245 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data\") pod \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " May 26 01:40:22.249371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249294 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj454\" (UniqueName: \"kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454\") pod \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " May 26 01:40:22.249371 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249335 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls\") pod \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\" (UID: \"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db\") " May 26 01:40:22.250044 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.249976 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data" (OuterVolumeSpecName: "feast-data") pod "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" (UID: "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:40:22.252053 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252024 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls" (OuterVolumeSpecName: "online-tls") pod "8f9f0120-1707-4b01-a6d3-e244bb80e0a8" (UID: "8f9f0120-1707-4b01-a6d3-e244bb80e0a8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:40:22.252053 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252042 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" (UID: "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:40:22.252222 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252064 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f9f0120-1707-4b01-a6d3-e244bb80e0a8" (UID: "8f9f0120-1707-4b01-a6d3-e244bb80e0a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:40:22.252222 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252081 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c" (OuterVolumeSpecName: "kube-api-access-22j4c") pod "8f9f0120-1707-4b01-a6d3-e244bb80e0a8" (UID: "8f9f0120-1707-4b01-a6d3-e244bb80e0a8"). InnerVolumeSpecName "kube-api-access-22j4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:40:22.252222 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252178 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls" (OuterVolumeSpecName: "online-tls") pod "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" (UID: "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 01:40:22.252339 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.252322 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454" (OuterVolumeSpecName: "kube-api-access-zj454") pod "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" (UID: "9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db"). InnerVolumeSpecName "kube-api-access-zj454". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:40:22.258715 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.258693 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data" (OuterVolumeSpecName: "feast-data") pod "8f9f0120-1707-4b01-a6d3-e244bb80e0a8" (UID: "8f9f0120-1707-4b01-a6d3-e244bb80e0a8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:40:22.350374 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350342 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22j4c\" (UniqueName: \"kubernetes.io/projected/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-kube-api-access-22j4c\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350374 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350374 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350394 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350403 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350411 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj454\" (UniqueName: \"kubernetes.io/projected/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-kube-api-access-zj454\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350424 2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db-online-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350435 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-registry-tls\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.350612 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.350444 2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f9f0120-1707-4b01-a6d3-e244bb80e0a8-feast-data\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:40:22.912526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.912491 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" event={"ID":"9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db","Type":"ContainerDied","Data":"6219704bfa79e4f3e6c2678428df44dbd382ac18dea319d14a1fa106a10150e4"} May 26 01:40:22.912526 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.912511 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq" May 26 01:40:22.913022 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.912541 2568 scope.go:117] "RemoveContainer" containerID="117c157c6005f1876b9bfafeba05c4338bbe1b5f9729e9b764da5cd7443eca57" May 26 01:40:22.914827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.914797 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" event={"ID":"8f9f0120-1707-4b01-a6d3-e244bb80e0a8","Type":"ContainerDied","Data":"542d979f5d6245fc22847dd48cdabeeb7849de9f7ae9f6d27c899f85d6d07676"} May 26 01:40:22.914942 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.914917 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq" May 26 01:40:22.921332 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.921318 2568 scope.go:117] "RemoveContainer" containerID="6f3c4bc6a281a82387f422e549ccabdbc77a4aada43fac537b4a9000152c8e1a" May 26 01:40:22.929827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.929795 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:40:22.930001 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.929972 2568 scope.go:117] "RemoveContainer" containerID="d447c61a6e5fc13a04f6367a770aa0e7b1835a369ef0d3e2ff582bfc025bc093" May 26 01:40:22.932711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.932686 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-777997c5c9-q5dzq"] May 26 01:40:22.937322 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.937295 2568 scope.go:117] "RemoveContainer" containerID="1dfff71fc264722ccd4ed150603eb974b46032c4f601622bdc9069b7c51bb293" May 26 01:40:22.942769 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.942748 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:40:22.944038 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.944019 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6489cbbb4-j69zq"] May 26 01:40:22.948218 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.948187 2568 scope.go:117] "RemoveContainer" containerID="863ef2c8e6ba22a87747f50734cebe956e6ee9ce1d8bd1bcf67d31d8e204c1be" May 26 01:40:22.955891 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.955869 2568 scope.go:117] "RemoveContainer" containerID="524c5fd2f2833f36cd4825d295f141c1d0a4fa0bd751182edab26da85bcd24c1" May 26 01:40:22.963805 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.963788 2568 scope.go:117] "RemoveContainer" containerID="661d6d9233371bba932d59615d76a89f29e9bfb1efec3cbe01c763fbe17785ea" May 26 01:40:22.971126 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:22.971085 2568 scope.go:117] "RemoveContainer" containerID="dfa1d0b32439d046d8642bbac17e8a1d307a2b3f5230eb3086668a63012cdf19" May 26 01:40:24.271803 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:24.271770 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" path="/var/lib/kubelet/pods/8f9f0120-1707-4b01-a6d3-e244bb80e0a8/volumes" May 26 01:40:24.272287 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:24.272273 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" path="/var/lib/kubelet/pods/9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db/volumes" May 26 01:40:44.404418 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:44.404391 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:40:44.406871 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:44.406840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:40:44.410314 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:44.410293 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:40:44.412397 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:40:44.412380 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:45:44.431176 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:45:44.431141 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:45:44.433625 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:45:44.433605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:45:44.436704 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:45:44.436687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:45:44.439022 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:45:44.439005 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:50:40.478325 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478289 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-htfvm/must-gather-6w2gz"] May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478602 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478614 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478623 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="feast-apply" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478630 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="feast-apply" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478638 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" containerName="postgres" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478644 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" containerName="postgres" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478650 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478655 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478666 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="feast-apply" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478671 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="feast-apply" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478680 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="feast-init" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478685 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="feast-init" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478691 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="feast-init" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478696 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="feast-init" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478702 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d14005a-681f-4130-bd65-d228eb669cb1" containerName="manager" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478709 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d14005a-681f-4130-bd65-d228eb669cb1" containerName="manager" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478723 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478730 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478738 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" containerName="redis" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478743 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" containerName="redis" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478748 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478753 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478800 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d14005a-681f-4130-bd65-d228eb669cb1" containerName="manager" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478808 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="online" May 26 01:50:40.478804 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478817 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="online" May 26 01:50:40.479916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478823 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="96bbf3bd-e678-4bd1-84e8-ddd93ed4ba0e" containerName="redis" May 26 01:50:40.479916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478829 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f9f0120-1707-4b01-a6d3-e244bb80e0a8" containerName="registry" May 26 01:50:40.479916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478836 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa30c2a2-cf9f-4e84-9139-a8433ea29e2b" containerName="postgres" May 26 01:50:40.479916 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.478842 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ad6b54f-0ab5-4afb-a347-f0b5c78cc4db" containerName="registry" May 26 01:50:40.481971 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.481954 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.484389 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.484362 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htfvm\"/\"kube-root-ca.crt\"" May 26 01:50:40.484524 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.484403 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htfvm\"/\"openshift-service-ca.crt\"" May 26 01:50:40.485244 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.485228 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-htfvm\"/\"default-dockercfg-bs576\"" May 26 01:50:40.489847 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.489826 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htfvm/must-gather-6w2gz"] May 26 01:50:40.611487 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.611419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k86x\" (UniqueName: \"kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.611688 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.611584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.712435 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.712401 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.712617 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.712450 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2k86x\" (UniqueName: \"kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.712754 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.712733 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.721911 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.721882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k86x\" (UniqueName: \"kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x\") pod \"must-gather-6w2gz\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.801210 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.801175 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:50:40.926449 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.926421 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htfvm/must-gather-6w2gz"] May 26 01:50:40.929088 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:50:40.929054 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod384bbca7_4941_492b_b4ae_1a9a734c04a9.slice/crio-f3459da2fe0a4d4a17c953c1844a4472774533998534607a22f261b6ca307f1d WatchSource:0}: Error finding container f3459da2fe0a4d4a17c953c1844a4472774533998534607a22f261b6ca307f1d: Status 404 returned error can't find the container with id f3459da2fe0a4d4a17c953c1844a4472774533998534607a22f261b6ca307f1d May 26 01:50:40.930856 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:40.930833 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 01:50:41.742787 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:41.742735 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htfvm/must-gather-6w2gz" event={"ID":"384bbca7-4941-492b-b4ae-1a9a734c04a9","Type":"ContainerStarted","Data":"f3459da2fe0a4d4a17c953c1844a4472774533998534607a22f261b6ca307f1d"} May 26 01:50:46.932416 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:46.932381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:50:46.932827 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:46.932607 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:50:46.934854 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:46.934832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:50:46.935135 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:46.935120 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:50:47.765126 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:47.765062 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htfvm/must-gather-6w2gz" event={"ID":"384bbca7-4941-492b-b4ae-1a9a734c04a9","Type":"ContainerStarted","Data":"c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d"} May 26 01:50:47.765323 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:47.765133 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htfvm/must-gather-6w2gz" event={"ID":"384bbca7-4941-492b-b4ae-1a9a734c04a9","Type":"ContainerStarted","Data":"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968"} May 26 01:50:47.782066 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:47.782016 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-htfvm/must-gather-6w2gz" podStartSLOduration=1.724372458 podStartE2EDuration="7.78200087s" podCreationTimestamp="2026-05-26 01:50:40 +0000 UTC" firstStartedPulling="2026-05-26 01:50:40.930950798 +0000 UTC m=+2397.276782241" lastFinishedPulling="2026-05-26 01:50:46.988579194 +0000 UTC m=+2403.334410653" observedRunningTime="2026-05-26 01:50:47.779326715 +0000 UTC m=+2404.125158181" watchObservedRunningTime="2026-05-26 01:50:47.78200087 +0000 UTC m=+2404.127832336" May 26 01:50:56.799301 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:56.799264 2568 generic.go:358] "Generic (PLEG): container finished" podID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerID="52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968" exitCode=0 May 26 01:50:56.799698 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:56.799311 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htfvm/must-gather-6w2gz" event={"ID":"384bbca7-4941-492b-b4ae-1a9a734c04a9","Type":"ContainerDied","Data":"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968"} May 26 01:50:56.799698 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:56.799624 2568 scope.go:117] "RemoveContainer" containerID="52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968" May 26 01:50:57.607182 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:50:57.607151 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-htfvm_must-gather-6w2gz_384bbca7-4941-492b-b4ae-1a9a734c04a9/gather/0.log" May 26 01:51:00.935370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:00.935342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvxhq_899b198e-4b22-4515-a64b-806f74124a0b/global-pull-secret-syncer/0.log" May 26 01:51:01.017873 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:01.017839 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8gvfj_798d89c8-5ba9-42eb-87ef-bb26636057ff/konnectivity-agent/0.log" May 26 01:51:01.069398 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:01.069364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-202.ec2.internal_a8e0ef6285d9b60c9a32d7ffb890bdc9/haproxy/0.log" May 26 01:51:02.915060 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:02.914972 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-htfvm/must-gather-6w2gz"] May 26 01:51:02.915519 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:02.915286 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-htfvm/must-gather-6w2gz" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="copy" containerID="cri-o://c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d" gracePeriod=2 May 26 01:51:02.921438 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:02.921410 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-htfvm/must-gather-6w2gz"] May 26 01:51:03.135655 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.135634 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-htfvm_must-gather-6w2gz_384bbca7-4941-492b-b4ae-1a9a734c04a9/copy/0.log" May 26 01:51:03.135976 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.135961 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:51:03.137785 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.137761 2568 status_manager.go:895] "Failed to get status for pod" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" pod="openshift-must-gather-htfvm/must-gather-6w2gz" err="pods \"must-gather-6w2gz\" is forbidden: User \"system:node:ip-10-0-137-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-htfvm\": no relationship found between node 'ip-10-0-137-202.ec2.internal' and this object" May 26 01:51:03.207554 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.207476 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output\") pod \"384bbca7-4941-492b-b4ae-1a9a734c04a9\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " May 26 01:51:03.207554 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.207535 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k86x\" (UniqueName: \"kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x\") pod \"384bbca7-4941-492b-b4ae-1a9a734c04a9\" (UID: \"384bbca7-4941-492b-b4ae-1a9a734c04a9\") " May 26 01:51:03.207819 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.207794 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "384bbca7-4941-492b-b4ae-1a9a734c04a9" (UID: "384bbca7-4941-492b-b4ae-1a9a734c04a9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 01:51:03.209629 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.209610 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x" (OuterVolumeSpecName: "kube-api-access-2k86x") pod "384bbca7-4941-492b-b4ae-1a9a734c04a9" (UID: "384bbca7-4941-492b-b4ae-1a9a734c04a9"). InnerVolumeSpecName "kube-api-access-2k86x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 01:51:03.308512 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.308477 2568 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/384bbca7-4941-492b-b4ae-1a9a734c04a9-must-gather-output\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:51:03.308663 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.308519 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k86x\" (UniqueName: \"kubernetes.io/projected/384bbca7-4941-492b-b4ae-1a9a734c04a9-kube-api-access-2k86x\") on node \"ip-10-0-137-202.ec2.internal\" DevicePath \"\"" May 26 01:51:03.626996 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.626954 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/alertmanager/0.log" May 26 01:51:03.657570 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.657542 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/config-reloader/0.log" May 26 01:51:03.686821 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.686794 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/kube-rbac-proxy-web/0.log" May 26 01:51:03.714910 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.714884 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/kube-rbac-proxy/0.log" May 26 01:51:03.746409 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.746381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/kube-rbac-proxy-metric/0.log" May 26 01:51:03.775618 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.775587 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/prom-label-proxy/0.log" May 26 01:51:03.800641 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.800618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a8d6077-6dcd-450c-8dc0-b9ad23c24b88/init-config-reloader/0.log" May 26 01:51:03.820057 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.820040 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-htfvm_must-gather-6w2gz_384bbca7-4941-492b-b4ae-1a9a734c04a9/copy/0.log" May 26 01:51:03.820377 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.820354 2568 generic.go:358] "Generic (PLEG): container finished" podID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerID="c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d" exitCode=143 May 26 01:51:03.820428 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.820409 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htfvm/must-gather-6w2gz" May 26 01:51:03.820469 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.820449 2568 scope.go:117] "RemoveContainer" containerID="c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d" May 26 01:51:03.822392 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.822358 2568 status_manager.go:895] "Failed to get status for pod" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" pod="openshift-must-gather-htfvm/must-gather-6w2gz" err="pods \"must-gather-6w2gz\" is forbidden: User \"system:node:ip-10-0-137-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-htfvm\": no relationship found between node 'ip-10-0-137-202.ec2.internal' and this object" May 26 01:51:03.829132 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.829110 2568 scope.go:117] "RemoveContainer" containerID="52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968" May 26 01:51:03.831350 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.831327 2568 status_manager.go:895] "Failed to get status for pod" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" pod="openshift-must-gather-htfvm/must-gather-6w2gz" err="pods \"must-gather-6w2gz\" is forbidden: User \"system:node:ip-10-0-137-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-htfvm\": no relationship found between node 'ip-10-0-137-202.ec2.internal' and this object" May 26 01:51:03.840019 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.840001 2568 scope.go:117] "RemoveContainer" containerID="c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d" May 26 01:51:03.840329 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:51:03.840312 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d\": container with ID starting with c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d not found: ID does not exist" containerID="c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d" May 26 01:51:03.840394 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.840336 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d"} err="failed to get container status \"c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d\": rpc error: code = NotFound desc = could not find container \"c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d\": container with ID starting with c7c77515269ca819010a7f5e89b0e3c0aca2449e19e5f06f9b67cf084153704d not found: ID does not exist" May 26 01:51:03.840394 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.840354 2568 scope.go:117] "RemoveContainer" containerID="52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968" May 26 01:51:03.840560 ip-10-0-137-202 kubenswrapper[2568]: E0526 01:51:03.840546 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968\": container with ID starting with 52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968 not found: ID does not exist" containerID="52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968" May 26 01:51:03.840603 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:03.840563 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968"} err="failed to get container status \"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968\": rpc error: code = NotFound desc = could not find container \"52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968\": container with ID starting with 52e955fa9b2ba5446eb0c60f0c70f899a02c737f307457e6d17c1ab1e3b63968 not found: ID does not exist" May 26 01:51:04.057005 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.056974 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cjnf_036a1e3b-38d1-459d-b561-9d6589a18d21/node-exporter/0.log" May 26 01:51:04.076820 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.076794 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cjnf_036a1e3b-38d1-459d-b561-9d6589a18d21/kube-rbac-proxy/0.log" May 26 01:51:04.110442 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.110420 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9cjnf_036a1e3b-38d1-459d-b561-9d6589a18d21/init-textfile/0.log" May 26 01:51:04.271881 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.271850 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" path="/var/lib/kubelet/pods/384bbca7-4941-492b-b4ae-1a9a734c04a9/volumes" May 26 01:51:04.275190 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.275166 2568 status_manager.go:895] "Failed to get status for pod" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" pod="openshift-must-gather-htfvm/must-gather-6w2gz" err="pods \"must-gather-6w2gz\" is forbidden: User \"system:node:ip-10-0-137-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-htfvm\": no relationship found between node 'ip-10-0-137-202.ec2.internal' and this object" May 26 01:51:04.601645 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.601615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-r2wsb_8f57a7d7-bd80-4d98-b75f-7118a4154a25/prometheus-operator/0.log" May 26 01:51:04.618015 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.617984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-r2wsb_8f57a7d7-bd80-4d98-b75f-7118a4154a25/kube-rbac-proxy/0.log" May 26 01:51:04.678056 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.678022 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78886dcfbf-wmrkg_aba5a029-034c-4edb-bd35-5bb9fd8d3829/telemeter-client/0.log" May 26 01:51:04.694932 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.694910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78886dcfbf-wmrkg_aba5a029-034c-4edb-bd35-5bb9fd8d3829/reload/0.log" May 26 01:51:04.713510 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.713457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78886dcfbf-wmrkg_aba5a029-034c-4edb-bd35-5bb9fd8d3829/kube-rbac-proxy/0.log" May 26 01:51:04.746133 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.746084 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/thanos-query/0.log" May 26 01:51:04.765053 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.765025 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/kube-rbac-proxy-web/0.log" May 26 01:51:04.786074 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.786048 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/kube-rbac-proxy/0.log" May 26 01:51:04.804979 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.804951 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/prom-label-proxy/0.log" May 26 01:51:04.824081 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.824047 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/kube-rbac-proxy-rules/0.log" May 26 01:51:04.842328 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:04.842304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54c5f66c79-bs9mt_58884f46-540c-4cfc-93eb-daa984272ed0/kube-rbac-proxy-metrics/0.log" May 26 01:51:06.365191 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:06.365162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/2.log" May 26 01:51:06.373395 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:06.373372 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-n96tq_642df71f-8dd8-4419-b91b-df530f7394b5/console-operator/3.log" May 26 01:51:06.731208 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:06.731124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97b699ff4-h8t26_c58b50da-b5ba-4c5f-854a-3484c0395a09/console/0.log" May 26 01:51:06.764549 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:06.764520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-vrppp_f13d6f09-1edc-40fc-ab77-51e1b2982a2a/download-server/0.log" May 26 01:51:07.435143 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435089 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh"] May 26 01:51:07.435480 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435419 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="gather" May 26 01:51:07.435480 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435429 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="gather" May 26 01:51:07.435480 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435442 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="copy" May 26 01:51:07.435480 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435447 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="copy" May 26 01:51:07.435761 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435507 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="gather" May 26 01:51:07.435761 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.435516 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="384bbca7-4941-492b-b4ae-1a9a734c04a9" containerName="copy" May 26 01:51:07.440266 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.440247 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.442660 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.442643 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg56t\"/\"kube-root-ca.crt\"" May 26 01:51:07.442733 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.442664 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rg56t\"/\"default-dockercfg-4xshw\"" May 26 01:51:07.443414 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.443397 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg56t\"/\"openshift-service-ca.crt\"" May 26 01:51:07.446888 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.446867 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh"] May 26 01:51:07.545473 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.545438 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-lib-modules\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.545648 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.545517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-podres\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.545648 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.545543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dxs5\" (UniqueName: \"kubernetes.io/projected/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-kube-api-access-6dxs5\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.545648 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.545560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-sys\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.545648 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.545582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-proc\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646520 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646478 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-podres\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646534 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dxs5\" (UniqueName: \"kubernetes.io/projected/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-kube-api-access-6dxs5\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646562 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-sys\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646582 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-proc\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646624 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-lib-modules\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-podres\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646659 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-sys\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646711 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646686 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-proc\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.646999 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.646778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-lib-modules\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.653670 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.653644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dxs5\" (UniqueName: \"kubernetes.io/projected/f6ac0997-4abb-4b0e-b1f0-441660d3a5a5-kube-api-access-6dxs5\") pod \"perf-node-gather-daemonset-smxhh\" (UID: \"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5\") " pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.750325 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.750228 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:07.750513 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.750491 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xf6kz_90253730-09e3-4f2e-8c5a-294a34a85a4f/dns/0.log" May 26 01:51:07.768680 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.768643 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xf6kz_90253730-09e3-4f2e-8c5a-294a34a85a4f/kube-rbac-proxy/0.log" May 26 01:51:07.829567 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.829539 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k7k8b_59afbbc1-4406-4bf3-a61e-65bdf8149809/dns-node-resolver/0.log" May 26 01:51:07.877726 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:07.877691 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh"] May 26 01:51:07.880497 ip-10-0-137-202 kubenswrapper[2568]: W0526 01:51:07.880467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6ac0997_4abb_4b0e_b1f0_441660d3a5a5.slice/crio-6344ed497f99b402ac783494f63c018227cce0c60b9606207ce4c229443e53d6 WatchSource:0}: Error finding container 6344ed497f99b402ac783494f63c018227cce0c60b9606207ce4c229443e53d6: Status 404 returned error can't find the container with id 6344ed497f99b402ac783494f63c018227cce0c60b9606207ce4c229443e53d6 May 26 01:51:08.286078 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:08.286045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7g7f_36c4134c-230f-411c-ba4f-44f5fb52c215/node-ca/0.log" May 26 01:51:08.835939 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:08.835899 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" event={"ID":"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5","Type":"ContainerStarted","Data":"88f41c99b685f8a4b8ce11e47982e426458d6569a36337b31385323f73c50a8b"} May 26 01:51:08.835939 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:08.835942 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" event={"ID":"f6ac0997-4abb-4b0e-b1f0-441660d3a5a5","Type":"ContainerStarted","Data":"6344ed497f99b402ac783494f63c018227cce0c60b9606207ce4c229443e53d6"} May 26 01:51:08.836384 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:08.836001 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:08.852736 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:08.852685 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" podStartSLOduration=1.852672139 podStartE2EDuration="1.852672139s" podCreationTimestamp="2026-05-26 01:51:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 01:51:08.851614437 +0000 UTC m=+2425.197445904" watchObservedRunningTime="2026-05-26 01:51:08.852672139 +0000 UTC m=+2425.198503604" May 26 01:51:09.290753 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:09.290706 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rzxnz_8f6a6674-5260-4618-b8bd-d6efe56141d3/serve-healthcheck-canary/0.log" May 26 01:51:09.721997 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:09.721913 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v27vq_f94fb629-5e99-4f09-b676-475cd0d10048/kube-rbac-proxy/0.log" May 26 01:51:09.739370 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:09.739344 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v27vq_f94fb629-5e99-4f09-b676-475cd0d10048/exporter/0.log" May 26 01:51:09.758662 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:09.758628 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v27vq_f94fb629-5e99-4f09-b676-475cd0d10048/extractor/0.log" May 26 01:51:13.507310 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:13.507277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-78jb7_f3d24612-c7c4-464a-8ea3-a96f4e25346c/migrator/0.log" May 26 01:51:13.523269 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:13.523233 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-78jb7_f3d24612-c7c4-464a-8ea3-a96f4e25346c/graceful-termination/0.log" May 26 01:51:13.774581 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:13.774480 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-dmss7_43c25ccd-9171-456e-b070-a165c302ca48/kube-storage-version-migrator-operator/1.log" May 26 01:51:13.776149 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:13.776078 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-dmss7_43c25ccd-9171-456e-b070-a165c302ca48/kube-storage-version-migrator-operator/0.log" May 26 01:51:14.828745 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.828718 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/kube-multus-additional-cni-plugins/0.log" May 26 01:51:14.846543 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.846513 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/egress-router-binary-copy/0.log" May 26 01:51:14.849121 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.849083 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rg56t/perf-node-gather-daemonset-smxhh" May 26 01:51:14.864632 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.864610 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/cni-plugins/0.log" May 26 01:51:14.883887 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.883857 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/bond-cni-plugin/0.log" May 26 01:51:14.900272 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.900245 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/routeoverride-cni/0.log" May 26 01:51:14.916255 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.916233 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/whereabouts-cni-bincopy/0.log" May 26 01:51:14.933474 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.933445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6h5n_6cb0e279-5346-4331-a42d-3e1e654b03f9/whereabouts-cni/0.log" May 26 01:51:14.991800 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:14.991762 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pxnnc_a8e1eeec-4a6f-4c24-8a16-e5ea1b926adb/kube-multus/0.log" May 26 01:51:15.009485 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:15.009444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8lcnj_96c69e1e-4e81-42a4-a126-18632305214b/network-metrics-daemon/0.log" May 26 01:51:15.027956 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:15.027929 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8lcnj_96c69e1e-4e81-42a4-a126-18632305214b/kube-rbac-proxy/0.log" May 26 01:51:16.315992 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.315960 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-controller/0.log" May 26 01:51:16.331378 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.331310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/0.log" May 26 01:51:16.354976 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.354948 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovn-acl-logging/1.log" May 26 01:51:16.374155 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.374128 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/kube-rbac-proxy-node/0.log" May 26 01:51:16.391853 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.391833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/kube-rbac-proxy-ovn-metrics/0.log" May 26 01:51:16.405551 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.405519 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/northd/0.log" May 26 01:51:16.422771 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.422745 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/nbdb/0.log" May 26 01:51:16.442915 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.442888 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/sbdb/0.log" May 26 01:51:16.570782 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:16.570741 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qdm2l_761e4056-776c-44ae-a96e-526896775703/ovnkube-controller/0.log" May 26 01:51:17.510336 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:17.510247 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-mfg9l_0ba18d8c-0f90-4105-b1c1-80459bf1f16a/check-endpoints/0.log" May 26 01:51:17.548541 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:17.548510 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9sllb_b5289ea7-a72e-4a58-8d63-641e8a0d5545/network-check-target-container/0.log" May 26 01:51:18.418069 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:18.418042 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vjrcp_e0146d55-9073-4601-8953-042c67ddaf53/iptables-alerter/0.log" May 26 01:51:18.997598 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:18.997514 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fbd6l_aad28b33-d40a-4258-88b0-25841cb542c1/tuned/0.log" May 26 01:51:20.440031 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:20.439998 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-rfwd2_8f31582c-b319-46d8-a5cd-a87663039eb5/cluster-samples-operator/0.log" May 26 01:51:20.453695 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:20.453670 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-rfwd2_8f31582c-b319-46d8-a5cd-a87663039eb5/cluster-samples-operator-watch/0.log" May 26 01:51:21.288929 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.288900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sw54l_5637e8ce-bd05-445f-a9f0-027037e8e611/service-ca-operator/1.log" May 26 01:51:21.290720 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.290682 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sw54l_5637e8ce-bd05-445f-a9f0-027037e8e611/service-ca-operator/0.log" May 26 01:51:21.568477 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.568392 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-rvlwr_7a5dbb3b-6e30-4cdc-9a09-88ab79429f8e/service-ca-controller/0.log" May 26 01:51:21.871291 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.871209 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8gn9z_3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7/csi-driver/0.log" May 26 01:51:21.888472 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.888437 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8gn9z_3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7/csi-node-driver-registrar/0.log" May 26 01:51:21.904595 ip-10-0-137-202 kubenswrapper[2568]: I0526 01:51:21.904570 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8gn9z_3d56d88b-38c0-4216-a3e6-e2e3d72aa8a7/csi-liveness-probe/0.log"