May 21 14:54:11.374429 ip-10-0-143-65 systemd[1]: Starting Kubernetes Kubelet... May 21 14:54:11.874602 ip-10-0-143-65 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:11.878985 ip-10-0-143-65 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:54:11.878985 ip-10-0-143-65 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:11.879107 ip-10-0-143-65 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:54:11.879107 ip-10-0-143-65 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:11.881047 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.880875 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:54:11.883745 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883730 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:11.883745 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883745 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883749 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883753 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883756 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883760 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883763 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883766 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883769 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883772 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883775 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883777 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883780 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883784 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883789 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883791 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883794 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883797 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883799 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883802 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:11.883808 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883805 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883808 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883811 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883814 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883826 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883830 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883832 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883836 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883838 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883841 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883843 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883846 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883848 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883850 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883853 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883855 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883858 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883862 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883866 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883868 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:11.884292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883871 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883874 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883877 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883880 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883883 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883886 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883889 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883891 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883894 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883897 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883899 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883902 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883904 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883907 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883910 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883913 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883916 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883919 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883921 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:11.884774 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883924 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883926 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883929 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883931 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883934 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883937 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883939 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883942 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883944 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883947 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883949 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883952 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883954 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883957 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883961 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883964 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883967 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883970 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883973 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883976 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:11.885300 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883978 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883981 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883984 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883986 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883989 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883991 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.883994 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884460 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884467 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884471 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884474 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884477 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884480 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884483 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884487 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884491 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884494 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884497 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884500 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:11.885789 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884503 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884505 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884508 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884511 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884514 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884516 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884519 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884521 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884524 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884527 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884529 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884532 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884534 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884539 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884542 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884545 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884548 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884550 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884553 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:11.886295 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884556 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884560 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884563 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884565 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884568 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884570 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884573 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884576 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884578 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884581 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884583 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884586 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884589 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884591 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884593 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884596 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884598 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884601 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884603 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884606 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:11.886786 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884608 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884610 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884613 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884616 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884619 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884621 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884623 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884626 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884628 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884631 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884633 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884636 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884638 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884641 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884643 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884646 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884648 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884651 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884653 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884656 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:11.887328 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884658 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884661 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884664 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884667 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884669 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884672 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884675 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884677 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884680 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884683 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884685 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884688 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884690 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884693 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.884695 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884765 2559 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884772 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884780 2559 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884785 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884789 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884792 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:54:11.887813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884797 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884801 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884806 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884809 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884813 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884816 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884819 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884822 2559 flags.go:64] FLAG: --cgroup-root="" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884825 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884829 2559 flags.go:64] FLAG: --client-ca-file="" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884832 2559 flags.go:64] FLAG: --cloud-config="" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884835 2559 flags.go:64] FLAG: --cloud-provider="external" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884838 2559 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884842 2559 flags.go:64] FLAG: --cluster-domain="" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884845 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884848 2559 flags.go:64] FLAG: --config-dir="" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884850 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884854 2559 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884857 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884861 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884864 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884867 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884871 2559 flags.go:64] FLAG: --contention-profiling="false" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884874 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:54:11.888342 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884877 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884880 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884883 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884887 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884891 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884894 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884897 2559 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884900 2559 flags.go:64] FLAG: --enable-server="true" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884903 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884908 2559 flags.go:64] FLAG: --event-burst="100" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884911 2559 flags.go:64] FLAG: --event-qps="50" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884914 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884917 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884920 2559 flags.go:64] FLAG: --eviction-hard="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884924 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884927 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884930 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884933 2559 flags.go:64] FLAG: --eviction-soft="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884936 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884939 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884942 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884945 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884948 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884951 2559 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884954 2559 flags.go:64] FLAG: --feature-gates="" May 21 14:54:11.888919 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884957 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884961 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884964 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884967 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884970 2559 flags.go:64] FLAG: --healthz-port="10248" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884973 2559 flags.go:64] FLAG: --help="false" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884976 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-65.ec2.internal" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884980 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884983 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884986 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884989 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884992 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884996 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.884999 2559 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885002 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885005 2559 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885020 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885024 2559 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885027 2559 flags.go:64] FLAG: --kube-reserved="" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885029 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885032 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885035 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885038 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885041 2559 flags.go:64] FLAG: --lock-file="" May 21 14:54:11.889560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885044 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885047 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885050 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885055 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885058 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885061 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885064 2559 flags.go:64] FLAG: --logging-format="text" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885067 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885070 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885073 2559 flags.go:64] FLAG: --manifest-url="" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885076 2559 flags.go:64] FLAG: --manifest-url-header="" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885081 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885084 2559 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885088 2559 flags.go:64] FLAG: --max-pods="110" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885091 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885094 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885097 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885100 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885103 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885107 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885109 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885118 2559 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885122 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885125 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:54:11.890168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885128 2559 flags.go:64] FLAG: --pod-cidr="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885131 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885137 2559 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885140 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885143 2559 flags.go:64] FLAG: --pods-per-core="0" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885146 2559 flags.go:64] FLAG: --port="10250" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885149 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885152 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d2ba810c1d571748" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885155 2559 flags.go:64] FLAG: --qos-reserved="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885158 2559 flags.go:64] FLAG: --read-only-port="10255" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885161 2559 flags.go:64] FLAG: --register-node="true" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885164 2559 flags.go:64] FLAG: --register-schedulable="true" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885167 2559 flags.go:64] FLAG: --register-with-taints="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885171 2559 flags.go:64] FLAG: --registry-burst="10" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885174 2559 flags.go:64] FLAG: --registry-qps="5" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885177 2559 flags.go:64] FLAG: --reserved-cpus="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885180 2559 flags.go:64] FLAG: --reserved-memory="" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885184 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885187 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885190 2559 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885193 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885196 2559 flags.go:64] FLAG: --runonce="false" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885199 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885202 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885205 2559 flags.go:64] FLAG: --seccomp-default="false" May 21 14:54:11.890770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885208 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885211 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885214 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885221 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885225 2559 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885228 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885231 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885234 2559 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885237 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885240 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885243 2559 flags.go:64] FLAG: --system-cgroups="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885246 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885252 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885255 2559 flags.go:64] FLAG: --tls-cert-file="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885258 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885262 2559 flags.go:64] FLAG: --tls-min-version="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885264 2559 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885267 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885270 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885273 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885277 2559 flags.go:64] FLAG: --v="2" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885281 2559 flags.go:64] FLAG: --version="false" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885285 2559 flags.go:64] FLAG: --vmodule="" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885289 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.885293 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:54:11.891379 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885401 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885405 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885409 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885412 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885415 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885418 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885421 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885424 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885426 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885429 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885433 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885436 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885439 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885442 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885445 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885448 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885451 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885453 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885456 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885459 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:11.892018 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885461 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885464 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885466 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885469 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885471 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885474 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885477 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885479 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885482 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885484 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885487 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885489 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885492 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885494 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885499 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885502 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885505 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885507 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885510 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885513 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:11.892569 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885515 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885518 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885522 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885524 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885527 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885530 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885533 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885535 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885538 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885541 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885543 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885546 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885548 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885551 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885553 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885556 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885560 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885564 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885567 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:11.893086 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885570 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885587 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885590 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885593 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885597 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885599 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885602 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885609 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885612 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885614 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885617 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885620 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885622 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885625 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885628 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885631 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885634 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885637 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885639 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:11.893590 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885642 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885651 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885655 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885658 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885661 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885664 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885666 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.885669 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.886436 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.893469 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.893485 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893537 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893543 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893546 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893550 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:11.894065 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893553 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893556 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893559 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893562 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893565 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893568 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893571 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893574 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893577 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893579 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893582 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893584 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893587 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893589 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893592 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893595 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893599 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893602 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893606 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893609 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:11.894450 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893611 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893614 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893617 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893619 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893622 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893625 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893628 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893631 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893634 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893636 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893640 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893644 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893647 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893650 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893652 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893655 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893657 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893660 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893663 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893666 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:11.894951 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893669 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893671 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893674 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893677 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893680 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893682 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893685 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893689 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893694 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893697 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893700 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893704 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893707 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893709 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893712 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893715 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893718 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893721 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893724 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893727 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:11.895512 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893730 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893733 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893736 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893739 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893742 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893745 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893747 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893750 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893753 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893755 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893758 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893761 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893764 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893767 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893769 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893771 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893774 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893777 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893779 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893782 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:11.896025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893785 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893787 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.893793 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893891 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893895 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893898 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893901 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893904 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893907 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893910 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893912 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893915 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893918 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893921 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893923 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:11.896553 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893926 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893928 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893931 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893934 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893936 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893939 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893941 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893944 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893946 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893949 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893951 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893954 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893956 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893959 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893962 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893964 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893967 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893970 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893972 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:11.896936 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893975 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893977 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893980 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893983 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893985 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893988 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893991 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893995 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.893998 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894001 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894004 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894024 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894027 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894030 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894033 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894036 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894038 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894041 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894044 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:11.897425 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894048 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894051 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894054 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894057 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894060 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894062 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894066 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894069 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894072 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894074 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894077 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894080 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894082 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894085 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894088 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894090 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894094 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894097 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894099 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894102 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:11.897927 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894104 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894107 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894110 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894113 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894115 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894118 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894120 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894123 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894126 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894128 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894131 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894133 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894135 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894139 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:11.894143 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:11.898437 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.894148 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:11.898806 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.894999 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:54:11.899854 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.899839 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:54:11.900912 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.900900 2559 server.go:1019] "Starting client certificate rotation" May 21 14:54:11.901042 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.901023 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:54:11.901113 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.901075 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:54:11.927508 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.927472 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:54:11.929324 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.929299 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:54:11.946280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.946257 2559 log.go:25] "Validated CRI v1 runtime API" May 21 14:54:11.951831 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.951814 2559 log.go:25] "Validated CRI v1 image API" May 21 14:54:11.953049 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.953020 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:54:11.956723 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.956707 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:54:11.957577 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.957558 2559 fs.go:135] Filesystem UUIDs: map[2aa85f12-98d7-46f2-8ded-7a2e61d1d9ec:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 efcce0f9-3471-403d-bd59-9e5667824ae7:/dev/nvme0n1p4] May 21 14:54:11.957628 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.957577 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:54:11.961979 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.961858 2559 manager.go:217] Machine: {Timestamp:2026-05-21 14:54:11.961348733 +0000 UTC m=+0.447245959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101102 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2606d6a6fd93ff66e7b0cefd883de6 SystemUUID:ec2606d6-a6fd-93ff-66e7-b0cefd883de6 BootID:b0d4118c-8a03-4c8f-a7d4-18f8ff279cff Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:1b:9a:9e:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:1b:9a:9e:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:a5:94:bf:ec:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:54:11.962606 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.962594 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:54:11.962705 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.962693 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:54:11.964744 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.964720 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:54:11.964927 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.964745 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:54:11.964970 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.964938 2559 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:54:11.964970 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.964947 2559 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:54:11.964970 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.964954 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:54:11.965979 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.965968 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:54:11.966928 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.966918 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 14:54:11.967053 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.967044 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:54:11.969566 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.969555 2559 kubelet.go:491] "Attempting to sync node with API server" May 21 14:54:11.969615 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.969570 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:54:11.969615 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.969583 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:54:11.969615 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.969592 2559 kubelet.go:397] "Adding apiserver pod source" May 21 14:54:11.969615 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.969603 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:54:11.970784 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.970772 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:54:11.970842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.970791 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:54:11.973866 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.973845 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:54:11.975729 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.975716 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:54:11.977190 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977177 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977199 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977209 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977216 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977225 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977231 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977237 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:54:11.977242 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977242 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:54:11.977417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977249 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:54:11.977417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977255 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:54:11.977417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977264 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:54:11.977417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.977269 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:54:11.978199 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.978188 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:54:11.978233 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.978202 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:54:11.981910 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.981896 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:54:11.981969 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.981947 2559 server.go:1295] "Started kubelet" May 21 14:54:11.982835 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.982024 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:54:11.983161 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.983140 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-65.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:54:11.983308 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:11.983283 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:54:11.983434 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:11.983416 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:54:11.983641 ip-10-0-143-65 systemd[1]: Started Kubernetes Kubelet. May 21 14:54:11.984317 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.984297 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f85jz" May 21 14:54:11.984472 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.984268 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:54:11.984660 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.984641 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:54:11.985832 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.985805 2559 server.go:317] "Adding debug handlers to kubelet server" May 21 14:54:11.986971 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.986955 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:54:11.992322 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:11.991357 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-65.ec2.internal.18b19c5d3880c071 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-65.ec2.internal,UID:ip-10-0-143-65.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-65.ec2.internal,},FirstTimestamp:2026-05-21 14:54:11.981910129 +0000 UTC m=+0.467807355,LastTimestamp:2026-05-21 14:54:11.981910129 +0000 UTC m=+0.467807355,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-65.ec2.internal,}" May 21 14:54:11.992681 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:11.992665 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:54:11.993173 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.993160 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f85jz" May 21 14:54:11.995057 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995039 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:54:11.995127 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995064 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:54:11.995177 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995126 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:54:11.995177 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995139 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:54:11.995279 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995222 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:54:11.995279 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995271 2559 reconstruct.go:97] "Volume reconstruction finished" May 21 14:54:11.995279 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.995279 2559 reconciler.go:26] "Reconciler: start to sync state" May 21 14:54:11.996093 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996072 2559 factory.go:55] Registering systemd factory May 21 14:54:11.996093 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996089 2559 factory.go:223] Registration of the systemd container factory successfully May 21 14:54:11.996253 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:11.996235 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:11.996395 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996381 2559 factory.go:153] Registering CRI-O factory May 21 14:54:11.996465 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996398 2559 factory.go:223] Registration of the crio container factory successfully May 21 14:54:11.996465 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996451 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:54:11.996552 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996472 2559 factory.go:103] Registering Raw factory May 21 14:54:11.996552 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.996492 2559 manager.go:1196] Started watching for new ooms in manager May 21 14:54:11.997704 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:11.997675 2559 manager.go:319] Starting recovery of all containers May 21 14:54:12.003032 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.002993 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:12.005676 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.005550 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" May 21 14:54:12.008264 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.008248 2559 manager.go:324] Recovery completed May 21 14:54:12.013497 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.013474 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.015432 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.015415 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.015493 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.015449 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.015493 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.015461 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.016250 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.016232 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:54:12.016250 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.016249 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:54:12.016362 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.016270 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 14:54:12.019326 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.019310 2559 policy_none.go:49] "None policy: Start" May 21 14:54:12.019326 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.019329 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:54:12.019436 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.019340 2559 state_mem.go:35] "Initializing new in-memory state store" May 21 14:54:12.060601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.060584 2559 manager.go:341] "Starting Device Plugin manager" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.060619 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.060632 2559 server.go:85] "Starting device plugin registration server" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.060908 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.060922 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.061030 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.061098 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.061106 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.061673 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:54:12.070559 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.061711 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.092845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.092761 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:54:12.094048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.094034 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:54:12.094121 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.094063 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:54:12.094121 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.094088 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:54:12.094121 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.094098 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:54:12.094256 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.094143 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:54:12.097575 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.097553 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:12.161707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.161663 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.162787 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.162771 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.162864 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.162802 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.162864 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.162816 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.162864 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.162841 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-65.ec2.internal" May 21 14:54:12.178463 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.178435 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-65.ec2.internal" May 21 14:54:12.178463 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.178465 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-65.ec2.internal\": node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.192930 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.192905 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.194978 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.194958 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal"] May 21 14:54:12.195069 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.195058 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.196417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.196400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.196491 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.196426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.197489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.197466 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.197566 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.197497 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.197566 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.197511 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.198809 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.198793 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.199031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.198988 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.199092 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199047 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.199664 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199649 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.199727 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199680 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.199727 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199694 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.199727 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199650 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.199856 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199749 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.199856 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.199761 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.201233 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.201215 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:12.201323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.201242 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:12.201960 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.201947 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:12.202069 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.201977 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:12.202069 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.201993 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:12.228719 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.228695 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" May 21 14:54:12.232950 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.232932 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-65.ec2.internal\" not found" node="ip-10-0-143-65.ec2.internal" May 21 14:54:12.293151 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.293118 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.297188 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.297168 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.297285 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.297196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.297285 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.297220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e860e65447da6b42d64abb9f280bafd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"3e860e65447da6b42d64abb9f280bafd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:12.297285 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.297279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.297379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.297298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5fd121eefd2062fa0e44c1e935a62dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal\" (UID: \"a5fd121eefd2062fa0e44c1e935a62dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.394258 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.394163 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.397466 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.397429 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e860e65447da6b42d64abb9f280bafd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"3e860e65447da6b42d64abb9f280bafd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:12.397595 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.397493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3e860e65447da6b42d64abb9f280bafd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-65.ec2.internal\" (UID: \"3e860e65447da6b42d64abb9f280bafd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:12.494853 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.494805 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.532208 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.532182 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:12.535866 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.535836 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:12.595671 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.595629 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.696061 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.695972 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.796436 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.796390 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.896947 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.896911 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:12.901149 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.901132 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:54:12.901306 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.901290 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:54:12.901344 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.901313 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:54:12.928026 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.927983 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:12.995635 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.995564 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:49:11 +0000 UTC" deadline="2027-10-30 19:51:03.667042373 +0000 UTC" May 21 14:54:12.995635 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.995599 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12652h56m50.671446374s" May 21 14:54:12.995635 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:12.995584 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:54:12.997061 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:12.997038 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:13.004601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.004579 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:54:13.029084 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.029062 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-snwmx" May 21 14:54:13.033456 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:13.033418 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e860e65447da6b42d64abb9f280bafd.slice/crio-34599beec027a03c1e83b37f072ce4e1853d62dfbdd0c78171b6f072cb892837 WatchSource:0}: Error finding container 34599beec027a03c1e83b37f072ce4e1853d62dfbdd0c78171b6f072cb892837: Status 404 returned error can't find the container with id 34599beec027a03c1e83b37f072ce4e1853d62dfbdd0c78171b6f072cb892837 May 21 14:54:13.033838 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:13.033816 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fd121eefd2062fa0e44c1e935a62dd.slice/crio-05491985a387c43b30a721805a70e9a2ec22db78d0e78eca7b1c2c6e0bc75c0c WatchSource:0}: Error finding container 05491985a387c43b30a721805a70e9a2ec22db78d0e78eca7b1c2c6e0bc75c0c: Status 404 returned error can't find the container with id 05491985a387c43b30a721805a70e9a2ec22db78d0e78eca7b1c2c6e0bc75c0c May 21 14:54:13.035659 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.035640 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-snwmx" May 21 14:54:13.037556 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.037543 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:54:13.097118 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:13.097088 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:13.097860 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.097813 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" event={"ID":"3e860e65447da6b42d64abb9f280bafd","Type":"ContainerStarted","Data":"34599beec027a03c1e83b37f072ce4e1853d62dfbdd0c78171b6f072cb892837"} May 21 14:54:13.098657 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.098629 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"a5fd121eefd2062fa0e44c1e935a62dd","Type":"ContainerStarted","Data":"05491985a387c43b30a721805a70e9a2ec22db78d0e78eca7b1c2c6e0bc75c0c"} May 21 14:54:13.198162 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:13.198128 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:13.298706 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:13.298623 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-65.ec2.internal\" not found" May 21 14:54:13.347247 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.347220 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:13.396210 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.396134 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" May 21 14:54:13.405149 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.405123 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:54:13.406191 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.406169 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" May 21 14:54:13.416203 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.416180 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:54:13.970332 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.970300 2559 apiserver.go:52] "Watching apiserver" May 21 14:54:13.977186 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.977155 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:13.979652 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.979625 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:54:13.981592 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.981566 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-5656t","openshift-network-diagnostics/network-check-target-vr27p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75","openshift-cluster-node-tuning-operator/tuned-msbbj","openshift-dns/node-resolver-4vdtv","openshift-image-registry/node-ca-m6krr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal","openshift-network-operator/iptables-alerter-6ld6c","openshift-ovn-kubernetes/ovnkube-node-mfp5m","kube-system/konnectivity-agent-pnkhs","kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal","openshift-multus/multus-additional-cni-plugins-jv5z2","openshift-multus/multus-xf65f"] May 21 14:54:13.984723 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.984686 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:13.985939 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.985917 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:13.986089 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:13.985994 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:13.986089 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.986004 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:13.987142 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.987120 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:13.987410 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.987382 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:54:13.987635 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.987614 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sbsfw\"" May 21 14:54:13.987735 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.987669 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:54:13.987831 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.987812 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:54:13.988506 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.988484 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:13.989266 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.989245 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qk7jg\"" May 21 14:54:13.989471 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.989445 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:54:13.989555 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.989495 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990501 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990573 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990581 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dffv4\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990604 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wtbtp\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990667 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:54:13.990707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990691 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:54:13.991130 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.990873 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:13.991130 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.991003 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:13.992611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.992533 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:13.992713 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.992665 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:54:13.993275 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.993040 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rgg6w\"" May 21 14:54:13.993275 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.993248 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:54:13.993387 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.993303 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:54:13.994296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.994275 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:54:13.994296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.994292 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:13.994447 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:13.994365 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:13.994447 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.994397 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:54:13.994692 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.994668 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:54:13.994890 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.994872 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:54:13.995071 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.995053 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n4xn6\"" May 21 14:54:13.995650 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.995455 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:54:13.995650 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.995635 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:54:13.996218 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.996196 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:54:13.996447 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.996431 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-57qjz\"" May 21 14:54:13.996650 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.996636 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:54:13.997351 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.997122 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:54:13.998140 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:13.998123 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.000228 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000156 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w988r\"" May 21 14:54:14.000228 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000182 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:54:14.000228 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000166 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:54:14.000426 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000384 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xf65f" May 21 14:54:14.000696 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000587 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:54:14.000696 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000598 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:54:14.000696 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.000609 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:54:14.002512 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.002492 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:54:14.002659 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.002643 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wt22x\"" May 21 14:54:14.006938 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.006912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-socket-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.007075 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.006949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.007075 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.006975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-host\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007075 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41860ef6-228f-4bb5-9126-9ac36c627a82-iptables-alerter-script\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.007234 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-host\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.007234 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hjgk\" (UniqueName: \"kubernetes.io/projected/c30cace1-723f-443a-9489-2dfe52748c0d-kube-api-access-4hjgk\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.007234 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007234 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.007429 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-conf\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007429 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-slash\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007429 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-bin\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007429 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovn-node-metrics-cert\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007429 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf5132e-4137-42aa-a050-a855d65ef1b4-tmp-dir\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-tmp\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-954rx\" (UniqueName: \"kubernetes.io/projected/41860ef6-228f-4bb5-9126-9ac36c627a82-kube-api-access-954rx\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-ovn\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-systemd\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-lib-modules\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27a4de00-323c-4547-be9a-16138406a7ef-konnectivity-ca\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58b2h\" (UniqueName: \"kubernetes.io/projected/4cf5132e-4137-42aa-a050-a855d65ef1b4-kube-api-access-58b2h\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.007643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mmtc\" (UniqueName: \"kubernetes.io/projected/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-kube-api-access-2mmtc\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-modprobe-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-kubernetes\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-device-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-tuned\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-run\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f859\" (UniqueName: \"kubernetes.io/projected/ae34b84a-0fdb-43cf-b685-83896e76ae82-kube-api-access-2f859\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-node-log\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-netd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.007996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.007979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-env-overrides\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-registration-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-netns\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-config\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmf88\" (UniqueName: \"kubernetes.io/projected/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-kube-api-access-nmf88\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-var-lib-kubelet\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4g98\" (UniqueName: \"kubernetes.io/projected/f4571ed6-8695-4611-a836-a6bbc9c83e47-kube-api-access-s4g98\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysconfig\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-sys-fs\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-systemd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cnibin\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-os-release\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41860ef6-228f-4bb5-9126-9ac36c627a82-host-slash\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.008569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-systemd-units\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-script-lib\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-log-socket\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v886z\" (UniqueName: \"kubernetes.io/projected/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-kube-api-access-v886z\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27a4de00-323c-4547-be9a-16138406a7ef-agent-certs\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4cf5132e-4137-42aa-a050-a855d65ef1b4-hosts-file\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-kubelet\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-var-lib-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-etc-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-sys\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.009407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.008981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-serviceca\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.036336 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.036297 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:49:13 +0000 UTC" deadline="2028-02-03 02:42:05.22961637 +0000 UTC" May 21 14:54:14.036336 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.036330 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14939h47m51.193290263s" May 21 14:54:14.097120 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.097054 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:54:14.109447 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-kubelet\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.109611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109463 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41860ef6-228f-4bb5-9126-9ac36c627a82-host-slash\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.109611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109504 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-systemd-units\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41860ef6-228f-4bb5-9126-9ac36c627a82-host-slash\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.109611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-script-lib\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-systemd-units\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109631 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-log-socket\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-log-socket\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109680 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v886z\" (UniqueName: \"kubernetes.io/projected/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-kube-api-access-v886z\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27a4de00-323c-4547-be9a-16138406a7ef-agent-certs\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109760 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4cf5132e-4137-42aa-a050-a855d65ef1b4-hosts-file\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.109813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mdcv\" (UniqueName: \"kubernetes.io/projected/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-kube-api-access-6mdcv\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-kubelet\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109848 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-var-lib-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109869 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-etc-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-multus\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109938 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-sys\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109970 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.109986 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-serviceca\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110002 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-socket-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110038 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-host\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110148 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-var-lib-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110195 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-host\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.110265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4cf5132e-4137-42aa-a050-a855d65ef1b4-hosts-file\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110151 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-kubelet\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-etc-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110313 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41860ef6-228f-4bb5-9126-9ac36c627a82-iptables-alerter-script\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-script-lib\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-host\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-host\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-hostroot\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-sys\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-daemon-config\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110474 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hjgk\" (UniqueName: \"kubernetes.io/projected/c30cace1-723f-443a-9489-2dfe52748c0d-kube-api-access-4hjgk\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110544 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110570 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-conf\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-slash\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110620 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-bin\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110646 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovn-node-metrics-cert\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf5132e-4137-42aa-a050-a855d65ef1b4-tmp-dir\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-tmp\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110723 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-954rx\" (UniqueName: \"kubernetes.io/projected/41860ef6-228f-4bb5-9126-9ac36c627a82-kube-api-access-954rx\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-ovn\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-k8s-cni-cncf-io\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-multus-certs\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110837 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110851 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-systemd\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41860ef6-228f-4bb5-9126-9ac36c627a82-iptables-alerter-script\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110878 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-lib-modules\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110905 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27a4de00-323c-4547-be9a-16138406a7ef-konnectivity-ca\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110931 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58b2h\" (UniqueName: \"kubernetes.io/projected/4cf5132e-4137-42aa-a050-a855d65ef1b4-kube-api-access-58b2h\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-socket-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110958 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mmtc\" (UniqueName: \"kubernetes.io/projected/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-kube-api-access-2mmtc\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.111845 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110974 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.110986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-os-release\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-serviceca\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-socket-dir-parent\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111080 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-modprobe-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-kubernetes\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111133 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111159 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111191 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-device-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf5132e-4137-42aa-a050-a855d65ef1b4-tmp-dir\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111216 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-tuned\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.111317 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-ovn\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-lib-modules\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111414 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.111421 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:14.61138039 +0000 UTC m=+3.097277643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111410 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-systemd\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.112644 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-device-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-modprobe-d\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-slash\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cnibin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysctl-conf\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111618 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-run\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111646 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f859\" (UniqueName: \"kubernetes.io/projected/ae34b84a-0fdb-43cf-b685-83896e76ae82-kube-api-access-2f859\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-kubernetes\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111704 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-node-log\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111732 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-netd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111756 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-env-overrides\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-conf-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-run\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111829 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-registration-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-netd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-node-log\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.113448 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-netns\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111890 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-config\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-registration-dir\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111918 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmf88\" (UniqueName: \"kubernetes.io/projected/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-kube-api-access-nmf88\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-cni-bin\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.111966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-host-run-netns\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27a4de00-323c-4547-be9a-16138406a7ef-konnectivity-ca\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-system-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cni-binary-copy\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-env-overrides\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112181 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-var-lib-kubelet\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g98\" (UniqueName: \"kubernetes.io/projected/f4571ed6-8695-4611-a836-a6bbc9c83e47-kube-api-access-s4g98\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-var-lib-kubelet\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112285 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-bin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovnkube-config\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112444 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysconfig\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.114300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-sysconfig\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112515 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-sys-fs\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-systemd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c30cace1-723f-443a-9489-2dfe52748c0d-sys-fs\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112606 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112611 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-systemd\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4571ed6-8695-4611-a836-a6bbc9c83e47-run-openvswitch\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-etc-kubernetes\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cnibin\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-os-release\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-netns\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-cnibin\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.112842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-os-release\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.113108 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.114768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-tmp\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.114775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4571ed6-8695-4611-a836-a6bbc9c83e47-ovn-node-metrics-cert\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.114918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.114821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27a4de00-323c-4547-be9a-16138406a7ef-agent-certs\") pod \"konnectivity-agent-pnkhs\" (UID: \"27a4de00-323c-4547-be9a-16138406a7ef\") " pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.115563 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.115267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae34b84a-0fdb-43cf-b685-83896e76ae82-etc-tuned\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.117746 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.117725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v886z\" (UniqueName: \"kubernetes.io/projected/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-kube-api-access-v886z\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.120424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.119979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-954rx\" (UniqueName: \"kubernetes.io/projected/41860ef6-228f-4bb5-9126-9ac36c627a82-kube-api-access-954rx\") pod \"iptables-alerter-6ld6c\" (UID: \"41860ef6-228f-4bb5-9126-9ac36c627a82\") " pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.120424 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.120141 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:14.120424 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.120161 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:14.120424 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.120173 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:14.120424 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.120235 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:14.620218018 +0000 UTC m=+3.106115253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:14.121613 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.121586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f859\" (UniqueName: \"kubernetes.io/projected/ae34b84a-0fdb-43cf-b685-83896e76ae82-kube-api-access-2f859\") pod \"tuned-msbbj\" (UID: \"ae34b84a-0fdb-43cf-b685-83896e76ae82\") " pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.122218 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.122196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4g98\" (UniqueName: \"kubernetes.io/projected/f4571ed6-8695-4611-a836-a6bbc9c83e47-kube-api-access-s4g98\") pod \"ovnkube-node-mfp5m\" (UID: \"f4571ed6-8695-4611-a836-a6bbc9c83e47\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.122777 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.122741 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mmtc\" (UniqueName: \"kubernetes.io/projected/b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4-kube-api-access-2mmtc\") pod \"node-ca-m6krr\" (UID: \"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4\") " pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.123086 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.122993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58b2h\" (UniqueName: \"kubernetes.io/projected/4cf5132e-4137-42aa-a050-a855d65ef1b4-kube-api-access-58b2h\") pod \"node-resolver-4vdtv\" (UID: \"4cf5132e-4137-42aa-a050-a855d65ef1b4\") " pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.123244 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.123196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hjgk\" (UniqueName: \"kubernetes.io/projected/c30cace1-723f-443a-9489-2dfe52748c0d-kube-api-access-4hjgk\") pod \"aws-ebs-csi-driver-node-5rl75\" (UID: \"c30cace1-723f-443a-9489-2dfe52748c0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.123600 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.123577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmf88\" (UniqueName: \"kubernetes.io/projected/f90aee8c-78a3-4a49-9e40-f87c42ccfbb9-kube-api-access-nmf88\") pod \"multus-additional-cni-plugins-jv5z2\" (UID: \"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9\") " pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.213262 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213219 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-multus\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213276 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-hostroot\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213307 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-daemon-config\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213341 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213352 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-hostroot\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-multus\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-k8s-cni-cncf-io\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213364 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-k8s-cni-cncf-io\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213451 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213439 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-multus-certs\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-multus-certs\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213504 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-os-release\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-socket-dir-parent\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213565 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cnibin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213593 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-conf-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-socket-dir-parent\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-os-release\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cnibin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213621 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-system-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-conf-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-system-cni-dir\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cni-binary-copy\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213687 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-bin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213706 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-etc-kubernetes\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.213733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213732 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-netns\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-cni-bin\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213757 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-kubelet\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-etc-kubernetes\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-run-netns\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-host-var-lib-kubelet\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213798 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mdcv\" (UniqueName: \"kubernetes.io/projected/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-kube-api-access-6mdcv\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.213930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-multus-daemon-config\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.214489 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.214209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-cni-binary-copy\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.223360 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.223295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mdcv\" (UniqueName: \"kubernetes.io/projected/ced8217a-b9d3-4ac7-9509-3ab5f1fe652a-kube-api-access-6mdcv\") pod \"multus-xf65f\" (UID: \"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a\") " pod="openshift-multus/multus-xf65f" May 21 14:54:14.250341 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.250312 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:14.297595 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.297559 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:14.305437 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.305398 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" May 21 14:54:14.314246 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.314221 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-msbbj" May 21 14:54:14.318693 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.318671 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4vdtv" May 21 14:54:14.325296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.325272 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6krr" May 21 14:54:14.333901 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.333877 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ld6c" May 21 14:54:14.340678 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.340649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:14.348380 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.348354 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" May 21 14:54:14.355165 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.355139 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xf65f" May 21 14:54:14.616500 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.616474 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:14.616588 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.616577 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:14.616642 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.616633 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:15.616619942 +0000 UTC m=+4.102517155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:14.623622 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.623595 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90aee8c_78a3_4a49_9e40_f87c42ccfbb9.slice/crio-04c31f7f84995f8a626e68dfdb27d0f41dff9d48626c4292118c799ee14baec4 WatchSource:0}: Error finding container 04c31f7f84995f8a626e68dfdb27d0f41dff9d48626c4292118c799ee14baec4: Status 404 returned error can't find the container with id 04c31f7f84995f8a626e68dfdb27d0f41dff9d48626c4292118c799ee14baec4 May 21 14:54:14.629690 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.629661 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced8217a_b9d3_4ac7_9509_3ab5f1fe652a.slice/crio-a087f9432f7d054d3a29c9a3ca6bf9c01c779fb3648b22d6fce94598e69bec5d WatchSource:0}: Error finding container a087f9432f7d054d3a29c9a3ca6bf9c01c779fb3648b22d6fce94598e69bec5d: Status 404 returned error can't find the container with id a087f9432f7d054d3a29c9a3ca6bf9c01c779fb3648b22d6fce94598e69bec5d May 21 14:54:14.630612 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.630491 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c20876_c5a8_4a7f_9c2c_e45e5b1117b4.slice/crio-ff1618cff95dc98ff6702528139c7713840c5237c0ab74daf8b33635fe859e81 WatchSource:0}: Error finding container ff1618cff95dc98ff6702528139c7713840c5237c0ab74daf8b33635fe859e81: Status 404 returned error can't find the container with id ff1618cff95dc98ff6702528139c7713840c5237c0ab74daf8b33635fe859e81 May 21 14:54:14.631000 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.630976 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf5132e_4137_42aa_a050_a855d65ef1b4.slice/crio-69d5d07951c7f89043dbd7bb70f356d43642a13f3fd3cef24fb35044a5b5a11a WatchSource:0}: Error finding container 69d5d07951c7f89043dbd7bb70f356d43642a13f3fd3cef24fb35044a5b5a11a: Status 404 returned error can't find the container with id 69d5d07951c7f89043dbd7bb70f356d43642a13f3fd3cef24fb35044a5b5a11a May 21 14:54:14.632202 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.631931 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a4de00_323c_4547_be9a_16138406a7ef.slice/crio-be42be2c364f1bd75a5aa49b910594cad4ca27ba074545fbdf05d9f236558dac WatchSource:0}: Error finding container be42be2c364f1bd75a5aa49b910594cad4ca27ba074545fbdf05d9f236558dac: Status 404 returned error can't find the container with id be42be2c364f1bd75a5aa49b910594cad4ca27ba074545fbdf05d9f236558dac May 21 14:54:14.632849 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.632831 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae34b84a_0fdb_43cf_b685_83896e76ae82.slice/crio-a67c9f9005bc93943756b87db37cea44517a5ed4f2aedaab0ed3586179cf8bcb WatchSource:0}: Error finding container a67c9f9005bc93943756b87db37cea44517a5ed4f2aedaab0ed3586179cf8bcb: Status 404 returned error can't find the container with id a67c9f9005bc93943756b87db37cea44517a5ed4f2aedaab0ed3586179cf8bcb May 21 14:54:14.635108 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.634523 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41860ef6_228f_4bb5_9126_9ac36c627a82.slice/crio-b69ffaa688e743a3a4aa50a6c1a22eb10a71e209f2266e108c12a69b587eb35d WatchSource:0}: Error finding container b69ffaa688e743a3a4aa50a6c1a22eb10a71e209f2266e108c12a69b587eb35d: Status 404 returned error can't find the container with id b69ffaa688e743a3a4aa50a6c1a22eb10a71e209f2266e108c12a69b587eb35d May 21 14:54:14.636068 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:14.635909 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30cace1_723f_443a_9489_2dfe52748c0d.slice/crio-57748e645d93a8fdf227f1848a502fac759e313043842835169e1cacd116c3c2 WatchSource:0}: Error finding container 57748e645d93a8fdf227f1848a502fac759e313043842835169e1cacd116c3c2: Status 404 returned error can't find the container with id 57748e645d93a8fdf227f1848a502fac759e313043842835169e1cacd116c3c2 May 21 14:54:14.717824 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:14.717592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:14.717824 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.717746 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:14.717921 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.717827 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:14.717921 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.717838 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:14.717921 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:14.717890 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:15.717876421 +0000 UTC m=+4.203773640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:15.036759 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.036686 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:49:13 +0000 UTC" deadline="2028-01-20 23:56:32.023666903 +0000 UTC" May 21 14:54:15.036759 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.036726 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14625h2m16.986944636s" May 21 14:54:15.095811 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.095222 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:15.095811 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.095391 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:15.116904 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.116785 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerStarted","Data":"04c31f7f84995f8a626e68dfdb27d0f41dff9d48626c4292118c799ee14baec4"} May 21 14:54:15.120066 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.119991 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" event={"ID":"c30cace1-723f-443a-9489-2dfe52748c0d","Type":"ContainerStarted","Data":"57748e645d93a8fdf227f1848a502fac759e313043842835169e1cacd116c3c2"} May 21 14:54:15.123331 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.123265 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ld6c" event={"ID":"41860ef6-228f-4bb5-9126-9ac36c627a82","Type":"ContainerStarted","Data":"b69ffaa688e743a3a4aa50a6c1a22eb10a71e209f2266e108c12a69b587eb35d"} May 21 14:54:15.129375 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.129329 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-msbbj" event={"ID":"ae34b84a-0fdb-43cf-b685-83896e76ae82","Type":"ContainerStarted","Data":"a67c9f9005bc93943756b87db37cea44517a5ed4f2aedaab0ed3586179cf8bcb"} May 21 14:54:15.137171 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.137139 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6krr" event={"ID":"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4","Type":"ContainerStarted","Data":"ff1618cff95dc98ff6702528139c7713840c5237c0ab74daf8b33635fe859e81"} May 21 14:54:15.151979 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.151286 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" event={"ID":"3e860e65447da6b42d64abb9f280bafd","Type":"ContainerStarted","Data":"ef6fdf9a502748f842175220689b01005bceb1b53235142b46b8c59c374e2891"} May 21 14:54:15.167507 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.166842 2559 generic.go:358] "Generic (PLEG): container finished" podID="a5fd121eefd2062fa0e44c1e935a62dd" containerID="ac9d35913db4c41c5255ca10f4bbbdd39528817a9b5b4748368097d774dd3e47" exitCode=0 May 21 14:54:15.167507 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.166919 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"a5fd121eefd2062fa0e44c1e935a62dd","Type":"ContainerDied","Data":"ac9d35913db4c41c5255ca10f4bbbdd39528817a9b5b4748368097d774dd3e47"} May 21 14:54:15.176620 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.176040 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-65.ec2.internal" podStartSLOduration=2.176021475 podStartE2EDuration="2.176021475s" podCreationTimestamp="2026-05-21 14:54:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:54:15.17564103 +0000 UTC m=+3.661538266" watchObservedRunningTime="2026-05-21 14:54:15.176021475 +0000 UTC m=+3.661918702" May 21 14:54:15.185428 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.185391 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"d50e23dcb429eb7e9695442a34d73fa96cd53e021e2d0563695f9a55dbf5b516"} May 21 14:54:15.204806 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.204676 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnkhs" event={"ID":"27a4de00-323c-4547-be9a-16138406a7ef","Type":"ContainerStarted","Data":"be42be2c364f1bd75a5aa49b910594cad4ca27ba074545fbdf05d9f236558dac"} May 21 14:54:15.215209 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.215123 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4vdtv" event={"ID":"4cf5132e-4137-42aa-a050-a855d65ef1b4","Type":"ContainerStarted","Data":"69d5d07951c7f89043dbd7bb70f356d43642a13f3fd3cef24fb35044a5b5a11a"} May 21 14:54:15.220551 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.220493 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xf65f" event={"ID":"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a","Type":"ContainerStarted","Data":"a087f9432f7d054d3a29c9a3ca6bf9c01c779fb3648b22d6fce94598e69bec5d"} May 21 14:54:15.625378 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.625338 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:15.625549 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.625524 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:15.625601 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.625590 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:17.625571621 +0000 UTC m=+6.111468848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:15.726654 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:15.726561 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:15.726821 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.726759 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:15.726821 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.726780 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:15.726821 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.726813 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:15.726992 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:15.726875 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:17.726856174 +0000 UTC m=+6.212753393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:16.097794 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:16.097704 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:16.098272 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:16.097824 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:16.233134 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:16.233088 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" event={"ID":"a5fd121eefd2062fa0e44c1e935a62dd","Type":"ContainerStarted","Data":"b20b138cf8cdae93803a3b8e49339e2944a132a9daed9dd27c3ee5e620a84c5a"} May 21 14:54:17.094594 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:17.094556 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:17.094800 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.094712 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:17.645593 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:17.645548 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:17.646118 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.645705 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:17.646118 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.645772 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:21.645751798 +0000 UTC m=+10.131649011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:17.746549 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:17.746499 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:17.746706 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.746675 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:17.746706 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.746693 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:17.746706 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.746706 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:17.746867 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:17.746768 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:21.746747736 +0000 UTC m=+10.232644955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:18.095101 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:18.094990 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:18.095258 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:18.095139 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:19.094628 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:19.094589 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:19.095035 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:19.094745 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:20.095175 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:20.095137 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:20.095616 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:20.095279 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:21.095214 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:21.095180 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:21.095679 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.095324 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:21.683191 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:21.683151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:21.683373 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.683360 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:21.683434 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.683427 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:29.683408042 +0000 UTC m=+18.169305269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:21.784261 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:21.784217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:21.784469 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.784422 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:21.784469 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.784446 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:21.784469 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.784458 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:21.784704 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:21.784522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:29.784503554 +0000 UTC m=+18.270400777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:22.095803 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:22.095696 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:22.096267 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:22.095825 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:23.094486 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:23.094449 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:23.094678 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:23.094593 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:24.094920 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:24.094880 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:24.095331 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:24.094999 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:25.094763 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:25.094718 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:25.094962 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:25.094852 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:26.094892 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:26.094841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:26.095076 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:26.094981 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:27.094868 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:27.094829 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:27.095063 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:27.094979 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:28.095109 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:28.095025 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:28.095569 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:28.095170 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:29.094903 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:29.094872 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:29.095195 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.095024 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:29.736362 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:29.736320 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:29.736567 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.736488 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:29.736632 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.736569 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:54:45.736547211 +0000 UTC m=+34.222444425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:29.836715 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:29.836679 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:29.836896 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.836873 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:29.836962 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.836902 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:29.836962 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.836913 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:29.837077 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:29.836985 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:45.836963674 +0000 UTC m=+34.322860893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:30.094754 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:30.094668 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:30.094918 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:30.094799 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:31.095290 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:31.095251 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:31.095834 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:31.095377 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:32.095311 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:32.095275 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:32.095678 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:32.095389 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:33.095192 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.094867 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:33.095356 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:33.095290 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"a30e0cd39672ae067bd6d343f6d2fd356e59da013f4573265f44625a15dcebe2"} May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"88db598d03955cddda2c570369630efdbcb0221b37aa108c4d10969251a6a309"} May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265500 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"2abe80b86b2b3a6ae4fe37ca5e211f1ce360dd5c675d6525f11944a11b7b3231"} May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265511 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"c25b815dc8000125676989cfb595e36f1f6c6ac1b3999eb6dcb9ad0bfbe50d10"} May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265521 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"1c1811f2afc261f7478c5d758a2deac5e8fe3c577ac31d3f81cec47095ba2f02"} May 21 14:54:33.265546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.265533 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"bc74f001080167651d3eb3656e43071d42ebf6ee9606692a266714d311df312b"} May 21 14:54:33.266877 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.266824 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnkhs" event={"ID":"27a4de00-323c-4547-be9a-16138406a7ef","Type":"ContainerStarted","Data":"adc64a8a338e1762dfb237229b5cecead9d635e5e1e21bc4c5f2f37da7e38de8"} May 21 14:54:33.268225 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.268185 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4vdtv" event={"ID":"4cf5132e-4137-42aa-a050-a855d65ef1b4","Type":"ContainerStarted","Data":"fd94125947f104a3407f187a9691c3b7bec9c6e4958d6604de00b40be1c4882e"} May 21 14:54:33.271228 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.271201 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xf65f" event={"ID":"ced8217a-b9d3-4ac7-9509-3ab5f1fe652a","Type":"ContainerStarted","Data":"8f312644089b12578b0ada44c70af985d8347206254107e7439566c30b6dbaaf"} May 21 14:54:33.273258 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.273233 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="ede1bf873d80312f4d697f6b307867d1a2f3ae4b7b3b5775886337b7325dca29" exitCode=0 May 21 14:54:33.273367 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.273314 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"ede1bf873d80312f4d697f6b307867d1a2f3ae4b7b3b5775886337b7325dca29"} May 21 14:54:33.274775 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.274753 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" event={"ID":"c30cace1-723f-443a-9489-2dfe52748c0d","Type":"ContainerStarted","Data":"594f5405d9e6abd91a0ed695bfb2d9c7058d8e6dfb2ba2cb68b4bde39de46e4c"} May 21 14:54:33.276243 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.276217 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-msbbj" event={"ID":"ae34b84a-0fdb-43cf-b685-83896e76ae82","Type":"ContainerStarted","Data":"49d39939e0d61038548776fcadf978b05e8bb7d1191ed733692c0510a5cf0181"} May 21 14:54:33.277858 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.277827 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6krr" event={"ID":"b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4","Type":"ContainerStarted","Data":"ef4c60c3df0fcd000c460c230c6a2ec3e78e1d75e032125af439e0b94f353a23"} May 21 14:54:33.281820 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.281785 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-65.ec2.internal" podStartSLOduration=20.281773597 podStartE2EDuration="20.281773597s" podCreationTimestamp="2026-05-21 14:54:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:54:16.25021817 +0000 UTC m=+4.736115433" watchObservedRunningTime="2026-05-21 14:54:33.281773597 +0000 UTC m=+21.767670833" May 21 14:54:33.282127 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.282096 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pnkhs" podStartSLOduration=8.085716208 podStartE2EDuration="21.282085865s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.633739646 +0000 UTC m=+3.119636874" lastFinishedPulling="2026-05-21 14:54:27.830109303 +0000 UTC m=+16.316006531" observedRunningTime="2026-05-21 14:54:33.281185132 +0000 UTC m=+21.767082368" watchObservedRunningTime="2026-05-21 14:54:33.282085865 +0000 UTC m=+21.767983102" May 21 14:54:33.296294 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.296249 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-msbbj" podStartSLOduration=3.365859165 podStartE2EDuration="21.296234776s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.635449389 +0000 UTC m=+3.121346602" lastFinishedPulling="2026-05-21 14:54:32.565824997 +0000 UTC m=+21.051722213" observedRunningTime="2026-05-21 14:54:33.29562371 +0000 UTC m=+21.781520946" watchObservedRunningTime="2026-05-21 14:54:33.296234776 +0000 UTC m=+21.782132012" May 21 14:54:33.309252 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.309204 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m6krr" podStartSLOduration=3.403189629 podStartE2EDuration="21.309185854s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.632794279 +0000 UTC m=+3.118691498" lastFinishedPulling="2026-05-21 14:54:32.538790506 +0000 UTC m=+21.024687723" observedRunningTime="2026-05-21 14:54:33.308876435 +0000 UTC m=+21.794773672" watchObservedRunningTime="2026-05-21 14:54:33.309185854 +0000 UTC m=+21.795083091" May 21 14:54:33.351245 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.351195 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4vdtv" podStartSLOduration=3.419198256 podStartE2EDuration="21.351180626s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.633469321 +0000 UTC m=+3.119366543" lastFinishedPulling="2026-05-21 14:54:32.565451687 +0000 UTC m=+21.051348913" observedRunningTime="2026-05-21 14:54:33.350745515 +0000 UTC m=+21.836642755" watchObservedRunningTime="2026-05-21 14:54:33.351180626 +0000 UTC m=+21.837077861" May 21 14:54:33.387475 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.387407 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xf65f" podStartSLOduration=3.435972919 podStartE2EDuration="21.38738838s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.632318199 +0000 UTC m=+3.118215411" lastFinishedPulling="2026-05-21 14:54:32.583733646 +0000 UTC m=+21.069630872" observedRunningTime="2026-05-21 14:54:33.383957365 +0000 UTC m=+21.869854600" watchObservedRunningTime="2026-05-21 14:54:33.38738838 +0000 UTC m=+21.873285617" May 21 14:54:33.617531 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.617506 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:54:33.695157 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.695126 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sllss"] May 21 14:54:33.697210 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.697192 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.697292 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:33.697267 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:33.764573 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.764539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-kubelet-config\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.764709 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.764590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.764709 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.764621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-dbus\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.865941 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.865909 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-dbus\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.866138 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.865971 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-kubelet-config\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.866138 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.866019 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.866138 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.866111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-kubelet-config\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:33.866301 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:33.866144 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:54:33.866301 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:33.866203 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret podName:b769e610-efc4-4f28-af2f-f01e19dc5b26 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:34.366183364 +0000 UTC m=+22.852080580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret") pod "global-pull-secret-syncer-sllss" (UID: "b769e610-efc4-4f28-af2f-f01e19dc5b26") : object "kube-system"/"original-pull-secret" not registered May 21 14:54:33.866301 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:33.866208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b769e610-efc4-4f28-af2f-f01e19dc5b26-dbus\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:34.080536 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.080398 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:54:33.617527327Z","UUID":"a82a8b5d-255c-4824-bf13-f12eaad54b86","Handler":null,"Name":"","Endpoint":""} May 21 14:54:34.082195 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.082172 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:54:34.082333 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.082203 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:54:34.094776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.094746 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:34.094927 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:34.094869 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:34.282833 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.282787 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" event={"ID":"c30cace1-723f-443a-9489-2dfe52748c0d","Type":"ContainerStarted","Data":"98ee7f4da78cdd1b41f88f51fd3f2f042aa39c16217a13686194dc62fd4f4152"} May 21 14:54:34.284673 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.284637 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ld6c" event={"ID":"41860ef6-228f-4bb5-9126-9ac36c627a82","Type":"ContainerStarted","Data":"b6fbe1f4cdec311b6951bf62044236a3377d1446f09822d0b77e20b8160f592e"} May 21 14:54:34.301319 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.301264 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6ld6c" podStartSLOduration=4.400808744 podStartE2EDuration="22.301247111s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.638325788 +0000 UTC m=+3.124223000" lastFinishedPulling="2026-05-21 14:54:32.538764149 +0000 UTC m=+21.024661367" observedRunningTime="2026-05-21 14:54:34.300653943 +0000 UTC m=+22.786551180" watchObservedRunningTime="2026-05-21 14:54:34.301247111 +0000 UTC m=+22.787144347" May 21 14:54:34.371154 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:34.370336 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:34.371154 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:34.370915 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:54:34.371154 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:34.370984 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret podName:b769e610-efc4-4f28-af2f-f01e19dc5b26 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:35.370962801 +0000 UTC m=+23.856860230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret") pod "global-pull-secret-syncer-sllss" (UID: "b769e610-efc4-4f28-af2f-f01e19dc5b26") : object "kube-system"/"original-pull-secret" not registered May 21 14:54:35.094701 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.094666 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:35.094701 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.094695 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:35.094917 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:35.094797 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:35.094978 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:35.094952 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:35.288399 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.288351 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" event={"ID":"c30cace1-723f-443a-9489-2dfe52748c0d","Type":"ContainerStarted","Data":"ece1ddbe4b2f42766b0acf5c6384e6e48671c9a09d95ae3a76d7552b0ba80c2a"} May 21 14:54:35.291701 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.291670 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"bc6b66344f34e62bd641bef9ea767534620128288fdb6ab1a30c4a95dbc9a369"} May 21 14:54:35.309684 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.309628 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rl75" podStartSLOduration=3.428521969 podStartE2EDuration="23.309607363s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.642105709 +0000 UTC m=+3.128002922" lastFinishedPulling="2026-05-21 14:54:34.523191091 +0000 UTC m=+23.009088316" observedRunningTime="2026-05-21 14:54:35.309263308 +0000 UTC m=+23.795160544" watchObservedRunningTime="2026-05-21 14:54:35.309607363 +0000 UTC m=+23.795504599" May 21 14:54:35.375535 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:35.375447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:35.375707 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:35.375547 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:54:35.375707 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:35.375624 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret podName:b769e610-efc4-4f28-af2f-f01e19dc5b26 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:37.375601052 +0000 UTC m=+25.861498273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret") pod "global-pull-secret-syncer-sllss" (UID: "b769e610-efc4-4f28-af2f-f01e19dc5b26") : object "kube-system"/"original-pull-secret" not registered May 21 14:54:36.095092 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:36.094899 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:36.095264 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:36.095174 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:37.095172 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.095135 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:37.095684 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.095135 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:37.095684 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:37.095274 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:37.095684 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:37.095372 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:37.180212 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.180174 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:37.181417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.181388 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:37.296074 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.296041 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:37.296609 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.296592 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pnkhs" May 21 14:54:37.391220 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:37.391190 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:37.391355 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:37.391336 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:54:37.391431 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:37.391417 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret podName:b769e610-efc4-4f28-af2f-f01e19dc5b26 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:41.391394721 +0000 UTC m=+29.877291934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret") pod "global-pull-secret-syncer-sllss" (UID: "b769e610-efc4-4f28-af2f-f01e19dc5b26") : object "kube-system"/"original-pull-secret" not registered May 21 14:54:38.095319 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.095055 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:38.095971 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:38.095431 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:38.299272 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.299240 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="5f289602914f084bb016e117f13c1f17e2b4f97e7092020191c622d87784b1f8" exitCode=0 May 21 14:54:38.299436 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.299323 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"5f289602914f084bb016e117f13c1f17e2b4f97e7092020191c622d87784b1f8"} May 21 14:54:38.302670 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.302636 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" event={"ID":"f4571ed6-8695-4611-a836-a6bbc9c83e47","Type":"ContainerStarted","Data":"956463d406d2089fb7b35d035e68986ce72b32fca45484168feb1ba473097e2e"} May 21 14:54:38.302951 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.302929 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:38.303070 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.302959 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:38.303070 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.302972 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:38.318758 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.318734 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:38.318896 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.318812 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:54:38.345853 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:38.345757 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" podStartSLOduration=8.342477515 podStartE2EDuration="26.345743265s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.642121435 +0000 UTC m=+3.128018648" lastFinishedPulling="2026-05-21 14:54:32.645387172 +0000 UTC m=+21.131284398" observedRunningTime="2026-05-21 14:54:38.344364864 +0000 UTC m=+26.830262098" watchObservedRunningTime="2026-05-21 14:54:38.345743265 +0000 UTC m=+26.831640547" May 21 14:54:39.094484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.094436 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:39.094682 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.094436 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:39.094682 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:39.094599 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:39.094809 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:39.094676 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:39.637232 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.637141 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vr27p"] May 21 14:54:39.637672 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.637298 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:39.637672 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:39.637404 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:39.637950 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.637928 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sllss"] May 21 14:54:39.638073 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.638039 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:39.638172 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:39.638140 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:39.638589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.638551 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5656t"] May 21 14:54:39.638664 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:39.638652 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:39.638778 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:39.638757 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:40.309398 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:40.309366 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="1eb96a9795fe6b5e38d1183b69f08b7d10e17aeeb868ab99ef45ab30dc512fd3" exitCode=0 May 21 14:54:40.309646 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:40.309467 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"1eb96a9795fe6b5e38d1183b69f08b7d10e17aeeb868ab99ef45ab30dc512fd3"} May 21 14:54:41.094561 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:41.094526 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:41.094561 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:41.094546 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:41.095112 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:41.094637 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:41.095112 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:41.094712 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:41.424284 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:41.424256 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:41.424389 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:41.424367 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:54:41.424444 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:41.424419 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret podName:b769e610-efc4-4f28-af2f-f01e19dc5b26 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:49.424404362 +0000 UTC m=+37.910301575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret") pod "global-pull-secret-syncer-sllss" (UID: "b769e610-efc4-4f28-af2f-f01e19dc5b26") : object "kube-system"/"original-pull-secret" not registered May 21 14:54:42.096179 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:42.095924 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:42.096553 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:42.096276 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:42.314993 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:42.314962 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="d56ad8704a9ca49dc904f9f7d4e397992d320fe8761cf1704ab60d3314edcb96" exitCode=0 May 21 14:54:42.315164 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:42.315044 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"d56ad8704a9ca49dc904f9f7d4e397992d320fe8761cf1704ab60d3314edcb96"} May 21 14:54:43.094596 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:43.094555 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:43.094822 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:43.094574 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:43.094822 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:43.094692 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:43.094822 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:43.094763 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:44.095362 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:44.095329 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:44.095833 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:44.095468 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sllss" podUID="b769e610-efc4-4f28-af2f-f01e19dc5b26" May 21 14:54:45.094927 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.094893 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:45.095100 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.094948 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:45.095165 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.095093 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:54:45.095219 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.095186 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vr27p" podUID="760992f3-9188-4c23-9ad2-ea67ad47177e" May 21 14:54:45.325783 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.325755 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-65.ec2.internal" event="NodeReady" May 21 14:54:45.326392 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.325894 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:54:45.371335 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.371250 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t6mcs"] May 21 14:54:45.389815 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.389762 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s47zt"] May 21 14:54:45.389998 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.389974 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.392312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.392289 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:54:45.392946 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.392662 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jrvl8\"" May 21 14:54:45.392946 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.392662 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:54:45.407534 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.407511 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s47zt"] May 21 14:54:45.407534 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.407536 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t6mcs"] May 21 14:54:45.407756 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.407637 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.410277 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.410254 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:54:45.410406 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.410255 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:54:45.410406 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.410369 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j2cxw\"" May 21 14:54:45.410519 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.410263 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:54:45.555402 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h4vl\" (UniqueName: \"kubernetes.io/projected/97a6b757-cbe5-45c7-ac93-0164412e7d2d-kube-api-access-8h4vl\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.555402 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.555645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a6b757-cbe5-45c7-ac93-0164412e7d2d-tmp-dir\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.555645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6wb\" (UniqueName: \"kubernetes.io/projected/c803a29c-0f7f-49ca-8b2f-561c51600efa-kube-api-access-9p6wb\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.555645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a6b757-cbe5-45c7-ac93-0164412e7d2d-config-volume\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.555645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.555595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.656572 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656467 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4vl\" (UniqueName: \"kubernetes.io/projected/97a6b757-cbe5-45c7-ac93-0164412e7d2d-kube-api-access-8h4vl\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.656572 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.656572 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656563 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a6b757-cbe5-45c7-ac93-0164412e7d2d-tmp-dir\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656597 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6wb\" (UniqueName: \"kubernetes.io/projected/c803a29c-0f7f-49ca-8b2f-561c51600efa-kube-api-access-9p6wb\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a6b757-cbe5-45c7-ac93-0164412e7d2d-config-volume\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656645 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.656697 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.656745 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.656768 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:54:46.156744304 +0000 UTC m=+34.642641524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:54:45.656850 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.656793 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:54:46.156776598 +0000 UTC m=+34.642673837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:54:45.657139 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.656966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a6b757-cbe5-45c7-ac93-0164412e7d2d-tmp-dir\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.657236 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.657219 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a6b757-cbe5-45c7-ac93-0164412e7d2d-config-volume\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.667152 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.667126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4vl\" (UniqueName: \"kubernetes.io/projected/97a6b757-cbe5-45c7-ac93-0164412e7d2d-kube-api-access-8h4vl\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:45.667265 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.667235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6wb\" (UniqueName: \"kubernetes.io/projected/c803a29c-0f7f-49ca-8b2f-561c51600efa-kube-api-access-9p6wb\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:45.757579 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.757542 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:45.757741 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.757698 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:45.757781 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.757767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:55:17.757751241 +0000 UTC m=+66.243648454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:45.858153 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:45.858115 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:45.858342 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.858305 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:45.858342 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.858329 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:45.858342 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.858340 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d2tqz for pod openshift-network-diagnostics/network-check-target-vr27p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:45.858467 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:45.858411 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz podName:760992f3-9188-4c23-9ad2-ea67ad47177e nodeName:}" failed. No retries permitted until 2026-05-21 14:55:17.85839525 +0000 UTC m=+66.344292468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2tqz" (UniqueName: "kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz") pod "network-check-target-vr27p" (UID: "760992f3-9188-4c23-9ad2-ea67ad47177e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:46.094849 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:46.094810 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:46.097494 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:46.097465 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:54:46.161338 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:46.161299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:46.161521 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:46.161384 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:46.161521 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:46.161463 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:54:46.161521 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:46.161487 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:54:46.161710 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:46.161547 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:54:47.161523317 +0000 UTC m=+35.647420535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:54:46.161710 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:46.161567 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:54:47.161557057 +0000 UTC m=+35.647454274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:54:47.095327 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.095288 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:54:47.096208 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.095288 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:54:47.098886 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.098863 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrll9\"" May 21 14:54:47.099270 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.099243 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:54:47.099270 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.099260 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:54:47.099871 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.099854 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl42\"" May 21 14:54:47.099956 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.099926 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:54:47.168393 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.168348 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:47.168578 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:47.168428 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:47.168578 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:47.168528 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:54:47.168669 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:47.168597 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:54:49.168578815 +0000 UTC m=+37.654476046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:54:47.168669 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:47.168534 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:54:47.168757 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:47.168677 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:54:49.168661723 +0000 UTC m=+37.654558938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:54:49.183566 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.183517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:49.183933 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.183599 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:49.183933 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:49.183671 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:54:49.183933 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:49.183738 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:54:53.183720926 +0000 UTC m=+41.669618144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:54:49.183933 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:49.183679 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:54:49.183933 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:49.183802 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:54:53.183791207 +0000 UTC m=+41.669688420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:54:49.332744 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.332712 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="4ec655e60ec9bf88f97867273ebae516c2cf1be900d8739c683789cd4b884964" exitCode=0 May 21 14:54:49.332930 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.332755 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"4ec655e60ec9bf88f97867273ebae516c2cf1be900d8739c683789cd4b884964"} May 21 14:54:49.487502 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.487315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:49.490077 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.490051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b769e610-efc4-4f28-af2f-f01e19dc5b26-original-pull-secret\") pod \"global-pull-secret-syncer-sllss\" (UID: \"b769e610-efc4-4f28-af2f-f01e19dc5b26\") " pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:49.705611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.705491 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sllss" May 21 14:54:49.863885 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:49.863848 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sllss"] May 21 14:54:49.868532 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:54:49.868503 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb769e610_efc4_4f28_af2f_f01e19dc5b26.slice/crio-8f9f7914f966c441c4931d9308ba857be99b0c7044a9ced818bd43c7e3628630 WatchSource:0}: Error finding container 8f9f7914f966c441c4931d9308ba857be99b0c7044a9ced818bd43c7e3628630: Status 404 returned error can't find the container with id 8f9f7914f966c441c4931d9308ba857be99b0c7044a9ced818bd43c7e3628630 May 21 14:54:50.336884 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:50.336844 2559 generic.go:358] "Generic (PLEG): container finished" podID="f90aee8c-78a3-4a49-9e40-f87c42ccfbb9" containerID="1cffd6cdcc0e272b2b3100daef1eb17fa94eb3489cb445a0ca6a017e904d61ff" exitCode=0 May 21 14:54:50.337399 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:50.336926 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerDied","Data":"1cffd6cdcc0e272b2b3100daef1eb17fa94eb3489cb445a0ca6a017e904d61ff"} May 21 14:54:50.338155 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:50.337973 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sllss" event={"ID":"b769e610-efc4-4f28-af2f-f01e19dc5b26","Type":"ContainerStarted","Data":"8f9f7914f966c441c4931d9308ba857be99b0c7044a9ced818bd43c7e3628630"} May 21 14:54:51.343503 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:51.343297 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" event={"ID":"f90aee8c-78a3-4a49-9e40-f87c42ccfbb9","Type":"ContainerStarted","Data":"f8a61728bb9eaf7bdbfcb2288b512d7c80309f1df53956725eae0b79713ac887"} May 21 14:54:51.368179 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:51.368116 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jv5z2" podStartSLOduration=5.799606555 podStartE2EDuration="39.368097579s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:54:14.626411587 +0000 UTC m=+3.112308802" lastFinishedPulling="2026-05-21 14:54:48.194902606 +0000 UTC m=+36.680799826" observedRunningTime="2026-05-21 14:54:51.367266152 +0000 UTC m=+39.853163400" watchObservedRunningTime="2026-05-21 14:54:51.368097579 +0000 UTC m=+39.853994814" May 21 14:54:53.217220 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:53.217181 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:54:53.217671 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:53.217252 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:54:53.217671 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:53.217367 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:54:53.217671 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:53.217371 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:54:53.217671 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:53.217429 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:55:01.21741506 +0000 UTC m=+49.703312273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:54:53.217671 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:54:53.217443 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:55:01.217437416 +0000 UTC m=+49.703334629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:54:54.352044 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:54:54.351993 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sllss" event={"ID":"b769e610-efc4-4f28-af2f-f01e19dc5b26","Type":"ContainerStarted","Data":"1b6fab7a57cfb6915d50fc33a0bd7761b9fe3b59428f77b695d503c29a6dda03"} May 21 14:55:01.281542 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:01.281421 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:55:01.281542 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:01.281510 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:55:01.282110 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:01.281577 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:01.282110 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:01.281607 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:01.282110 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:01.281659 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:55:17.281641203 +0000 UTC m=+65.767538416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:55:01.282110 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:01.281674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:55:17.281667635 +0000 UTC m=+65.767564848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:55:10.327328 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:10.327298 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfp5m" May 21 14:55:10.357142 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:10.357087 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sllss" podStartSLOduration=33.056096886 podStartE2EDuration="37.357072667s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:49.870162455 +0000 UTC m=+38.356059669" lastFinishedPulling="2026-05-21 14:54:54.171138231 +0000 UTC m=+42.657035450" observedRunningTime="2026-05-21 14:54:54.384649996 +0000 UTC m=+42.870547231" watchObservedRunningTime="2026-05-21 14:55:10.357072667 +0000 UTC m=+58.842969880" May 21 14:55:17.291930 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.291879 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:55:17.291930 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.291941 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:55:17.292480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.292049 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:17.292480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.292061 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:17.292480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.292108 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:55:49.29209466 +0000 UTC m=+97.777991872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:55:17.292480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.292142 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:55:49.292121798 +0000 UTC m=+97.778019029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:55:17.795478 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.795445 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:55:17.797712 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.797694 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:55:17.805850 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.805826 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:55:17.805964 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:17.805915 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:56:21.805891806 +0000 UTC m=+130.291789024 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : secret "metrics-daemon-secret" not found May 21 14:55:17.896643 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.896595 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:55:17.899050 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.899034 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:55:17.909817 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.909801 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:55:17.921759 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:17.921726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2tqz\" (UniqueName: \"kubernetes.io/projected/760992f3-9188-4c23-9ad2-ea67ad47177e-kube-api-access-d2tqz\") pod \"network-check-target-vr27p\" (UID: \"760992f3-9188-4c23-9ad2-ea67ad47177e\") " pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:55:18.010217 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:18.010186 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrll9\"" May 21 14:55:18.018190 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:18.018165 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:55:18.137156 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:18.137123 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vr27p"] May 21 14:55:18.141003 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:55:18.140975 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760992f3_9188_4c23_9ad2_ea67ad47177e.slice/crio-6eeb447d06c51bce0a73349921e362c37245bf0169cabfa75e6ffc335f24608a WatchSource:0}: Error finding container 6eeb447d06c51bce0a73349921e362c37245bf0169cabfa75e6ffc335f24608a: Status 404 returned error can't find the container with id 6eeb447d06c51bce0a73349921e362c37245bf0169cabfa75e6ffc335f24608a May 21 14:55:18.396434 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:18.396339 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vr27p" event={"ID":"760992f3-9188-4c23-9ad2-ea67ad47177e","Type":"ContainerStarted","Data":"6eeb447d06c51bce0a73349921e362c37245bf0169cabfa75e6ffc335f24608a"} May 21 14:55:21.402858 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:21.402823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vr27p" event={"ID":"760992f3-9188-4c23-9ad2-ea67ad47177e","Type":"ContainerStarted","Data":"c837c71d7bdb25eb52d560bcd00026f43973a2dd6cd8504bee067096154e1edf"} May 21 14:55:21.403256 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:21.403036 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:55:21.418914 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:21.418855 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vr27p" podStartSLOduration=66.60716648 podStartE2EDuration="1m9.418837311s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:55:18.143367162 +0000 UTC m=+66.629264378" lastFinishedPulling="2026-05-21 14:55:20.955037996 +0000 UTC m=+69.440935209" observedRunningTime="2026-05-21 14:55:21.418204178 +0000 UTC m=+69.904101416" watchObservedRunningTime="2026-05-21 14:55:21.418837311 +0000 UTC m=+69.904734548" May 21 14:55:49.319693 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:49.319658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:55:49.320202 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:49.319716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:55:49.320202 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:49.319813 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:49.320202 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:49.319836 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:49.320202 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:49.319869 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert podName:c803a29c-0f7f-49ca-8b2f-561c51600efa nodeName:}" failed. No retries permitted until 2026-05-21 14:56:53.319855582 +0000 UTC m=+161.805752796 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert") pod "ingress-canary-s47zt" (UID: "c803a29c-0f7f-49ca-8b2f-561c51600efa") : secret "canary-serving-cert" not found May 21 14:55:49.320202 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:55:49.319913 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls podName:97a6b757-cbe5-45c7-ac93-0164412e7d2d nodeName:}" failed. No retries permitted until 2026-05-21 14:56:53.319894258 +0000 UTC m=+161.805791484 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls") pod "dns-default-t6mcs" (UID: "97a6b757-cbe5-45c7-ac93-0164412e7d2d") : secret "dns-default-metrics-tls" not found May 21 14:55:52.407522 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:55:52.407488 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vr27p" May 21 14:56:13.470214 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.470179 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vpvlx"] May 21 14:56:13.472076 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.472061 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.474499 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.474468 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9wgf\"" May 21 14:56:13.474499 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.474489 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 14:56:13.474698 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.474470 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:56:13.475217 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.475200 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:56:13.475217 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.475204 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 14:56:13.480315 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.480150 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 14:56:13.481297 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.481276 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vpvlx"] May 21 14:56:13.593782 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-tmp\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.593782 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.594031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqz22\" (UniqueName: \"kubernetes.io/projected/03cee9f1-cd81-4fe0-a09e-62b362165285-kube-api-access-lqz22\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.594031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-snapshots\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.594031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03cee9f1-cd81-4fe0-a09e-62b362165285-serving-cert\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.594031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.593993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695340 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695285 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-tmp\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695340 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695345 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695378 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqz22\" (UniqueName: \"kubernetes.io/projected/03cee9f1-cd81-4fe0-a09e-62b362165285-kube-api-access-lqz22\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695414 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-snapshots\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695441 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03cee9f1-cd81-4fe0-a09e-62b362165285-serving-cert\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695479 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.695971 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-tmp\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.696098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.695977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03cee9f1-cd81-4fe0-a09e-62b362165285-snapshots\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.696098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.696086 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-service-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.696364 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.696343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03cee9f1-cd81-4fe0-a09e-62b362165285-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.701148 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.698239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03cee9f1-cd81-4fe0-a09e-62b362165285-serving-cert\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.703933 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.703913 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqz22\" (UniqueName: \"kubernetes.io/projected/03cee9f1-cd81-4fe0-a09e-62b362165285-kube-api-access-lqz22\") pod \"insights-operator-78bdfb888c-vpvlx\" (UID: \"03cee9f1-cd81-4fe0-a09e-62b362165285\") " pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.780939 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.780859 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" May 21 14:56:13.902721 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:13.902682 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-vpvlx"] May 21 14:56:13.906705 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:13.906670 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cee9f1_cd81_4fe0_a09e_62b362165285.slice/crio-d5d1d00cf9eed6b7c248e70b255f9953be634c67f5565c344c8a3fea60d20c45 WatchSource:0}: Error finding container d5d1d00cf9eed6b7c248e70b255f9953be634c67f5565c344c8a3fea60d20c45: Status 404 returned error can't find the container with id d5d1d00cf9eed6b7c248e70b255f9953be634c67f5565c344c8a3fea60d20c45 May 21 14:56:14.508379 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:14.508322 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" event={"ID":"03cee9f1-cd81-4fe0-a09e-62b362165285","Type":"ContainerStarted","Data":"d5d1d00cf9eed6b7c248e70b255f9953be634c67f5565c344c8a3fea60d20c45"} May 21 14:56:16.514030 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:16.513978 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" event={"ID":"03cee9f1-cd81-4fe0-a09e-62b362165285","Type":"ContainerStarted","Data":"eecf235f596668d00d69b04d52c9bb864796b35d580cf45304ce55f52e1450d0"} May 21 14:56:16.532464 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:16.532409 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" podStartSLOduration=1.714848594 podStartE2EDuration="3.532390746s" podCreationTimestamp="2026-05-21 14:56:13 +0000 UTC" firstStartedPulling="2026-05-21 14:56:13.908701608 +0000 UTC m=+122.394598825" lastFinishedPulling="2026-05-21 14:56:15.726243761 +0000 UTC m=+124.212140977" observedRunningTime="2026-05-21 14:56:16.531562783 +0000 UTC m=+125.017460019" watchObservedRunningTime="2026-05-21 14:56:16.532390746 +0000 UTC m=+125.018287981" May 21 14:56:18.394297 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.394261 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:56:18.396165 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.396148 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.398419 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.398384 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:56:18.398545 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.398443 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:56:18.398545 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.398457 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:56:18.398545 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.398497 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqqvq\"" May 21 14:56:18.403979 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.403953 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:56:18.414283 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.414255 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:56:18.532059 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532059 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532286 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532286 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532286 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zl4b\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532286 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.532407 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.532312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633332 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633290 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633345 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633420 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633454 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633475 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633778 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.633491 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zl4b\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.633778 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:18.633608 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:18.633778 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:18.633627 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:18.633778 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:18.633705 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:19.133683632 +0000 UTC m=+127.619580858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:18.634283 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.634253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.634409 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.634378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.634566 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.634544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.635830 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.635809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.635902 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.635876 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.643841 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.643819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:18.643925 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:18.643880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zl4b\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:19.137103 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:19.137068 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:19.137301 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:19.137188 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:19.137301 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:19.137199 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:19.137301 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:19.137263 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:20.137245562 +0000 UTC m=+128.623142775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:19.258250 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:19.258221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4vdtv_4cf5132e-4137-42aa-a050-a855d65ef1b4/dns-node-resolver/0.log" May 21 14:56:20.056981 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.056954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6krr_b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4/node-ca/0.log" May 21 14:56:20.146292 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.146255 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:20.146480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:20.146406 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:20.146480 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:20.146426 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:20.146571 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:20.146497 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:22.146479258 +0000 UTC m=+130.632376471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:20.443591 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.443514 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2"] May 21 14:56:20.446206 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.446191 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.448560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.448533 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 14:56:20.448680 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.448557 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 14:56:20.448680 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.448611 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dwzgr\"" May 21 14:56:20.448680 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.448557 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 14:56:20.448680 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.448557 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 14:56:20.454313 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.454292 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2"] May 21 14:56:20.549299 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.549260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsl5\" (UniqueName: \"kubernetes.io/projected/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-kube-api-access-cxsl5\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.549480 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.549305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-config\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.549480 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.549349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.650628 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.650591 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsl5\" (UniqueName: \"kubernetes.io/projected/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-kube-api-access-cxsl5\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.650831 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.650666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-config\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.650831 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.650703 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.651362 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.651335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-config\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.652981 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.652961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.660277 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.660251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsl5\" (UniqueName: \"kubernetes.io/projected/aaddbcb0-8f06-4bfa-a0a1-107710b07cda-kube-api-access-cxsl5\") pod \"kube-storage-version-migrator-operator-565644f49-8c8f2\" (UID: \"aaddbcb0-8f06-4bfa-a0a1-107710b07cda\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.755664 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.755560 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" May 21 14:56:20.884071 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:20.884038 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2"] May 21 14:56:20.889525 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:20.889494 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaddbcb0_8f06_4bfa_a0a1_107710b07cda.slice/crio-8249b4e2a38313809aeef2a3e6b382f86fc703f3a6704a68d6e1a3df64895b54 WatchSource:0}: Error finding container 8249b4e2a38313809aeef2a3e6b382f86fc703f3a6704a68d6e1a3df64895b54: Status 404 returned error can't find the container with id 8249b4e2a38313809aeef2a3e6b382f86fc703f3a6704a68d6e1a3df64895b54 May 21 14:56:21.523816 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:21.523779 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" event={"ID":"aaddbcb0-8f06-4bfa-a0a1-107710b07cda","Type":"ContainerStarted","Data":"8249b4e2a38313809aeef2a3e6b382f86fc703f3a6704a68d6e1a3df64895b54"} May 21 14:56:21.859095 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:21.859060 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:56:21.859272 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:21.859220 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:56:21.859333 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:21.859297 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs podName:330a2b07-ef9d-48b1-9dc1-813b0a41b54b nodeName:}" failed. No retries permitted until 2026-05-21 14:58:23.859280314 +0000 UTC m=+252.345177531 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs") pod "network-metrics-daemon-5656t" (UID: "330a2b07-ef9d-48b1-9dc1-813b0a41b54b") : secret "metrics-daemon-secret" not found May 21 14:56:22.160718 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.160628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:22.160877 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:22.160757 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:22.160877 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:22.160771 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:22.160877 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:22.160834 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:26.160817548 +0000 UTC m=+134.646714766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:22.482460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.482376 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd"] May 21 14:56:22.484287 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.484272 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.487545 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.487525 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 14:56:22.487688 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.487546 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 14:56:22.487688 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.487620 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lvj2g\"" May 21 14:56:22.487937 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.487921 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 14:56:22.488163 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.488150 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 14:56:22.495712 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.495689 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd"] May 21 14:56:22.664848 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.664809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04df39-757d-4f70-afb9-b32073f89a41-serving-cert\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.665255 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.664859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85bk\" (UniqueName: \"kubernetes.io/projected/df04df39-757d-4f70-afb9-b32073f89a41-kube-api-access-m85bk\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.665255 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.664952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04df39-757d-4f70-afb9-b32073f89a41-config\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.766266 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.766171 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04df39-757d-4f70-afb9-b32073f89a41-serving-cert\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.766266 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.766226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m85bk\" (UniqueName: \"kubernetes.io/projected/df04df39-757d-4f70-afb9-b32073f89a41-kube-api-access-m85bk\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.766549 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.766284 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04df39-757d-4f70-afb9-b32073f89a41-config\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.767109 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.767074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df04df39-757d-4f70-afb9-b32073f89a41-config\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.768809 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.768785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df04df39-757d-4f70-afb9-b32073f89a41-serving-cert\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.774747 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.774701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85bk\" (UniqueName: \"kubernetes.io/projected/df04df39-757d-4f70-afb9-b32073f89a41-kube-api-access-m85bk\") pod \"service-ca-operator-57b5b68b8-85znd\" (UID: \"df04df39-757d-4f70-afb9-b32073f89a41\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:22.792592 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:22.792567 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" May 21 14:56:23.246025 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.245974 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd"] May 21 14:56:23.249648 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:23.249618 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf04df39_757d_4f70_afb9_b32073f89a41.slice/crio-b7cf348e8682f114f3aee937547cc05d3a8e5982a0968f3d37f259e079d228d1 WatchSource:0}: Error finding container b7cf348e8682f114f3aee937547cc05d3a8e5982a0968f3d37f259e079d228d1: Status 404 returned error can't find the container with id b7cf348e8682f114f3aee937547cc05d3a8e5982a0968f3d37f259e079d228d1 May 21 14:56:23.527697 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.527600 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" event={"ID":"df04df39-757d-4f70-afb9-b32073f89a41","Type":"ContainerStarted","Data":"b7cf348e8682f114f3aee937547cc05d3a8e5982a0968f3d37f259e079d228d1"} May 21 14:56:23.528864 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.528839 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" event={"ID":"aaddbcb0-8f06-4bfa-a0a1-107710b07cda","Type":"ContainerStarted","Data":"d51f3e7958aa843207eae182b0e59fe0df539edb246a6ca5e48280b51171481a"} May 21 14:56:23.545160 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.545102 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" podStartSLOduration=1.29043436 podStartE2EDuration="3.545083738s" podCreationTimestamp="2026-05-21 14:56:20 +0000 UTC" firstStartedPulling="2026-05-21 14:56:20.891407685 +0000 UTC m=+129.377304911" lastFinishedPulling="2026-05-21 14:56:23.14605706 +0000 UTC m=+131.631954289" observedRunningTime="2026-05-21 14:56:23.544535651 +0000 UTC m=+132.030432887" watchObservedRunningTime="2026-05-21 14:56:23.545083738 +0000 UTC m=+132.030980976" May 21 14:56:23.678022 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.677972 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57"] May 21 14:56:23.680100 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.680080 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" May 21 14:56:23.682882 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.682863 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hp99s\"" May 21 14:56:23.691175 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.691149 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57"] May 21 14:56:23.774739 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.774701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrr8\" (UniqueName: \"kubernetes.io/projected/2d53db5a-f88c-420c-b11a-05536d092369-kube-api-access-pqrr8\") pod \"network-check-source-7f44b6dd87-lqm57\" (UID: \"2d53db5a-f88c-420c-b11a-05536d092369\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" May 21 14:56:23.876168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.876133 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrr8\" (UniqueName: \"kubernetes.io/projected/2d53db5a-f88c-420c-b11a-05536d092369-kube-api-access-pqrr8\") pod \"network-check-source-7f44b6dd87-lqm57\" (UID: \"2d53db5a-f88c-420c-b11a-05536d092369\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" May 21 14:56:23.885174 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.885141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrr8\" (UniqueName: \"kubernetes.io/projected/2d53db5a-f88c-420c-b11a-05536d092369-kube-api-access-pqrr8\") pod \"network-check-source-7f44b6dd87-lqm57\" (UID: \"2d53db5a-f88c-420c-b11a-05536d092369\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" May 21 14:56:23.988282 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:23.988242 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" May 21 14:56:24.123783 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:24.123747 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57"] May 21 14:56:24.127703 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:24.127640 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d53db5a_f88c_420c_b11a_05536d092369.slice/crio-5166db72c89fc452aa233a80fbe7e19a242e23bf9a9ed1a9758189800477710f WatchSource:0}: Error finding container 5166db72c89fc452aa233a80fbe7e19a242e23bf9a9ed1a9758189800477710f: Status 404 returned error can't find the container with id 5166db72c89fc452aa233a80fbe7e19a242e23bf9a9ed1a9758189800477710f May 21 14:56:24.532376 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:24.532342 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" event={"ID":"2d53db5a-f88c-420c-b11a-05536d092369","Type":"ContainerStarted","Data":"d0a8286ae622a050803f5a79d66a8e66094f0d3516514a704c5d40407e949ae8"} May 21 14:56:24.532376 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:24.532378 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" event={"ID":"2d53db5a-f88c-420c-b11a-05536d092369","Type":"ContainerStarted","Data":"5166db72c89fc452aa233a80fbe7e19a242e23bf9a9ed1a9758189800477710f"} May 21 14:56:24.548826 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:24.548775 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-lqm57" podStartSLOduration=1.548754741 podStartE2EDuration="1.548754741s" podCreationTimestamp="2026-05-21 14:56:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:56:24.548235808 +0000 UTC m=+133.034133043" watchObservedRunningTime="2026-05-21 14:56:24.548754741 +0000 UTC m=+133.034651978" May 21 14:56:25.536989 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:25.536897 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" event={"ID":"df04df39-757d-4f70-afb9-b32073f89a41","Type":"ContainerStarted","Data":"081202cee494c20d542479ee695bbbcfa5b35966893e33f0a66520af2b25860c"} May 21 14:56:25.553605 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:25.553556 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" podStartSLOduration=1.5202565529999998 podStartE2EDuration="3.553540404s" podCreationTimestamp="2026-05-21 14:56:22 +0000 UTC" firstStartedPulling="2026-05-21 14:56:23.25200133 +0000 UTC m=+131.737898543" lastFinishedPulling="2026-05-21 14:56:25.285285156 +0000 UTC m=+133.771182394" observedRunningTime="2026-05-21 14:56:25.552292164 +0000 UTC m=+134.038189400" watchObservedRunningTime="2026-05-21 14:56:25.553540404 +0000 UTC m=+134.039437641" May 21 14:56:26.195796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:26.195753 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:26.195984 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:26.195917 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:26.195984 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:26.195929 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:26.195984 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:26.195982 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:34.195968002 +0000 UTC m=+142.681865215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:34.257392 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:34.257349 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:34.257793 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:34.257491 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:56:34.257793 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:34.257506 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d5b9458f-r8xq8: secret "image-registry-tls" not found May 21 14:56:34.257793 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:34.257574 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls podName:e5c6714b-0b86-4228-ba82-ebe54e0b9005 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:50.257553213 +0000 UTC m=+158.743450431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls") pod "image-registry-58d5b9458f-r8xq8" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005") : secret "image-registry-tls" not found May 21 14:56:48.401515 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:48.401455 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t6mcs" podUID="97a6b757-cbe5-45c7-ac93-0164412e7d2d" May 21 14:56:48.417210 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:48.417170 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-s47zt" podUID="c803a29c-0f7f-49ca-8b2f-561c51600efa" May 21 14:56:48.589100 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:48.589070 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6mcs" May 21 14:56:50.116167 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:56:50.116120 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5656t" podUID="330a2b07-ef9d-48b1-9dc1-813b0a41b54b" May 21 14:56:50.280623 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:50.280586 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:50.283069 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:50.283036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"image-registry-58d5b9458f-r8xq8\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:50.505296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:50.505205 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:50.633615 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:50.633582 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:56:50.636955 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:50.636924 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c6714b_0b86_4228_ba82_ebe54e0b9005.slice/crio-328dce93cc78d445c69228f172e9ef1868899334a81d3f23e54801e9f64add5a WatchSource:0}: Error finding container 328dce93cc78d445c69228f172e9ef1868899334a81d3f23e54801e9f64add5a: Status 404 returned error can't find the container with id 328dce93cc78d445c69228f172e9ef1868899334a81d3f23e54801e9f64add5a May 21 14:56:51.108719 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.108454 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5x84l"] May 21 14:56:51.113588 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.113564 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.118461 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.118435 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4hfq\"" May 21 14:56:51.119086 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.119061 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:56:51.119396 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.119375 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:56:51.127026 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.126984 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5x84l"] May 21 14:56:51.165629 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.165593 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:56:51.186918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.186886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnrh\" (UniqueName: \"kubernetes.io/projected/37890673-7007-44c3-8c5a-b2487148b339-kube-api-access-jjnrh\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.187106 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.186925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37890673-7007-44c3-8c5a-b2487148b339-data-volume\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.187106 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.187024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37890673-7007-44c3-8c5a-b2487148b339-crio-socket\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.187106 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.187081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37890673-7007-44c3-8c5a-b2487148b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.187226 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.187130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37890673-7007-44c3-8c5a-b2487148b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288503 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288466 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37890673-7007-44c3-8c5a-b2487148b339-crio-socket\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288503 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288510 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37890673-7007-44c3-8c5a-b2487148b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288765 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37890673-7007-44c3-8c5a-b2487148b339-crio-socket\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288765 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288642 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37890673-7007-44c3-8c5a-b2487148b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288765 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288729 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnrh\" (UniqueName: \"kubernetes.io/projected/37890673-7007-44c3-8c5a-b2487148b339-kube-api-access-jjnrh\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.288918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.288769 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37890673-7007-44c3-8c5a-b2487148b339-data-volume\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.289099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.289080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37890673-7007-44c3-8c5a-b2487148b339-data-volume\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.289193 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.289177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37890673-7007-44c3-8c5a-b2487148b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.290829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.290811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37890673-7007-44c3-8c5a-b2487148b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.297544 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.297524 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5448b59c7f-pchlj"] May 21 14:56:51.300576 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.300562 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.308608 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.308589 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnrh\" (UniqueName: \"kubernetes.io/projected/37890673-7007-44c3-8c5a-b2487148b339-kube-api-access-jjnrh\") pod \"insights-runtime-extractor-5x84l\" (UID: \"37890673-7007-44c3-8c5a-b2487148b339\") " pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.313068 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.313046 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5448b59c7f-pchlj"] May 21 14:56:51.389796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-trusted-ca\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.389796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-installation-pull-secrets\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.389796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-image-registry-private-configuration\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.389796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-bound-sa-token\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.390098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-ca-trust-extracted\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.390098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-certificates\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.390098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fkp\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-kube-api-access-24fkp\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.390098 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.389916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-tls\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.424426 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.424390 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5x84l" May 21 14:56:51.491102 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-ca-trust-extracted\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491102 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-certificates\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491134 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24fkp\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-kube-api-access-24fkp\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491158 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-tls\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491205 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-trusted-ca\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491233 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-installation-pull-secrets\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491253 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-image-registry-private-configuration\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491355 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-bound-sa-token\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.491650 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.491542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-ca-trust-extracted\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.492280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.492254 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-certificates\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.492612 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.492574 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-trusted-ca\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.493819 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.493796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-registry-tls\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.493925 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.493888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-installation-pull-secrets\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.493996 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.493978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-image-registry-private-configuration\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.500132 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.500109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-bound-sa-token\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.500438 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.500419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fkp\" (UniqueName: \"kubernetes.io/projected/0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4-kube-api-access-24fkp\") pod \"image-registry-5448b59c7f-pchlj\" (UID: \"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4\") " pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.556988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.556953 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5x84l"] May 21 14:56:51.560292 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:51.560259 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37890673_7007_44c3_8c5a_b2487148b339.slice/crio-4c0f9bf102fc45c4ee7b15b0616ca194ac6ad51430a94420340d9c35ea3a0805 WatchSource:0}: Error finding container 4c0f9bf102fc45c4ee7b15b0616ca194ac6ad51430a94420340d9c35ea3a0805: Status 404 returned error can't find the container with id 4c0f9bf102fc45c4ee7b15b0616ca194ac6ad51430a94420340d9c35ea3a0805 May 21 14:56:51.602163 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.602119 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5x84l" event={"ID":"37890673-7007-44c3-8c5a-b2487148b339","Type":"ContainerStarted","Data":"4c0f9bf102fc45c4ee7b15b0616ca194ac6ad51430a94420340d9c35ea3a0805"} May 21 14:56:51.603416 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.603386 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" event={"ID":"e5c6714b-0b86-4228-ba82-ebe54e0b9005","Type":"ContainerStarted","Data":"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1"} May 21 14:56:51.603416 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.603419 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" event={"ID":"e5c6714b-0b86-4228-ba82-ebe54e0b9005","Type":"ContainerStarted","Data":"328dce93cc78d445c69228f172e9ef1868899334a81d3f23e54801e9f64add5a"} May 21 14:56:51.603607 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.603553 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:56:51.608975 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.608956 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:51.623326 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.623280 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" podStartSLOduration=33.62326535 podStartE2EDuration="33.62326535s" podCreationTimestamp="2026-05-21 14:56:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:56:51.622294007 +0000 UTC m=+160.108191265" watchObservedRunningTime="2026-05-21 14:56:51.62326535 +0000 UTC m=+160.109162585" May 21 14:56:51.736953 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:51.736920 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5448b59c7f-pchlj"] May 21 14:56:51.741314 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:51.741278 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d076dd6_0f87_4a05_8887_b3d2e1ff4fa4.slice/crio-b38a821d18c5efbe405b6d59222f9ebdf756790aa78f8831a909e0fe968ec273 WatchSource:0}: Error finding container b38a821d18c5efbe405b6d59222f9ebdf756790aa78f8831a909e0fe968ec273: Status 404 returned error can't find the container with id b38a821d18c5efbe405b6d59222f9ebdf756790aa78f8831a909e0fe968ec273 May 21 14:56:52.609159 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:52.609117 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5x84l" event={"ID":"37890673-7007-44c3-8c5a-b2487148b339","Type":"ContainerStarted","Data":"3fb563aa5745ea8dd7064fd713a99396a60275ca9592c6c53d49e877a2242b8f"} May 21 14:56:52.609159 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:52.609164 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5x84l" event={"ID":"37890673-7007-44c3-8c5a-b2487148b339","Type":"ContainerStarted","Data":"38468fcb6aa6c31eb0153338d94c740e25c6924913f38ea52817f8b07e75ff55"} May 21 14:56:52.610332 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:52.610307 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" event={"ID":"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4","Type":"ContainerStarted","Data":"ba45ca55b62466d78e172ec59e7c173ccb37c9531c187998db21cf69f20f979c"} May 21 14:56:52.610428 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:52.610341 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" event={"ID":"0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4","Type":"ContainerStarted","Data":"b38a821d18c5efbe405b6d59222f9ebdf756790aa78f8831a909e0fe968ec273"} May 21 14:56:52.634084 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:52.633992 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" podStartSLOduration=1.633979707 podStartE2EDuration="1.633979707s" podCreationTimestamp="2026-05-21 14:56:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:56:52.633285172 +0000 UTC m=+161.119182416" watchObservedRunningTime="2026-05-21 14:56:52.633979707 +0000 UTC m=+161.119876976" May 21 14:56:53.403950 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.403911 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:56:53.404166 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.404056 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:56:53.406692 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.406662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a6b757-cbe5-45c7-ac93-0164412e7d2d-metrics-tls\") pod \"dns-default-t6mcs\" (UID: \"97a6b757-cbe5-45c7-ac93-0164412e7d2d\") " pod="openshift-dns/dns-default-t6mcs" May 21 14:56:53.406813 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.406798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c803a29c-0f7f-49ca-8b2f-561c51600efa-cert\") pod \"ingress-canary-s47zt\" (UID: \"c803a29c-0f7f-49ca-8b2f-561c51600efa\") " pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:56:53.613244 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.613207 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:56:53.692021 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.691988 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jrvl8\"" May 21 14:56:53.700707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.700683 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6mcs" May 21 14:56:53.843328 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:53.843294 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t6mcs"] May 21 14:56:53.848267 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:53.848238 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a6b757_cbe5_45c7_ac93_0164412e7d2d.slice/crio-088530194cab465f94118e9a356c2885699ffb1d57d851b8a65a624ed3c172f7 WatchSource:0}: Error finding container 088530194cab465f94118e9a356c2885699ffb1d57d851b8a65a624ed3c172f7: Status 404 returned error can't find the container with id 088530194cab465f94118e9a356c2885699ffb1d57d851b8a65a624ed3c172f7 May 21 14:56:54.617557 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:54.617519 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5x84l" event={"ID":"37890673-7007-44c3-8c5a-b2487148b339","Type":"ContainerStarted","Data":"d2c30f705a35871383dacf502b02cfed36f09265b7a193787bbcd9279ced924a"} May 21 14:56:54.618656 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:54.618632 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6mcs" event={"ID":"97a6b757-cbe5-45c7-ac93-0164412e7d2d","Type":"ContainerStarted","Data":"088530194cab465f94118e9a356c2885699ffb1d57d851b8a65a624ed3c172f7"} May 21 14:56:54.636707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:54.636647 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5x84l" podStartSLOduration=1.6316031899999999 podStartE2EDuration="3.636632654s" podCreationTimestamp="2026-05-21 14:56:51 +0000 UTC" firstStartedPulling="2026-05-21 14:56:51.613423127 +0000 UTC m=+160.099320342" lastFinishedPulling="2026-05-21 14:56:53.618452588 +0000 UTC m=+162.104349806" observedRunningTime="2026-05-21 14:56:54.635138789 +0000 UTC m=+163.121036036" watchObservedRunningTime="2026-05-21 14:56:54.636632654 +0000 UTC m=+163.122529889" May 21 14:56:55.622783 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:55.622744 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6mcs" event={"ID":"97a6b757-cbe5-45c7-ac93-0164412e7d2d","Type":"ContainerStarted","Data":"a6d1ec0026fe7137feadce65125c6564d9e0b043007a392b198ffb8326792f66"} May 21 14:56:55.622783 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:55.622788 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6mcs" event={"ID":"97a6b757-cbe5-45c7-ac93-0164412e7d2d","Type":"ContainerStarted","Data":"d991067e876662b90911c79f7f9337e0561c7a7f0ac1a76765dfbd8defbbb8be"} May 21 14:56:55.623235 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:55.622927 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t6mcs" May 21 14:56:55.641210 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:55.641162 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t6mcs" podStartSLOduration=129.237097613 podStartE2EDuration="2m10.641146231s" podCreationTimestamp="2026-05-21 14:54:45 +0000 UTC" firstStartedPulling="2026-05-21 14:56:53.850051375 +0000 UTC m=+162.335948589" lastFinishedPulling="2026-05-21 14:56:55.254099982 +0000 UTC m=+163.739997207" observedRunningTime="2026-05-21 14:56:55.640381772 +0000 UTC m=+164.126279007" watchObservedRunningTime="2026-05-21 14:56:55.641146231 +0000 UTC m=+164.127043515" May 21 14:56:58.134070 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.134024 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ks26k"] May 21 14:56:58.136898 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.136882 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.139924 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.139896 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 14:56:58.140091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.139924 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-65db4\"" May 21 14:56:58.140091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.139975 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 14:56:58.140091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.140002 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:56:58.140091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.140068 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:56:58.140091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.140080 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:56:58.149886 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.149867 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ks26k"] May 21 14:56:58.177264 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.177233 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hwm7d"] May 21 14:56:58.180168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.180147 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.182548 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.182525 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:56:58.182673 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.182582 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2chdt\"" May 21 14:56:58.182821 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.182808 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:56:58.183146 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.183131 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:56:58.246546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-root\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-wtmp\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-tls\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhds4\" (UniqueName: \"kubernetes.io/projected/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-kube-api-access-nhds4\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.246764 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-textfile\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-metrics-client-ca\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsmkk\" (UniqueName: \"kubernetes.io/projected/4a99c05b-9def-4b2c-8fa6-1fab200efe78-kube-api-access-fsmkk\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.247099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.246977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-sys\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.347666 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347629 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-textfile\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.347842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.347842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-metrics-client-ca\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.347842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347792 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsmkk\" (UniqueName: \"kubernetes.io/projected/4a99c05b-9def-4b2c-8fa6-1fab200efe78-kube-api-access-fsmkk\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.347842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347847 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-sys\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347897 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-root\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-wtmp\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348030 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-tls\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348063 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhds4\" (UniqueName: \"kubernetes.io/projected/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-kube-api-access-nhds4\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.348099 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348090 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.348419 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.348419 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-wtmp\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348419 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-textfile\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348419 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348246 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-root\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a99c05b-9def-4b2c-8fa6-1fab200efe78-metrics-client-ca\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.347995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a99c05b-9def-4b2c-8fa6-1fab200efe78-sys\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.348601 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.348588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.350691 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.350661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-tls\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.350691 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.350679 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a99c05b-9def-4b2c-8fa6-1fab200efe78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.350866 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.350683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.350866 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.350744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.356645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.356600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsmkk\" (UniqueName: \"kubernetes.io/projected/4a99c05b-9def-4b2c-8fa6-1fab200efe78-kube-api-access-fsmkk\") pod \"node-exporter-hwm7d\" (UID: \"4a99c05b-9def-4b2c-8fa6-1fab200efe78\") " pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.357042 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.356986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhds4\" (UniqueName: \"kubernetes.io/projected/370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629-kube-api-access-nhds4\") pod \"openshift-state-metrics-9c959559f-ks26k\" (UID: \"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.446494 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.446400 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" May 21 14:56:58.489091 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.489050 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hwm7d" May 21 14:56:58.499025 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:58.498970 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a99c05b_9def_4b2c_8fa6_1fab200efe78.slice/crio-fbce3cca2f0562df95a55520d12c6fc44aeb654b16f5016346e6e0e02f01ff46 WatchSource:0}: Error finding container fbce3cca2f0562df95a55520d12c6fc44aeb654b16f5016346e6e0e02f01ff46: Status 404 returned error can't find the container with id fbce3cca2f0562df95a55520d12c6fc44aeb654b16f5016346e6e0e02f01ff46 May 21 14:56:58.578210 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.578167 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ks26k"] May 21 14:56:58.582623 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:56:58.582594 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370b6eb7_2c0f_4ca9_84b3_3d4d0f5da629.slice/crio-b93981910817366d809f399a412af03cdefe60cbc05f1f2e6a3721d288150426 WatchSource:0}: Error finding container b93981910817366d809f399a412af03cdefe60cbc05f1f2e6a3721d288150426: Status 404 returned error can't find the container with id b93981910817366d809f399a412af03cdefe60cbc05f1f2e6a3721d288150426 May 21 14:56:58.631918 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.631890 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" event={"ID":"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629","Type":"ContainerStarted","Data":"b93981910817366d809f399a412af03cdefe60cbc05f1f2e6a3721d288150426"} May 21 14:56:58.632800 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:58.632777 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwm7d" event={"ID":"4a99c05b-9def-4b2c-8fa6-1fab200efe78","Type":"ContainerStarted","Data":"fbce3cca2f0562df95a55520d12c6fc44aeb654b16f5016346e6e0e02f01ff46"} May 21 14:56:59.641815 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:59.641721 2559 generic.go:358] "Generic (PLEG): container finished" podID="4a99c05b-9def-4b2c-8fa6-1fab200efe78" containerID="d59e9cffc2cf44aedb2aba005e1f0665d43fc92bd9655d8eea4946a05bf103d8" exitCode=0 May 21 14:56:59.642296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:59.641811 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwm7d" event={"ID":"4a99c05b-9def-4b2c-8fa6-1fab200efe78","Type":"ContainerDied","Data":"d59e9cffc2cf44aedb2aba005e1f0665d43fc92bd9655d8eea4946a05bf103d8"} May 21 14:56:59.643827 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:59.643782 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" event={"ID":"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629","Type":"ContainerStarted","Data":"8bf21171ac392f00ac9ade865a63d26ae8fe08e6e6b03464a26f5a6877c1f83e"} May 21 14:56:59.643827 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:56:59.643821 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" event={"ID":"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629","Type":"ContainerStarted","Data":"7865220d53d5ebb08ca1ac1418f7e4b77252d3bafa5865a2bcf31cfa53292839"} May 21 14:57:00.647963 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:00.647920 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwm7d" event={"ID":"4a99c05b-9def-4b2c-8fa6-1fab200efe78","Type":"ContainerStarted","Data":"2ad9b5289000bc2da99da3fddfd262b27f574f5f5fab6e1b7e21e814216df6a9"} May 21 14:57:00.647963 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:00.647969 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwm7d" event={"ID":"4a99c05b-9def-4b2c-8fa6-1fab200efe78","Type":"ContainerStarted","Data":"497353c7e8e1ce92acaf4ec99372e3122d35083ade8be42993758176e6709b7c"} May 21 14:57:00.649738 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:00.649715 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" event={"ID":"370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629","Type":"ContainerStarted","Data":"30201de9a8d4dcf9796fea41f8123d5a7e98a1c9dec5e14f7967c9be2a3fd2b6"} May 21 14:57:00.682072 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:00.681995 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hwm7d" podStartSLOduration=1.7993655450000001 podStartE2EDuration="2.681979705s" podCreationTimestamp="2026-05-21 14:56:58 +0000 UTC" firstStartedPulling="2026-05-21 14:56:58.500745739 +0000 UTC m=+166.986642955" lastFinishedPulling="2026-05-21 14:56:59.383359902 +0000 UTC m=+167.869257115" observedRunningTime="2026-05-21 14:57:00.680662613 +0000 UTC m=+169.166559848" watchObservedRunningTime="2026-05-21 14:57:00.681979705 +0000 UTC m=+169.167876943" May 21 14:57:00.711869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:00.711817 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ks26k" podStartSLOduration=1.399455262 podStartE2EDuration="2.711804623s" podCreationTimestamp="2026-05-21 14:56:58 +0000 UTC" firstStartedPulling="2026-05-21 14:56:58.711295177 +0000 UTC m=+167.197192390" lastFinishedPulling="2026-05-21 14:57:00.023644523 +0000 UTC m=+168.509541751" observedRunningTime="2026-05-21 14:57:00.710622338 +0000 UTC m=+169.196519573" watchObservedRunningTime="2026-05-21 14:57:00.711804623 +0000 UTC m=+169.197701857" May 21 14:57:01.094874 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.094837 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:57:01.184546 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.184501 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d8657446d-26n8k"] May 21 14:57:01.188233 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.188208 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.191662 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.191637 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 14:57:01.192267 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192245 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 14:57:01.192372 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192251 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 14:57:01.192372 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192334 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-44sf8rj1gu7qu\"" May 21 14:57:01.192613 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192598 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 14:57:01.192672 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192645 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 14:57:01.192884 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.192871 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gxplj\"" May 21 14:57:01.205969 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.205941 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8657446d-26n8k"] May 21 14:57:01.274394 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274394 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116d1c55-92d4-4a64-8fda-51a3722dd841-metrics-client-ca\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274667 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274667 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274667 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-grpc-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274667 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sl6h\" (UniqueName: \"kubernetes.io/projected/116d1c55-92d4-4a64-8fda-51a3722dd841-kube-api-access-5sl6h\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274667 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.274841 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.274684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.375921 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375823 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sl6h\" (UniqueName: \"kubernetes.io/projected/116d1c55-92d4-4a64-8fda-51a3722dd841-kube-api-access-5sl6h\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.375921 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375870 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.375921 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375893 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.375921 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375915 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.376281 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375934 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116d1c55-92d4-4a64-8fda-51a3722dd841-metrics-client-ca\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.376281 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.375957 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.376281 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.376070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.376281 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.376107 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-grpc-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.376784 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.376728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/116d1c55-92d4-4a64-8fda-51a3722dd841-metrics-client-ca\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.378780 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.378751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.378890 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.378783 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.379388 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.379363 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.379473 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.379455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-grpc-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.379550 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.379530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.379591 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.379557 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/116d1c55-92d4-4a64-8fda-51a3722dd841-secret-thanos-querier-tls\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.387450 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.387430 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sl6h\" (UniqueName: \"kubernetes.io/projected/116d1c55-92d4-4a64-8fda-51a3722dd841-kube-api-access-5sl6h\") pod \"thanos-querier-5d8657446d-26n8k\" (UID: \"116d1c55-92d4-4a64-8fda-51a3722dd841\") " pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.497495 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.497442 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:01.630699 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.630601 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8657446d-26n8k"] May 21 14:57:01.634802 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:01.634774 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116d1c55_92d4_4a64_8fda_51a3722dd841.slice/crio-1c8f9e4c435b55832a76dbbce413e01b05f149550b45932838186a0c2ca432ba WatchSource:0}: Error finding container 1c8f9e4c435b55832a76dbbce413e01b05f149550b45932838186a0c2ca432ba: Status 404 returned error can't find the container with id 1c8f9e4c435b55832a76dbbce413e01b05f149550b45932838186a0c2ca432ba May 21 14:57:01.653698 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:01.653660 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"1c8f9e4c435b55832a76dbbce413e01b05f149550b45932838186a0c2ca432ba"} May 21 14:57:02.459702 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.459663 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-788949c7-cj68q"] May 21 14:57:02.463252 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.463225 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.465613 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.465585 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 14:57:02.465761 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.465711 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 14:57:02.465761 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.465715 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x7btk\"" May 21 14:57:02.465848 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.465813 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 14:57:02.466308 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.466288 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 14:57:02.466395 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.466326 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-app5380m7nel5\"" May 21 14:57:02.471517 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.471493 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-788949c7-cj68q"] May 21 14:57:02.586463 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-client-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586463 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrsx\" (UniqueName: \"kubernetes.io/projected/e770d37d-80fe-410f-86c5-59b98c9e80c5-kube-api-access-lqrsx\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586661 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-metrics-server-audit-profiles\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586661 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-client-certs\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586661 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-tls\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e770d37d-80fe-410f-86c5-59b98c9e80c5-audit-log\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.586869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.586759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688195 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-tls\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688195 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e770d37d-80fe-410f-86c5-59b98c9e80c5-audit-log\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688417 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-client-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688446 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrsx\" (UniqueName: \"kubernetes.io/projected/e770d37d-80fe-410f-86c5-59b98c9e80c5-kube-api-access-lqrsx\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688472 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-metrics-server-audit-profiles\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688536 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-client-certs\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.688716 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.688593 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e770d37d-80fe-410f-86c5-59b98c9e80c5-audit-log\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.689104 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.689078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.689673 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.689647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e770d37d-80fe-410f-86c5-59b98c9e80c5-metrics-server-audit-profiles\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.691193 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.691167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-tls\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.691294 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.691252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-secret-metrics-server-client-certs\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.691364 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.691343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e770d37d-80fe-410f-86c5-59b98c9e80c5-client-ca-bundle\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.697622 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.697597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrsx\" (UniqueName: \"kubernetes.io/projected/e770d37d-80fe-410f-86c5-59b98c9e80c5-kube-api-access-lqrsx\") pod \"metrics-server-788949c7-cj68q\" (UID: \"e770d37d-80fe-410f-86c5-59b98c9e80c5\") " pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.775503 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.775409 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:02.919045 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:02.918992 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-788949c7-cj68q"] May 21 14:57:02.921977 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:02.921937 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode770d37d_80fe_410f_86c5_59b98c9e80c5.slice/crio-c570839f3b779de669cf46756e67feaed1786025e7a22ad7ecce8d9e5db41ee4 WatchSource:0}: Error finding container c570839f3b779de669cf46756e67feaed1786025e7a22ad7ecce8d9e5db41ee4: Status 404 returned error can't find the container with id c570839f3b779de669cf46756e67feaed1786025e7a22ad7ecce8d9e5db41ee4 May 21 14:57:03.660896 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:03.660870 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"a238e471e850d0710755ed81d93fba49cf9c258cc32664aa0f66702cb101ec51"} May 21 14:57:03.661024 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:03.660907 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"1d3937ca9a82640a19dfc59ed6fba96fb5ca4296acc2095f01d6f8815ccd3c21"} May 21 14:57:03.661870 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:03.661850 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-788949c7-cj68q" event={"ID":"e770d37d-80fe-410f-86c5-59b98c9e80c5","Type":"ContainerStarted","Data":"c570839f3b779de669cf46756e67feaed1786025e7a22ad7ecce8d9e5db41ee4"} May 21 14:57:04.095304 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.095269 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:57:04.097571 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.097549 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j2cxw\"" May 21 14:57:04.106424 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.106403 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s47zt" May 21 14:57:04.271849 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.271675 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s47zt"] May 21 14:57:04.387127 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:04.387042 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc803a29c_0f7f_49ca_8b2f_561c51600efa.slice/crio-be8bfd33c35fc627d78f8c9fbde8077f34b81eef65f50a411eb94a71f2c130b1 WatchSource:0}: Error finding container be8bfd33c35fc627d78f8c9fbde8077f34b81eef65f50a411eb94a71f2c130b1: Status 404 returned error can't find the container with id be8bfd33c35fc627d78f8c9fbde8077f34b81eef65f50a411eb94a71f2c130b1 May 21 14:57:04.666043 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.665941 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s47zt" event={"ID":"c803a29c-0f7f-49ca-8b2f-561c51600efa","Type":"ContainerStarted","Data":"be8bfd33c35fc627d78f8c9fbde8077f34b81eef65f50a411eb94a71f2c130b1"} May 21 14:57:04.667927 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:04.667900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"90f52b1a357253967336fdf61b32caf97625093c73662e34081567874cdebb0a"} May 21 14:57:05.627485 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.627456 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t6mcs" May 21 14:57:05.675078 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.675046 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"3cfbe4cb8d90c65b570cc6aa4315ea46d39ffd3736996cfe984db9ce3d246f15"} May 21 14:57:05.675262 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.675098 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"caedf8ebd9c1b3269916594c28342f69e70d4490c8107cb8749484a1cbdc6546"} May 21 14:57:05.675262 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.675114 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" event={"ID":"116d1c55-92d4-4a64-8fda-51a3722dd841","Type":"ContainerStarted","Data":"b5667eb9e64e11218fbd9a09b973b0169b3602fd67c913289143010cd0628eb7"} May 21 14:57:05.675262 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.675244 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:05.676652 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.676623 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-788949c7-cj68q" event={"ID":"e770d37d-80fe-410f-86c5-59b98c9e80c5","Type":"ContainerStarted","Data":"bf9fef38beb5d9a6fcf2c31a0c7510cfa42218590cedd6e547a09640c59bfdf1"} May 21 14:57:05.697088 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.697032 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" podStartSLOduration=1.528786873 podStartE2EDuration="4.697000618s" podCreationTimestamp="2026-05-21 14:57:01 +0000 UTC" firstStartedPulling="2026-05-21 14:57:01.63660469 +0000 UTC m=+170.122501904" lastFinishedPulling="2026-05-21 14:57:04.804818435 +0000 UTC m=+173.290715649" observedRunningTime="2026-05-21 14:57:05.695468678 +0000 UTC m=+174.181365938" watchObservedRunningTime="2026-05-21 14:57:05.697000618 +0000 UTC m=+174.182897853" May 21 14:57:05.712293 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:05.712236 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-788949c7-cj68q" podStartSLOduration=1.828472265 podStartE2EDuration="3.712222382s" podCreationTimestamp="2026-05-21 14:57:02 +0000 UTC" firstStartedPulling="2026-05-21 14:57:02.923723991 +0000 UTC m=+171.409621207" lastFinishedPulling="2026-05-21 14:57:04.807474111 +0000 UTC m=+173.293371324" observedRunningTime="2026-05-21 14:57:05.711656302 +0000 UTC m=+174.197553536" watchObservedRunningTime="2026-05-21 14:57:05.712222382 +0000 UTC m=+174.198119616" May 21 14:57:06.680739 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:06.680650 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s47zt" event={"ID":"c803a29c-0f7f-49ca-8b2f-561c51600efa","Type":"ContainerStarted","Data":"b5288813c5aed4ce0cd001916a1a425be0505f12a862f9bb93b61a3f6e7d5f49"} May 21 14:57:06.699075 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:06.699001 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s47zt" podStartSLOduration=139.663991193 podStartE2EDuration="2m21.698981591s" podCreationTimestamp="2026-05-21 14:54:45 +0000 UTC" firstStartedPulling="2026-05-21 14:57:04.388942885 +0000 UTC m=+172.874840098" lastFinishedPulling="2026-05-21 14:57:06.423933268 +0000 UTC m=+174.909830496" observedRunningTime="2026-05-21 14:57:06.697555103 +0000 UTC m=+175.183452352" watchObservedRunningTime="2026-05-21 14:57:06.698981591 +0000 UTC m=+175.184878828" May 21 14:57:10.373074 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.373036 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-qtglm"] May 21 14:57:10.376365 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.376347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:10.378560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.378537 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 14:57:10.378645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.378604 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qpchx\"" May 21 14:57:10.378645 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.378630 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 14:57:10.391234 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.391214 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-qtglm"] May 21 14:57:10.458280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.458241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmw4m\" (UniqueName: \"kubernetes.io/projected/15839093-71c0-47e1-a6fb-c77e01bc70f7-kube-api-access-fmw4m\") pod \"downloads-57bd96b888-qtglm\" (UID: \"15839093-71c0-47e1-a6fb-c77e01bc70f7\") " pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:10.559144 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.559108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmw4m\" (UniqueName: \"kubernetes.io/projected/15839093-71c0-47e1-a6fb-c77e01bc70f7-kube-api-access-fmw4m\") pod \"downloads-57bd96b888-qtglm\" (UID: \"15839093-71c0-47e1-a6fb-c77e01bc70f7\") " pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:10.567507 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.567473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmw4m\" (UniqueName: \"kubernetes.io/projected/15839093-71c0-47e1-a6fb-c77e01bc70f7-kube-api-access-fmw4m\") pod \"downloads-57bd96b888-qtglm\" (UID: \"15839093-71c0-47e1-a6fb-c77e01bc70f7\") " pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:10.684761 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.684662 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:10.817532 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:10.817501 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-qtglm"] May 21 14:57:10.820397 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:10.820366 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15839093_71c0_47e1_a6fb_c77e01bc70f7.slice/crio-52399b05700225952ad2e4f4de9fa90d6c7bc0cde645ea2f763bb103864953a2 WatchSource:0}: Error finding container 52399b05700225952ad2e4f4de9fa90d6c7bc0cde645ea2f763bb103864953a2: Status 404 returned error can't find the container with id 52399b05700225952ad2e4f4de9fa90d6c7bc0cde645ea2f763bb103864953a2 May 21 14:57:11.614194 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:11.614145 2559 patch_prober.go:28] interesting pod/image-registry-5448b59c7f-pchlj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 14:57:11.614632 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:11.614210 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" podUID="0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:57:11.687389 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:11.687362 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d8657446d-26n8k" May 21 14:57:11.694213 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:11.694174 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-qtglm" event={"ID":"15839093-71c0-47e1-a6fb-c77e01bc70f7","Type":"ContainerStarted","Data":"52399b05700225952ad2e4f4de9fa90d6c7bc0cde645ea2f763bb103864953a2"} May 21 14:57:12.617732 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:12.617699 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:57:14.623920 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:14.623889 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5448b59c7f-pchlj" May 21 14:57:17.628504 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:17.628458 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" podUID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" containerName="registry" containerID="cri-o://dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1" gracePeriod=30 May 21 14:57:17.886627 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:17.886557 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:57:18.026280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026237 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026291 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026324 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026379 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026424 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zl4b\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026473 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026499 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026530 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") pod \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\" (UID: \"e5c6714b-0b86-4228-ba82-ebe54e0b9005\") " May 21 14:57:18.026803 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026761 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:57:18.026859 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.026801 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:57:18.029338 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.029302 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:57:18.029466 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.029340 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b" (OuterVolumeSpecName: "kube-api-access-7zl4b") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "kube-api-access-7zl4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:57:18.029466 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.029358 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:57:18.029466 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.029368 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:57:18.029625 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.029476 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:57:18.038350 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.038311 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e5c6714b-0b86-4228-ba82-ebe54e0b9005" (UID: "e5c6714b-0b86-4228-ba82-ebe54e0b9005"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:57:18.127246 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127213 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-bound-sa-token\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127246 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127241 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5c6714b-0b86-4228-ba82-ebe54e0b9005-ca-trust-extracted\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127246 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127252 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-tls\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127262 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-image-registry-private-configuration\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127272 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-registry-certificates\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127285 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5c6714b-0b86-4228-ba82-ebe54e0b9005-trusted-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127294 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5c6714b-0b86-4228-ba82-ebe54e0b9005-installation-pull-secrets\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.127474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.127303 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zl4b\" (UniqueName: \"kubernetes.io/projected/e5c6714b-0b86-4228-ba82-ebe54e0b9005-kube-api-access-7zl4b\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:57:18.718316 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.718271 2559 generic.go:358] "Generic (PLEG): container finished" podID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" containerID="dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1" exitCode=0 May 21 14:57:18.718773 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.718336 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" May 21 14:57:18.718773 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.718357 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" event={"ID":"e5c6714b-0b86-4228-ba82-ebe54e0b9005","Type":"ContainerDied","Data":"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1"} May 21 14:57:18.718773 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.718407 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d5b9458f-r8xq8" event={"ID":"e5c6714b-0b86-4228-ba82-ebe54e0b9005","Type":"ContainerDied","Data":"328dce93cc78d445c69228f172e9ef1868899334a81d3f23e54801e9f64add5a"} May 21 14:57:18.718773 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.718434 2559 scope.go:117] "RemoveContainer" containerID="dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1" May 21 14:57:18.728128 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.728090 2559 scope.go:117] "RemoveContainer" containerID="dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1" May 21 14:57:18.728454 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:57:18.728434 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1\": container with ID starting with dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1 not found: ID does not exist" containerID="dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1" May 21 14:57:18.728540 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.728467 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1"} err="failed to get container status \"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1\": rpc error: code = NotFound desc = could not find container \"dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1\": container with ID starting with dd7b83ce307ed64caf3a4150b314f84b6a6cc5f4d2503b94ed54429d82a7cbd1 not found: ID does not exist" May 21 14:57:18.743470 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.743430 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:57:18.751547 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:18.751518 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58d5b9458f-r8xq8"] May 21 14:57:20.099495 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:20.099462 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" path="/var/lib/kubelet/pods/e5c6714b-0b86-4228-ba82-ebe54e0b9005/volumes" May 21 14:57:22.357262 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.357229 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:57:22.357786 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.357599 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" containerName="registry" May 21 14:57:22.357786 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.357615 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" containerName="registry" May 21 14:57:22.357786 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.357702 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5c6714b-0b86-4228-ba82-ebe54e0b9005" containerName="registry" May 21 14:57:22.360931 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.360909 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.365445 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.365418 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 14:57:22.365869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.365851 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 14:57:22.366248 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.366232 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 14:57:22.366460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.366446 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dpdn\"" May 21 14:57:22.366799 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.366509 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 14:57:22.366799 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.366599 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 14:57:22.368462 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.368570 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.368570 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.368570 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzhbc\" (UniqueName: \"kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.368727 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.368727 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.368636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.372742 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.372720 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:57:22.469650 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469620 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.469829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469664 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.469829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469738 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.469829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469766 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.469829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.470075 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.469830 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzhbc\" (UniqueName: \"kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.470474 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.470445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.470605 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.470445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.470605 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.470499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.472569 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.472546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.472690 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.472666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.479239 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.479216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzhbc\" (UniqueName: \"kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc\") pod \"console-784dcfc5cd-7sbnx\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.674114 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.673956 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:22.776113 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.776075 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:22.776280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:22.776128 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:26.191722 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.190520 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:57:26.203814 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:26.203781 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf712afa7_d89b_4b4d_a63d_cc2348013aa7.slice/crio-3cd2e5f6a16268c5094b5f19ded5be5a7bbdee8940bf8662263a19c210b1b5b9 WatchSource:0}: Error finding container 3cd2e5f6a16268c5094b5f19ded5be5a7bbdee8940bf8662263a19c210b1b5b9: Status 404 returned error can't find the container with id 3cd2e5f6a16268c5094b5f19ded5be5a7bbdee8940bf8662263a19c210b1b5b9 May 21 14:57:26.747450 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.747413 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-qtglm" event={"ID":"15839093-71c0-47e1-a6fb-c77e01bc70f7","Type":"ContainerStarted","Data":"7157a7afa2fd90a75b0b6fc75fd23124aa757f72db12148e0370e5a163c21b47"} May 21 14:57:26.747660 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.747609 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:26.748855 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.748821 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dcfc5cd-7sbnx" event={"ID":"f712afa7-d89b-4b4d-a63d-cc2348013aa7","Type":"ContainerStarted","Data":"3cd2e5f6a16268c5094b5f19ded5be5a7bbdee8940bf8662263a19c210b1b5b9"} May 21 14:57:26.750513 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.750489 2559 generic.go:358] "Generic (PLEG): container finished" podID="03cee9f1-cd81-4fe0-a09e-62b362165285" containerID="eecf235f596668d00d69b04d52c9bb864796b35d580cf45304ce55f52e1450d0" exitCode=0 May 21 14:57:26.750623 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.750542 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" event={"ID":"03cee9f1-cd81-4fe0-a09e-62b362165285","Type":"ContainerDied","Data":"eecf235f596668d00d69b04d52c9bb864796b35d580cf45304ce55f52e1450d0"} May 21 14:57:26.750885 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.750871 2559 scope.go:117] "RemoveContainer" containerID="eecf235f596668d00d69b04d52c9bb864796b35d580cf45304ce55f52e1450d0" May 21 14:57:26.761521 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.761492 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-qtglm" May 21 14:57:26.771495 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:26.771452 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-qtglm" podStartSLOduration=1.439057877 podStartE2EDuration="16.771436822s" podCreationTimestamp="2026-05-21 14:57:10 +0000 UTC" firstStartedPulling="2026-05-21 14:57:10.822405778 +0000 UTC m=+179.308302993" lastFinishedPulling="2026-05-21 14:57:26.154784719 +0000 UTC m=+194.640681938" observedRunningTime="2026-05-21 14:57:26.769097495 +0000 UTC m=+195.254994735" watchObservedRunningTime="2026-05-21 14:57:26.771436822 +0000 UTC m=+195.257334059" May 21 14:57:27.762000 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:27.761319 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-vpvlx" event={"ID":"03cee9f1-cd81-4fe0-a09e-62b362165285","Type":"ContainerStarted","Data":"c9bf63a3594d3435f599a682748e91543bc7b5e653a926ffb43ef28f946f909c"} May 21 14:57:28.293351 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:28.293316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6mcs_97a6b757-cbe5-45c7-ac93-0164412e7d2d/dns/0.log" May 21 14:57:28.494467 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:28.494283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6mcs_97a6b757-cbe5-45c7-ac93-0164412e7d2d/kube-rbac-proxy/0.log" May 21 14:57:28.693278 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:28.693196 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4vdtv_4cf5132e-4137-42aa-a050-a855d65ef1b4/dns-node-resolver/0.log" May 21 14:57:29.493833 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:29.493789 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s47zt_c803a29c-0f7f-49ca-8b2f-561c51600efa/serve-healthcheck-canary/0.log" May 21 14:57:30.772987 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:30.772944 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dcfc5cd-7sbnx" event={"ID":"f712afa7-d89b-4b4d-a63d-cc2348013aa7","Type":"ContainerStarted","Data":"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39"} May 21 14:57:32.655832 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.655775 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-784dcfc5cd-7sbnx" podStartSLOduration=6.672258579 podStartE2EDuration="10.655759294s" podCreationTimestamp="2026-05-21 14:57:22 +0000 UTC" firstStartedPulling="2026-05-21 14:57:26.20615797 +0000 UTC m=+194.692055183" lastFinishedPulling="2026-05-21 14:57:30.189658675 +0000 UTC m=+198.675555898" observedRunningTime="2026-05-21 14:57:30.793932544 +0000 UTC m=+199.279829780" watchObservedRunningTime="2026-05-21 14:57:32.655759294 +0000 UTC m=+201.141656529" May 21 14:57:32.657021 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.656986 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:57:32.679057 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.678999 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:57:32.679240 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.679074 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:32.679240 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.679111 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:32.679240 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.679179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.680639 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.680596 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:32.687704 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.687655 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 14:57:32.767557 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj7f\" (UniqueName: \"kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767741 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767741 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767741 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767902 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767902 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.767902 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.767874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.783803 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.783773 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:57:32.869024 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.868975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.869208 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869128 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.869280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.869660 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869631 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870076 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870076 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869825 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870076 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869918 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj7f\" (UniqueName: \"kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870076 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.869957 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870394 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.870369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.870872 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.870842 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.871150 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.871127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.871934 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.871913 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.872895 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.872875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.878484 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.878458 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj7f\" (UniqueName: \"kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f\") pod \"console-76d96f579f-2qvl4\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:32.991347 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:32.991256 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:33.149372 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:33.149339 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:57:33.153073 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:57:33.153044 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade7f848_8778_4b83_9cab_f62ceaf8f6ee.slice/crio-09175849061ff274ad6dbc6f5d3daedbf537fb87a0839ce1c0fce02da4cf2e06 WatchSource:0}: Error finding container 09175849061ff274ad6dbc6f5d3daedbf537fb87a0839ce1c0fce02da4cf2e06: Status 404 returned error can't find the container with id 09175849061ff274ad6dbc6f5d3daedbf537fb87a0839ce1c0fce02da4cf2e06 May 21 14:57:33.783478 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:33.783431 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d96f579f-2qvl4" event={"ID":"ade7f848-8778-4b83-9cab-f62ceaf8f6ee","Type":"ContainerStarted","Data":"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef"} May 21 14:57:33.783478 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:33.783482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d96f579f-2qvl4" event={"ID":"ade7f848-8778-4b83-9cab-f62ceaf8f6ee","Type":"ContainerStarted","Data":"09175849061ff274ad6dbc6f5d3daedbf537fb87a0839ce1c0fce02da4cf2e06"} May 21 14:57:33.802616 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:33.802567 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76d96f579f-2qvl4" podStartSLOduration=1.802550103 podStartE2EDuration="1.802550103s" podCreationTimestamp="2026-05-21 14:57:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:57:33.801590715 +0000 UTC m=+202.287487996" watchObservedRunningTime="2026-05-21 14:57:33.802550103 +0000 UTC m=+202.288447339" May 21 14:57:42.781134 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:42.781102 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:42.785626 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:42.785600 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-788949c7-cj68q" May 21 14:57:42.991702 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:42.991665 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:42.991702 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:42.991710 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:42.996455 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:42.996427 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:43.815690 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:43.815662 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:57:43.859366 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:43.859320 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:57:49.831941 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:49.831909 2559 generic.go:358] "Generic (PLEG): container finished" podID="aaddbcb0-8f06-4bfa-a0a1-107710b07cda" containerID="d51f3e7958aa843207eae182b0e59fe0df539edb246a6ca5e48280b51171481a" exitCode=0 May 21 14:57:49.832375 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:49.831964 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" event={"ID":"aaddbcb0-8f06-4bfa-a0a1-107710b07cda","Type":"ContainerDied","Data":"d51f3e7958aa843207eae182b0e59fe0df539edb246a6ca5e48280b51171481a"} May 21 14:57:49.832375 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:49.832336 2559 scope.go:117] "RemoveContainer" containerID="d51f3e7958aa843207eae182b0e59fe0df539edb246a6ca5e48280b51171481a" May 21 14:57:50.836085 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:50.836046 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8c8f2" event={"ID":"aaddbcb0-8f06-4bfa-a0a1-107710b07cda","Type":"ContainerStarted","Data":"ece5da55a1881df8a8e4d94ade5da2e4e11b07a7a0a0af7b1bfe0a4245e74fe7"} May 21 14:57:55.850745 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:55.850708 2559 generic.go:358] "Generic (PLEG): container finished" podID="df04df39-757d-4f70-afb9-b32073f89a41" containerID="081202cee494c20d542479ee695bbbcfa5b35966893e33f0a66520af2b25860c" exitCode=0 May 21 14:57:55.851290 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:55.850786 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" event={"ID":"df04df39-757d-4f70-afb9-b32073f89a41","Type":"ContainerDied","Data":"081202cee494c20d542479ee695bbbcfa5b35966893e33f0a66520af2b25860c"} May 21 14:57:55.851290 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:55.851249 2559 scope.go:117] "RemoveContainer" containerID="081202cee494c20d542479ee695bbbcfa5b35966893e33f0a66520af2b25860c" May 21 14:57:56.855141 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:57:56.855105 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-85znd" event={"ID":"df04df39-757d-4f70-afb9-b32073f89a41","Type":"ContainerStarted","Data":"e8da9c711c86220597cb81961130e7144d7390b4b4ce63bab537e886a8067570"} May 21 14:58:08.878953 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:08.878881 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-784dcfc5cd-7sbnx" podUID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" containerName="console" containerID="cri-o://ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39" gracePeriod=15 May 21 14:58:09.147174 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.147153 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784dcfc5cd-7sbnx_f712afa7-d89b-4b4d-a63d-cc2348013aa7/console/0.log" May 21 14:58:09.147302 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.147223 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:58:09.206574 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206531 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.206777 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206620 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.206777 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206717 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzhbc\" (UniqueName: \"kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.206777 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206753 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.207056 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206782 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.207056 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.206815 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config\") pod \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\" (UID: \"f712afa7-d89b-4b4d-a63d-cc2348013aa7\") " May 21 14:58:09.207056 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.207005 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config" (OuterVolumeSpecName: "console-config") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:09.207056 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.207038 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:09.207245 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.207222 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca" (OuterVolumeSpecName: "service-ca") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:09.209027 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.208977 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:58:09.209137 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.209002 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:58:09.209137 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.209046 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc" (OuterVolumeSpecName: "kube-api-access-nzhbc") pod "f712afa7-d89b-4b4d-a63d-cc2348013aa7" (UID: "f712afa7-d89b-4b4d-a63d-cc2348013aa7"). InnerVolumeSpecName "kube-api-access-nzhbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:58:09.307603 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307561 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-oauth-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.307603 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307595 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-oauth-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.307603 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307606 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.307837 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307616 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzhbc\" (UniqueName: \"kubernetes.io/projected/f712afa7-d89b-4b4d-a63d-cc2348013aa7-kube-api-access-nzhbc\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.307837 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307627 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f712afa7-d89b-4b4d-a63d-cc2348013aa7-console-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.307837 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.307635 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f712afa7-d89b-4b4d-a63d-cc2348013aa7-service-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:09.895031 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.894986 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784dcfc5cd-7sbnx_f712afa7-d89b-4b4d-a63d-cc2348013aa7/console/0.log" May 21 14:58:09.895417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.895055 2559 generic.go:358] "Generic (PLEG): container finished" podID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" containerID="ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39" exitCode=2 May 21 14:58:09.895417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.895129 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784dcfc5cd-7sbnx" May 21 14:58:09.895417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.895146 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dcfc5cd-7sbnx" event={"ID":"f712afa7-d89b-4b4d-a63d-cc2348013aa7","Type":"ContainerDied","Data":"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39"} May 21 14:58:09.895417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.895188 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784dcfc5cd-7sbnx" event={"ID":"f712afa7-d89b-4b4d-a63d-cc2348013aa7","Type":"ContainerDied","Data":"3cd2e5f6a16268c5094b5f19ded5be5a7bbdee8940bf8662263a19c210b1b5b9"} May 21 14:58:09.895417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.895207 2559 scope.go:117] "RemoveContainer" containerID="ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39" May 21 14:58:09.903465 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.903447 2559 scope.go:117] "RemoveContainer" containerID="ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39" May 21 14:58:09.903718 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:58:09.903702 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39\": container with ID starting with ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39 not found: ID does not exist" containerID="ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39" May 21 14:58:09.903771 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.903726 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39"} err="failed to get container status \"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39\": rpc error: code = NotFound desc = could not find container \"ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39\": container with ID starting with ebce07826dc9a1a6d41f31c5bd7cd8ebde4dad5f31716c0186d38405a0c47c39 not found: ID does not exist" May 21 14:58:09.917729 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.917692 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:58:09.922386 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:09.922359 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784dcfc5cd-7sbnx"] May 21 14:58:10.098672 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:10.098638 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" path="/var/lib/kubelet/pods/f712afa7-d89b-4b4d-a63d-cc2348013aa7/volumes" May 21 14:58:17.748951 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.748910 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 14:58:17.749388 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.749213 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" containerName="console" May 21 14:58:17.749388 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.749226 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" containerName="console" May 21 14:58:17.749388 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.749285 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f712afa7-d89b-4b4d-a63d-cc2348013aa7" containerName="console" May 21 14:58:17.752280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.752261 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.761439 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.761415 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 14:58:17.777862 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.777825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778055 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.777878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778055 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.777964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778055 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.778005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvzn\" (UniqueName: \"kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778218 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.778139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778218 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.778176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.778308 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.778215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878625 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878581 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878804 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878804 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878667 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878804 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878823 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878873 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.878988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.878901 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvzn\" (UniqueName: \"kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.879442 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.879420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.879551 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.879411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.879551 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.879519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.879640 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.879617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.881755 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.881724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.881846 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.881816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:17.887696 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:17.887671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvzn\" (UniqueName: \"kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn\") pod \"console-84b4586896-xwhqg\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:18.061491 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:18.061450 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:18.196979 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:18.196951 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 14:58:18.200810 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:58:18.200778 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05ceada_c926_4f28_9cd4_17e0694dc4eb.slice/crio-5f66867d2f907d0eb5d6013db6292f43a56d34264ee9d9abcd022dd9e5626eee WatchSource:0}: Error finding container 5f66867d2f907d0eb5d6013db6292f43a56d34264ee9d9abcd022dd9e5626eee: Status 404 returned error can't find the container with id 5f66867d2f907d0eb5d6013db6292f43a56d34264ee9d9abcd022dd9e5626eee May 21 14:58:18.925235 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:18.925198 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b4586896-xwhqg" event={"ID":"d05ceada-c926-4f28-9cd4-17e0694dc4eb","Type":"ContainerStarted","Data":"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8"} May 21 14:58:18.925235 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:18.925234 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b4586896-xwhqg" event={"ID":"d05ceada-c926-4f28-9cd4-17e0694dc4eb","Type":"ContainerStarted","Data":"5f66867d2f907d0eb5d6013db6292f43a56d34264ee9d9abcd022dd9e5626eee"} May 21 14:58:18.946829 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:18.946779 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84b4586896-xwhqg" podStartSLOduration=1.9467640510000002 podStartE2EDuration="1.946764051s" podCreationTimestamp="2026-05-21 14:58:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:58:18.945758776 +0000 UTC m=+247.431656012" watchObservedRunningTime="2026-05-21 14:58:18.946764051 +0000 UTC m=+247.432661285" May 21 14:58:23.936095 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:23.936041 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:58:23.938447 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:23.938421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/330a2b07-ef9d-48b1-9dc1-813b0a41b54b-metrics-certs\") pod \"network-metrics-daemon-5656t\" (UID: \"330a2b07-ef9d-48b1-9dc1-813b0a41b54b\") " pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:58:24.198367 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:24.198283 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl42\"" May 21 14:58:24.206684 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:24.206658 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5656t" May 21 14:58:24.338447 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:24.338383 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5656t"] May 21 14:58:24.342893 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:58:24.342855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330a2b07_ef9d_48b1_9dc1_813b0a41b54b.slice/crio-e0e325e9d3581ddd84b6d583214788f31438a39a611a6578bb2cc8e23d28ba3f WatchSource:0}: Error finding container e0e325e9d3581ddd84b6d583214788f31438a39a611a6578bb2cc8e23d28ba3f: Status 404 returned error can't find the container with id e0e325e9d3581ddd84b6d583214788f31438a39a611a6578bb2cc8e23d28ba3f May 21 14:58:24.943323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:24.943280 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5656t" event={"ID":"330a2b07-ef9d-48b1-9dc1-813b0a41b54b","Type":"ContainerStarted","Data":"e0e325e9d3581ddd84b6d583214788f31438a39a611a6578bb2cc8e23d28ba3f"} May 21 14:58:25.947733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:25.947693 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5656t" event={"ID":"330a2b07-ef9d-48b1-9dc1-813b0a41b54b","Type":"ContainerStarted","Data":"08ecb26d52f32b6d32b12026bd3b3e06528d7a9b242ef510d44aab033a4454f3"} May 21 14:58:25.947733 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:25.947730 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5656t" event={"ID":"330a2b07-ef9d-48b1-9dc1-813b0a41b54b","Type":"ContainerStarted","Data":"696eb8bbcf4ba0c888f975073f22c51811b0016132b76825b5b98e0df4e34fd9"} May 21 14:58:25.965889 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:25.965843 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5656t" podStartSLOduration=253.077395375 podStartE2EDuration="4m13.965827457s" podCreationTimestamp="2026-05-21 14:54:12 +0000 UTC" firstStartedPulling="2026-05-21 14:58:24.344819379 +0000 UTC m=+252.830716592" lastFinishedPulling="2026-05-21 14:58:25.233251461 +0000 UTC m=+253.719148674" observedRunningTime="2026-05-21 14:58:25.964186525 +0000 UTC m=+254.450083767" watchObservedRunningTime="2026-05-21 14:58:25.965827457 +0000 UTC m=+254.451724693" May 21 14:58:28.062460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:28.062418 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:28.062460 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:28.062457 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:28.067621 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:28.067597 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:28.959589 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:28.959565 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b4586896-xwhqg" May 21 14:58:29.004877 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:29.004839 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:58:54.026619 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.026560 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76d96f579f-2qvl4" podUID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" containerName="console" containerID="cri-o://28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef" gracePeriod=15 May 21 14:58:54.273356 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.273334 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76d96f579f-2qvl4_ade7f848-8778-4b83-9cab-f62ceaf8f6ee/console/0.log" May 21 14:58:54.273477 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.273397 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:58:54.296135 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296104 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296156 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbj7f\" (UniqueName: \"kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296188 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296221 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296246 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296323 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296304 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296587 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296363 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert\") pod \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\" (UID: \"ade7f848-8778-4b83-9cab-f62ceaf8f6ee\") " May 21 14:58:54.296701 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.296670 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:54.297409 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.297157 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:54.297409 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.297197 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:54.297632 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.297543 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config" (OuterVolumeSpecName: "console-config") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:58:54.299462 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.299228 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:58:54.299713 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.299683 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:58:54.299790 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.299748 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f" (OuterVolumeSpecName: "kube-api-access-nbj7f") pod "ade7f848-8778-4b83-9cab-f62ceaf8f6ee" (UID: "ade7f848-8778-4b83-9cab-f62ceaf8f6ee"). InnerVolumeSpecName "kube-api-access-nbj7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:58:54.397356 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397313 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-trusted-ca-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397356 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397347 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397356 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397357 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-service-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397356 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397366 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbj7f\" (UniqueName: \"kubernetes.io/projected/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-kube-api-access-nbj7f\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397619 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397376 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397619 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397386 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-console-oauth-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:54.397619 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:54.397394 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade7f848-8778-4b83-9cab-f62ceaf8f6ee-oauth-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:58:55.034129 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034096 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76d96f579f-2qvl4_ade7f848-8778-4b83-9cab-f62ceaf8f6ee/console/0.log" May 21 14:58:55.034611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034143 2559 generic.go:358] "Generic (PLEG): container finished" podID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" containerID="28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef" exitCode=2 May 21 14:58:55.034611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034186 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d96f579f-2qvl4" event={"ID":"ade7f848-8778-4b83-9cab-f62ceaf8f6ee","Type":"ContainerDied","Data":"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef"} May 21 14:58:55.034611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034218 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d96f579f-2qvl4" event={"ID":"ade7f848-8778-4b83-9cab-f62ceaf8f6ee","Type":"ContainerDied","Data":"09175849061ff274ad6dbc6f5d3daedbf537fb87a0839ce1c0fce02da4cf2e06"} May 21 14:58:55.034611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034219 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d96f579f-2qvl4" May 21 14:58:55.034611 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.034284 2559 scope.go:117] "RemoveContainer" containerID="28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef" May 21 14:58:55.042515 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.042496 2559 scope.go:117] "RemoveContainer" containerID="28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef" May 21 14:58:55.042801 ip-10-0-143-65 kubenswrapper[2559]: E0521 14:58:55.042783 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef\": container with ID starting with 28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef not found: ID does not exist" containerID="28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef" May 21 14:58:55.042853 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.042810 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef"} err="failed to get container status \"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef\": rpc error: code = NotFound desc = could not find container \"28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef\": container with ID starting with 28845408f9fc1a3e32e484af88038bed34c0226598642d96f0eee89d63aed2ef not found: ID does not exist" May 21 14:58:55.055472 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.055445 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:58:55.060260 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:55.060236 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76d96f579f-2qvl4"] May 21 14:58:56.098952 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:58:56.098914 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" path="/var/lib/kubelet/pods/ade7f848-8778-4b83-9cab-f62ceaf8f6ee/volumes" May 21 14:59:03.943475 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.943432 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z"] May 21 14:59:03.943936 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.943835 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" containerName="console" May 21 14:59:03.943936 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.943854 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" containerName="console" May 21 14:59:03.944103 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.943940 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ade7f848-8778-4b83-9cab-f62ceaf8f6ee" containerName="console" May 21 14:59:03.946236 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.946214 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:03.948600 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.948580 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 14:59:03.948707 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.948580 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 14:59:03.949346 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.949331 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 14:59:03.957658 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.957622 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z"] May 21 14:59:03.971755 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.971714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgbqt\" (UniqueName: \"kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:03.971928 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.971794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:03.971928 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:03.971884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.072772 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.072734 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.072975 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.072779 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgbqt\" (UniqueName: \"kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.072975 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.072811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.073178 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.073158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.073240 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.073182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.081477 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.081449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgbqt\" (UniqueName: \"kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.255809 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.255719 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:04.397709 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:04.397675 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z"] May 21 14:59:04.400939 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:04.400912 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a3bab4_7713_4cc7_93d2_cfc9ff12f66d.slice/crio-a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2 WatchSource:0}: Error finding container a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2: Status 404 returned error can't find the container with id a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2 May 21 14:59:05.066685 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:05.066642 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerStarted","Data":"a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2"} May 21 14:59:10.083630 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:10.083593 2559 generic.go:358] "Generic (PLEG): container finished" podID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerID="227629a3f0c6779bdfe3581ea3150bcd598b8fea2b52bd3277e8e9d765ed18f4" exitCode=0 May 21 14:59:10.084044 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:10.083684 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerDied","Data":"227629a3f0c6779bdfe3581ea3150bcd598b8fea2b52bd3277e8e9d765ed18f4"} May 21 14:59:12.019767 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:12.019738 2559 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:59:13.095481 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:13.095448 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerStarted","Data":"4ed4ea04f6c6898bd452aa26af26ab32381a862a4fcfa3521054d7cf0a2c142c"} May 21 14:59:14.099935 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:14.099895 2559 generic.go:358] "Generic (PLEG): container finished" podID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerID="4ed4ea04f6c6898bd452aa26af26ab32381a862a4fcfa3521054d7cf0a2c142c" exitCode=0 May 21 14:59:14.100440 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:14.099932 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerDied","Data":"4ed4ea04f6c6898bd452aa26af26ab32381a862a4fcfa3521054d7cf0a2c142c"} May 21 14:59:14.101097 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:14.101083 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:59:21.122770 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:21.122734 2559 generic.go:358] "Generic (PLEG): container finished" podID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerID="08d7bd42e3c20e7ea5416aa63e288f57b6a8c0ebeecca7fa5b87bcd2818485b6" exitCode=0 May 21 14:59:21.123187 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:21.122780 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerDied","Data":"08d7bd42e3c20e7ea5416aa63e288f57b6a8c0ebeecca7fa5b87bcd2818485b6"} May 21 14:59:22.199468 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.199431 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg"] May 21 14:59:22.202514 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.202486 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.206555 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.206532 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 14:59:22.206669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.206597 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 14:59:22.207428 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.207403 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 14:59:22.207560 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.207491 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 14:59:22.214063 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.214039 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg"] May 21 14:59:22.251189 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.251166 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:22.336214 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336182 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgbqt\" (UniqueName: \"kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt\") pod \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " May 21 14:59:22.336427 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336246 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle\") pod \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " May 21 14:59:22.336427 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336287 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util\") pod \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\" (UID: \"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d\") " May 21 14:59:22.336427 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22rp\" (UniqueName: \"kubernetes.io/projected/36fe725d-5511-4dd8-b5ec-bdc4727708ab-kube-api-access-j22rp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.336596 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36fe725d-5511-4dd8-b5ec-bdc4727708ab-tmp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.336596 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36fe725d-5511-4dd8-b5ec-bdc4727708ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.337046 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.336993 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle" (OuterVolumeSpecName: "bundle") pod "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" (UID: "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:22.338509 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.338485 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt" (OuterVolumeSpecName: "kube-api-access-qgbqt") pod "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" (UID: "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d"). InnerVolumeSpecName "kube-api-access-qgbqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:59:22.340150 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.340124 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util" (OuterVolumeSpecName: "util") pod "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" (UID: "28a3bab4-7713-4cc7-93d2-cfc9ff12f66d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:22.437118 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.436997 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36fe725d-5511-4dd8-b5ec-bdc4727708ab-tmp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.437425 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437160 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36fe725d-5511-4dd8-b5ec-bdc4727708ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.437425 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437216 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j22rp\" (UniqueName: \"kubernetes.io/projected/36fe725d-5511-4dd8-b5ec-bdc4727708ab-kube-api-access-j22rp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.437425 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437313 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:22.437425 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437329 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgbqt\" (UniqueName: \"kubernetes.io/projected/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-kube-api-access-qgbqt\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:22.437425 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437346 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a3bab4-7713-4cc7-93d2-cfc9ff12f66d-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:22.437619 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.437475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36fe725d-5511-4dd8-b5ec-bdc4727708ab-tmp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.439669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.439644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36fe725d-5511-4dd8-b5ec-bdc4727708ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.445840 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.445815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22rp\" (UniqueName: \"kubernetes.io/projected/36fe725d-5511-4dd8-b5ec-bdc4727708ab-kube-api-access-j22rp\") pod \"klusterlet-addon-workmgr-85b47674f7-5nbmg\" (UID: \"36fe725d-5511-4dd8-b5ec-bdc4727708ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.514570 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.514523 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:22.643466 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:22.643428 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg"] May 21 14:59:22.646214 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:22.646191 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fe725d_5511_4dd8_b5ec_bdc4727708ab.slice/crio-527a43dd5ca545c3966fd9768423cb8240c052615c5b9c8caf1efccf415e2ba3 WatchSource:0}: Error finding container 527a43dd5ca545c3966fd9768423cb8240c052615c5b9c8caf1efccf415e2ba3: Status 404 returned error can't find the container with id 527a43dd5ca545c3966fd9768423cb8240c052615c5b9c8caf1efccf415e2ba3 May 21 14:59:23.128202 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:23.128163 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" event={"ID":"36fe725d-5511-4dd8-b5ec-bdc4727708ab","Type":"ContainerStarted","Data":"527a43dd5ca545c3966fd9768423cb8240c052615c5b9c8caf1efccf415e2ba3"} May 21 14:59:23.129869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:23.129842 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" event={"ID":"28a3bab4-7713-4cc7-93d2-cfc9ff12f66d","Type":"ContainerDied","Data":"a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2"} May 21 14:59:23.129982 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:23.129875 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7565756e2121bd74965815bf4d7212f42ebb91ce26355efcb412c3b81b000d2" May 21 14:59:23.129982 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:23.129849 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4w65z" May 21 14:59:27.133796 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.133754 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98"] May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134189 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="util" May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134208 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="util" May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134232 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="extract" May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134242 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="extract" May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134252 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="pull" May 21 14:59:27.134312 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134260 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="pull" May 21 14:59:27.134593 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.134335 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="28a3bab4-7713-4cc7-93d2-cfc9ff12f66d" containerName="extract" May 21 14:59:27.136456 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.136437 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.138809 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.138779 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 14:59:27.138933 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.138826 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 14:59:27.139032 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.138979 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gdp9h\"" May 21 14:59:27.142623 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.142596 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" event={"ID":"36fe725d-5511-4dd8-b5ec-bdc4727708ab","Type":"ContainerStarted","Data":"01915a9e2cb1fb2725beaa790ce4b4062ae107be0b0f87bd4d8766314a934605"} May 21 14:59:27.142808 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.142791 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:27.144581 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.144564 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" May 21 14:59:27.151719 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.151695 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98"] May 21 14:59:27.187518 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.187474 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85b47674f7-5nbmg" podStartSLOduration=0.863761389 podStartE2EDuration="5.187460793s" podCreationTimestamp="2026-05-21 14:59:22 +0000 UTC" firstStartedPulling="2026-05-21 14:59:22.64807327 +0000 UTC m=+311.133970482" lastFinishedPulling="2026-05-21 14:59:26.971772673 +0000 UTC m=+315.457669886" observedRunningTime="2026-05-21 14:59:27.185998147 +0000 UTC m=+315.671895382" watchObservedRunningTime="2026-05-21 14:59:27.187460793 +0000 UTC m=+315.673358072" May 21 14:59:27.284344 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.284308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c22p\" (UniqueName: \"kubernetes.io/projected/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-kube-api-access-9c22p\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.284509 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.284385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.384752 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.384717 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c22p\" (UniqueName: \"kubernetes.io/projected/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-kube-api-access-9c22p\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.384957 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.384772 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.385154 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.385136 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.398280 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.398253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c22p\" (UniqueName: \"kubernetes.io/projected/f07bc6f1-5a27-451d-8ac0-7e28ac2b6155-kube-api-access-9c22p\") pod \"cert-manager-operator-controller-manager-54b9655956-r5h98\" (UID: \"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.445857 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.445826 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" May 21 14:59:27.587290 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:27.587213 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98"] May 21 14:59:27.590849 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:27.590803 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07bc6f1_5a27_451d_8ac0_7e28ac2b6155.slice/crio-969d0044aff82de0f9652d8208591838d45b1bc3fccd3ac242fea6ec9566037a WatchSource:0}: Error finding container 969d0044aff82de0f9652d8208591838d45b1bc3fccd3ac242fea6ec9566037a: Status 404 returned error can't find the container with id 969d0044aff82de0f9652d8208591838d45b1bc3fccd3ac242fea6ec9566037a May 21 14:59:28.149417 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:28.149385 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" event={"ID":"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155","Type":"ContainerStarted","Data":"969d0044aff82de0f9652d8208591838d45b1bc3fccd3ac242fea6ec9566037a"} May 21 14:59:30.157698 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:30.157659 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" event={"ID":"f07bc6f1-5a27-451d-8ac0-7e28ac2b6155","Type":"ContainerStarted","Data":"544c4852fc1e68af194f917ef73669a3a34020e381622668ec8c934a2133b38a"} May 21 14:59:30.180346 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:30.180291 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-r5h98" podStartSLOduration=1.503163843 podStartE2EDuration="3.180272952s" podCreationTimestamp="2026-05-21 14:59:27 +0000 UTC" firstStartedPulling="2026-05-21 14:59:27.59337816 +0000 UTC m=+316.079275376" lastFinishedPulling="2026-05-21 14:59:29.270487271 +0000 UTC m=+317.756384485" observedRunningTime="2026-05-21 14:59:30.178248569 +0000 UTC m=+318.664145804" watchObservedRunningTime="2026-05-21 14:59:30.180272952 +0000 UTC m=+318.666170188" May 21 14:59:31.784244 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.784211 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r"] May 21 14:59:31.787105 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.787089 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:31.791334 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.791308 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 14:59:31.792030 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.791988 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 14:59:31.792030 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.791993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 14:59:31.800244 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.800223 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r"] May 21 14:59:31.926681 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.926647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:31.926854 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.926689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:31.926854 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:31.926720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hfg\" (UniqueName: \"kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.027296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.027259 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.027296 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.027302 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.027538 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.027323 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hfg\" (UniqueName: \"kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.027721 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.027696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.027789 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.027710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.040842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.040787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hfg\" (UniqueName: \"kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.095715 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.095684 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:32.226910 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.226786 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r"] May 21 14:59:32.229041 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:32.228998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1869b8_4eda_49cf_8441_4bf40af83c18.slice/crio-5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e WatchSource:0}: Error finding container 5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e: Status 404 returned error can't find the container with id 5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e May 21 14:59:32.680795 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.680708 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jxdp2"] May 21 14:59:32.682907 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.682891 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.685630 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.685594 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 14:59:32.686492 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.686471 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fst82\"" May 21 14:59:32.686492 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.686485 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 14:59:32.692191 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.692169 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jxdp2"] May 21 14:59:32.833380 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.833350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.833734 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.833407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgmwl\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-kube-api-access-bgmwl\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.934123 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.934033 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgmwl\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-kube-api-access-bgmwl\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.934303 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.934132 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.944869 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.944838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:32.944975 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:32.944934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgmwl\" (UniqueName: \"kubernetes.io/projected/dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8-kube-api-access-bgmwl\") pod \"cert-manager-webhook-587ccfb98-jxdp2\" (UID: \"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:33.002380 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.002347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:33.133950 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.133771 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jxdp2"] May 21 14:59:33.137866 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:33.137834 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc807d99_1589_45e7_8f1f_a0e9ba4b3cb8.slice/crio-f542824ed049bc57f9efada6d107761df204a4f75bcee69c54c3a624d832e10b WatchSource:0}: Error finding container f542824ed049bc57f9efada6d107761df204a4f75bcee69c54c3a624d832e10b: Status 404 returned error can't find the container with id f542824ed049bc57f9efada6d107761df204a4f75bcee69c54c3a624d832e10b May 21 14:59:33.167523 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.167494 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" event={"ID":"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8","Type":"ContainerStarted","Data":"f542824ed049bc57f9efada6d107761df204a4f75bcee69c54c3a624d832e10b"} May 21 14:59:33.168801 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.168774 2559 generic.go:358] "Generic (PLEG): container finished" podID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerID="27a1698584f3cfc083ee257f027d6fe06cdac85873da373e1a8ca5d13a97131d" exitCode=0 May 21 14:59:33.168888 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.168862 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" event={"ID":"0a1869b8-4eda-49cf-8441-4bf40af83c18","Type":"ContainerDied","Data":"27a1698584f3cfc083ee257f027d6fe06cdac85873da373e1a8ca5d13a97131d"} May 21 14:59:33.168945 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:33.168888 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" event={"ID":"0a1869b8-4eda-49cf-8441-4bf40af83c18","Type":"ContainerStarted","Data":"5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e"} May 21 14:59:37.187730 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:37.187690 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" event={"ID":"dc807d99-1589-45e7-8f1f-a0e9ba4b3cb8","Type":"ContainerStarted","Data":"e70828d137b6db0b8a102658d70fddfb1372eeddd4eeade9247c2bd169b27a07"} May 21 14:59:37.188226 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:37.187761 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:37.189340 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:37.189315 2559 generic.go:358] "Generic (PLEG): container finished" podID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerID="4206bccad918e1c32502bd5e4e2cdaf33a09577fdaa83545045bf6d1b66d49e4" exitCode=0 May 21 14:59:37.189418 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:37.189361 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" event={"ID":"0a1869b8-4eda-49cf-8441-4bf40af83c18","Type":"ContainerDied","Data":"4206bccad918e1c32502bd5e4e2cdaf33a09577fdaa83545045bf6d1b66d49e4"} May 21 14:59:37.205669 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:37.205624 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" podStartSLOduration=2.221514979 podStartE2EDuration="5.205611557s" podCreationTimestamp="2026-05-21 14:59:32 +0000 UTC" firstStartedPulling="2026-05-21 14:59:33.140331739 +0000 UTC m=+321.626228951" lastFinishedPulling="2026-05-21 14:59:36.124428316 +0000 UTC m=+324.610325529" observedRunningTime="2026-05-21 14:59:37.205430892 +0000 UTC m=+325.691328128" watchObservedRunningTime="2026-05-21 14:59:37.205611557 +0000 UTC m=+325.691508794" May 21 14:59:38.194387 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:38.194351 2559 generic.go:358] "Generic (PLEG): container finished" podID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerID="36999722cbf675f7ceaf812a44fe29b5a41668256842da9ce95a7f89b7945924" exitCode=0 May 21 14:59:38.194855 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:38.194440 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" event={"ID":"0a1869b8-4eda-49cf-8441-4bf40af83c18","Type":"ContainerDied","Data":"36999722cbf675f7ceaf812a44fe29b5a41668256842da9ce95a7f89b7945924"} May 21 14:59:39.317968 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.317942 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:39.393127 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.393090 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle\") pod \"0a1869b8-4eda-49cf-8441-4bf40af83c18\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " May 21 14:59:39.393127 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.393133 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util\") pod \"0a1869b8-4eda-49cf-8441-4bf40af83c18\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " May 21 14:59:39.393364 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.393187 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7hfg\" (UniqueName: \"kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg\") pod \"0a1869b8-4eda-49cf-8441-4bf40af83c18\" (UID: \"0a1869b8-4eda-49cf-8441-4bf40af83c18\") " May 21 14:59:39.393580 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.393536 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle" (OuterVolumeSpecName: "bundle") pod "0a1869b8-4eda-49cf-8441-4bf40af83c18" (UID: "0a1869b8-4eda-49cf-8441-4bf40af83c18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:39.395300 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.395278 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg" (OuterVolumeSpecName: "kube-api-access-r7hfg") pod "0a1869b8-4eda-49cf-8441-4bf40af83c18" (UID: "0a1869b8-4eda-49cf-8441-4bf40af83c18"). InnerVolumeSpecName "kube-api-access-r7hfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:59:39.398048 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.398002 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util" (OuterVolumeSpecName: "util") pod "0a1869b8-4eda-49cf-8441-4bf40af83c18" (UID: "0a1869b8-4eda-49cf-8441-4bf40af83c18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:39.494155 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.494079 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7hfg\" (UniqueName: \"kubernetes.io/projected/0a1869b8-4eda-49cf-8441-4bf40af83c18-kube-api-access-r7hfg\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:39.494155 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.494106 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:39.494155 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:39.494115 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1869b8-4eda-49cf-8441-4bf40af83c18-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:40.204880 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:40.204851 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" May 21 14:59:40.205033 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:40.204850 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4988r" event={"ID":"0a1869b8-4eda-49cf-8441-4bf40af83c18","Type":"ContainerDied","Data":"5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e"} May 21 14:59:40.205033 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:40.204962 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5feda7d2c061753a8b8c5464d040e3f1f5045619f7e59d3654ceb21862bd629e" May 21 14:59:43.196850 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:43.196820 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jxdp2" May 21 14:59:51.383354 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383313 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2"] May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383629 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="extract" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383645 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="extract" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383659 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="util" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383665 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="util" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383677 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="pull" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383683 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="pull" May 21 14:59:51.383776 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.383742 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a1869b8-4eda-49cf-8441-4bf40af83c18" containerName="extract" May 21 14:59:51.407000 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.406968 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2"] May 21 14:59:51.407168 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.407134 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.409472 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.409450 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 14:59:51.409596 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.409495 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 14:59:51.409596 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.409576 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 14:59:51.491780 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.491745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.491963 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.491790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7llc\" (UniqueName: \"kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.491963 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.491862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.593129 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.593089 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.593325 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.593146 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.593325 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.593180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7llc\" (UniqueName: \"kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.593497 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.593466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.593545 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.593528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.607462 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.607433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7llc\" (UniqueName: \"kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.612386 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.612362 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5746r"] May 21 14:59:51.630530 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.630506 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5746r"] May 21 14:59:51.630692 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.630604 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.632690 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.632667 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-28vlh\"" May 21 14:59:51.694333 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.694306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-bound-sa-token\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.694519 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.694351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqmj\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-kube-api-access-xgqmj\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.719278 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.719240 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:51.795842 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.795814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-bound-sa-token\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.795981 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.795864 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqmj\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-kube-api-access-xgqmj\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.804493 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.804468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-bound-sa-token\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.804705 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.804683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqmj\" (UniqueName: \"kubernetes.io/projected/4649236b-53b1-485d-9940-10f828d9f30f-kube-api-access-xgqmj\") pod \"cert-manager-79c8d999ff-5746r\" (UID: \"4649236b-53b1-485d-9940-10f828d9f30f\") " pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:51.850218 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.850050 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2"] May 21 14:59:51.852850 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:51.852821 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfda00b8_6a00_4a0d_bdbf_b5b243293f66.slice/crio-ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d WatchSource:0}: Error finding container ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d: Status 404 returned error can't find the container with id ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d May 21 14:59:51.940260 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:51.940238 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5746r" May 21 14:59:52.072499 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.072468 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5746r"] May 21 14:59:52.075983 ip-10-0-143-65 kubenswrapper[2559]: W0521 14:59:52.075948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4649236b_53b1_485d_9940_10f828d9f30f.slice/crio-3d8331ab09940d16b01357c9ba268a1080e67a1d5d50bd88fc72967c16d6e528 WatchSource:0}: Error finding container 3d8331ab09940d16b01357c9ba268a1080e67a1d5d50bd88fc72967c16d6e528: Status 404 returned error can't find the container with id 3d8331ab09940d16b01357c9ba268a1080e67a1d5d50bd88fc72967c16d6e528 May 21 14:59:52.243409 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.243374 2559 generic.go:358] "Generic (PLEG): container finished" podID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerID="76ddb3f4b5fba48946d069e008ab0f19ee727df600793593abc710a7e0b7e7ef" exitCode=0 May 21 14:59:52.243637 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.243459 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" event={"ID":"dfda00b8-6a00-4a0d-bdbf-b5b243293f66","Type":"ContainerDied","Data":"76ddb3f4b5fba48946d069e008ab0f19ee727df600793593abc710a7e0b7e7ef"} May 21 14:59:52.243637 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.243496 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" event={"ID":"dfda00b8-6a00-4a0d-bdbf-b5b243293f66","Type":"ContainerStarted","Data":"ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d"} May 21 14:59:52.244945 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.244914 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5746r" event={"ID":"4649236b-53b1-485d-9940-10f828d9f30f","Type":"ContainerStarted","Data":"2ee55ed89c17e96cde740f1d8e025798d8ead580c57672e0ef9a066c4caf5804"} May 21 14:59:52.245069 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.244946 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5746r" event={"ID":"4649236b-53b1-485d-9940-10f828d9f30f","Type":"ContainerStarted","Data":"3d8331ab09940d16b01357c9ba268a1080e67a1d5d50bd88fc72967c16d6e528"} May 21 14:59:52.275789 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:52.275741 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5746r" podStartSLOduration=1.275728506 podStartE2EDuration="1.275728506s" podCreationTimestamp="2026-05-21 14:59:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:59:52.273752047 +0000 UTC m=+340.759649282" watchObservedRunningTime="2026-05-21 14:59:52.275728506 +0000 UTC m=+340.761625741" May 21 14:59:54.253375 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:54.253339 2559 generic.go:358] "Generic (PLEG): container finished" podID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerID="8d47ab8743688c8105dd5c1077171f5c40696d7771ed423cdd21acc8536192d9" exitCode=0 May 21 14:59:54.253803 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:54.253387 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" event={"ID":"dfda00b8-6a00-4a0d-bdbf-b5b243293f66","Type":"ContainerDied","Data":"8d47ab8743688c8105dd5c1077171f5c40696d7771ed423cdd21acc8536192d9"} May 21 14:59:55.259086 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:55.259050 2559 generic.go:358] "Generic (PLEG): container finished" podID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerID="f94cb060f218824e8dbfc87c0d44bcbbf9da4aa3ddb302cb536a68c7153c22f2" exitCode=0 May 21 14:59:55.259086 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:55.259088 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" event={"ID":"dfda00b8-6a00-4a0d-bdbf-b5b243293f66","Type":"ContainerDied","Data":"f94cb060f218824e8dbfc87c0d44bcbbf9da4aa3ddb302cb536a68c7153c22f2"} May 21 14:59:56.385697 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.385675 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 14:59:56.437133 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.437096 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7llc\" (UniqueName: \"kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc\") pod \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " May 21 14:59:56.437133 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.437136 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util\") pod \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " May 21 14:59:56.437354 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.437180 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle\") pod \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\" (UID: \"dfda00b8-6a00-4a0d-bdbf-b5b243293f66\") " May 21 14:59:56.437945 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.437913 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle" (OuterVolumeSpecName: "bundle") pod "dfda00b8-6a00-4a0d-bdbf-b5b243293f66" (UID: "dfda00b8-6a00-4a0d-bdbf-b5b243293f66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:56.439320 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.439292 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc" (OuterVolumeSpecName: "kube-api-access-n7llc") pod "dfda00b8-6a00-4a0d-bdbf-b5b243293f66" (UID: "dfda00b8-6a00-4a0d-bdbf-b5b243293f66"). InnerVolumeSpecName "kube-api-access-n7llc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:59:56.442528 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.442503 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util" (OuterVolumeSpecName: "util") pod "dfda00b8-6a00-4a0d-bdbf-b5b243293f66" (UID: "dfda00b8-6a00-4a0d-bdbf-b5b243293f66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:59:56.537988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.537959 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7llc\" (UniqueName: \"kubernetes.io/projected/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-kube-api-access-n7llc\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:56.537988 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.537989 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:56.538252 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:56.537999 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfda00b8-6a00-4a0d-bdbf-b5b243293f66-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 14:59:57.266368 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:57.266331 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" event={"ID":"dfda00b8-6a00-4a0d-bdbf-b5b243293f66","Type":"ContainerDied","Data":"ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d"} May 21 14:59:57.266368 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:57.266374 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba879e2e17b9e89faf98a6312245a7bc4f4e70aad5a74deaec0a5ee32478d25d" May 21 14:59:57.266604 ip-10-0-143-65 kubenswrapper[2559]: I0521 14:59:57.266348 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5nflz2" May 21 15:00:08.233535 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233450 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4"] May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233740 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="pull" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233750 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="pull" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233767 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="extract" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233772 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="extract" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233780 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="util" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233786 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="util" May 21 15:00:08.233905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.233839 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfda00b8-6a00-4a0d-bdbf-b5b243293f66" containerName="extract" May 21 15:00:08.235762 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.235745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.238646 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.238620 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 15:00:08.239290 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.239264 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 15:00:08.239685 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.239449 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s2xc7\"" May 21 15:00:08.239685 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.239382 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 15:00:08.242870 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.240136 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 15:00:08.263155 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.263130 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4"] May 21 15:00:08.343720 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.343685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spr2l\" (UniqueName: \"kubernetes.io/projected/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-kube-api-access-spr2l\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.343897 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.343791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.343897 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.343831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.445190 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.445149 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.445364 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.445202 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.445364 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.445264 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-spr2l\" (UniqueName: \"kubernetes.io/projected/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-kube-api-access-spr2l\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.447776 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.447740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.447904 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.447798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.454228 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.454205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spr2l\" (UniqueName: \"kubernetes.io/projected/472d8b6e-bd1c-4bf2-88df-7b4831a5902e-kube-api-access-spr2l\") pod \"opendatahub-operator-controller-manager-677f98f9b9-jcln4\" (UID: \"472d8b6e-bd1c-4bf2-88df-7b4831a5902e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.548402 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.548373 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:08.607104 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.607039 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt"] May 21 15:00:08.613060 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.610974 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.620505 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.620466 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 15:00:08.622146 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.620761 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 15:00:08.622146 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.620962 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 15:00:08.622146 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.621962 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt"] May 21 15:00:08.700502 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.700470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4"] May 21 15:00:08.703737 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:00:08.703700 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472d8b6e_bd1c_4bf2_88df_7b4831a5902e.slice/crio-e79c98bd4b83ee5157b47412c9f1a19f5befb6412f7e8cc263db765f264574c6 WatchSource:0}: Error finding container e79c98bd4b83ee5157b47412c9f1a19f5befb6412f7e8cc263db765f264574c6: Status 404 returned error can't find the container with id e79c98bd4b83ee5157b47412c9f1a19f5befb6412f7e8cc263db765f264574c6 May 21 15:00:08.748400 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.748367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.748552 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.748438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.748552 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.748515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4c8z\" (UniqueName: \"kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.849661 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.849560 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.849661 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.849633 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4c8z\" (UniqueName: \"kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.849891 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.849716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.849956 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.849940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.850106 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.850085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.862657 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.862638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4c8z\" (UniqueName: \"kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:08.941324 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:08.941291 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:09.082209 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:09.082171 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt"] May 21 15:00:09.085763 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:00:09.085731 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d9cbc0_b458_4923_adc6_7a9d5a4e305c.slice/crio-f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b WatchSource:0}: Error finding container f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b: Status 404 returned error can't find the container with id f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b May 21 15:00:09.306996 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:09.306961 2559 generic.go:358] "Generic (PLEG): container finished" podID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerID="d708b6281c120ab7ca9d645e783b9415013f3a2269746fcac9967dfbdcc83fb6" exitCode=0 May 21 15:00:09.307426 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:09.307048 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" event={"ID":"31d9cbc0-b458-4923-adc6-7a9d5a4e305c","Type":"ContainerDied","Data":"d708b6281c120ab7ca9d645e783b9415013f3a2269746fcac9967dfbdcc83fb6"} May 21 15:00:09.307426 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:09.307087 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" event={"ID":"31d9cbc0-b458-4923-adc6-7a9d5a4e305c","Type":"ContainerStarted","Data":"f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b"} May 21 15:00:09.308323 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:09.308301 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" event={"ID":"472d8b6e-bd1c-4bf2-88df-7b4831a5902e","Type":"ContainerStarted","Data":"e79c98bd4b83ee5157b47412c9f1a19f5befb6412f7e8cc263db765f264574c6"} May 21 15:00:10.314560 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:10.314515 2559 generic.go:358] "Generic (PLEG): container finished" podID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerID="e86dbb14ce037d6dc6692df6cf3e98ad38ed6a96e80cfadc4fd9e07ffc86248b" exitCode=0 May 21 15:00:10.315030 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:10.314576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" event={"ID":"31d9cbc0-b458-4923-adc6-7a9d5a4e305c","Type":"ContainerDied","Data":"e86dbb14ce037d6dc6692df6cf3e98ad38ed6a96e80cfadc4fd9e07ffc86248b"} May 21 15:00:12.323763 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:12.323723 2559 generic.go:358] "Generic (PLEG): container finished" podID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerID="98dca9535465566310e312a94b101724d92c7a3f5c63ee4b74ed7f2323a637a4" exitCode=0 May 21 15:00:12.324206 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:12.323811 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" event={"ID":"31d9cbc0-b458-4923-adc6-7a9d5a4e305c","Type":"ContainerDied","Data":"98dca9535465566310e312a94b101724d92c7a3f5c63ee4b74ed7f2323a637a4"} May 21 15:00:12.325373 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:12.325344 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" event={"ID":"472d8b6e-bd1c-4bf2-88df-7b4831a5902e","Type":"ContainerStarted","Data":"9098e5c90b14e9627b067e836aeb7330133fabd27b80e6c42cc56b16fe33775f"} May 21 15:00:12.325509 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:12.325447 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:12.388885 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:12.388830 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" podStartSLOduration=1.5865403420000002 podStartE2EDuration="4.388811205s" podCreationTimestamp="2026-05-21 15:00:08 +0000 UTC" firstStartedPulling="2026-05-21 15:00:08.705427702 +0000 UTC m=+357.191324916" lastFinishedPulling="2026-05-21 15:00:11.507698565 +0000 UTC m=+359.993595779" observedRunningTime="2026-05-21 15:00:12.387725519 +0000 UTC m=+360.873622755" watchObservedRunningTime="2026-05-21 15:00:12.388811205 +0000 UTC m=+360.874708439" May 21 15:00:13.451477 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.451455 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:13.589204 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.589114 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle\") pod \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " May 21 15:00:13.589204 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.589161 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util\") pod \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " May 21 15:00:13.589204 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.589193 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4c8z\" (UniqueName: \"kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z\") pod \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\" (UID: \"31d9cbc0-b458-4923-adc6-7a9d5a4e305c\") " May 21 15:00:13.589933 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.589897 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle" (OuterVolumeSpecName: "bundle") pod "31d9cbc0-b458-4923-adc6-7a9d5a4e305c" (UID: "31d9cbc0-b458-4923-adc6-7a9d5a4e305c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:13.591302 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.591283 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z" (OuterVolumeSpecName: "kube-api-access-n4c8z") pod "31d9cbc0-b458-4923-adc6-7a9d5a4e305c" (UID: "31d9cbc0-b458-4923-adc6-7a9d5a4e305c"). InnerVolumeSpecName "kube-api-access-n4c8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:00:13.594747 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.594706 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util" (OuterVolumeSpecName: "util") pod "31d9cbc0-b458-4923-adc6-7a9d5a4e305c" (UID: "31d9cbc0-b458-4923-adc6-7a9d5a4e305c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:13.689843 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.689806 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:13.689843 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.689837 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:13.689843 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:13.689850 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4c8z\" (UniqueName: \"kubernetes.io/projected/31d9cbc0-b458-4923-adc6-7a9d5a4e305c-kube-api-access-n4c8z\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:14.333525 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:14.333488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" event={"ID":"31d9cbc0-b458-4923-adc6-7a9d5a4e305c","Type":"ContainerDied","Data":"f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b"} May 21 15:00:14.333525 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:14.333520 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9hmtlt" May 21 15:00:14.333695 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:14.333522 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1ad4c650603dc0e9e5604a5815273a889060b37f6939d8a218f4c99d0354c5b" May 21 15:00:18.522343 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522307 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9"] May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522639 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="extract" May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522649 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="extract" May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522658 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="util" May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522663 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="util" May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522674 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="pull" May 21 15:00:18.522725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522679 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="pull" May 21 15:00:18.522907 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.522732 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="31d9cbc0-b458-4923-adc6-7a9d5a4e305c" containerName="extract" May 21 15:00:18.525538 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.525520 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.529127 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529104 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 15:00:18.529730 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529709 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 15:00:18.529804 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529761 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 15:00:18.529864 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529802 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 15:00:18.529864 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529805 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7qpmj\"" May 21 15:00:18.529864 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.529858 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 15:00:18.540578 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.540555 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9"] May 21 15:00:18.632883 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.632848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.633081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.632897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-metrics-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.633081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.632956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-manager-config\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.633081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.633047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj8h8\" (UniqueName: \"kubernetes.io/projected/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-kube-api-access-rj8h8\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.733822 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.733782 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.734005 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.733833 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-metrics-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.734005 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.733854 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-manager-config\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.734005 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.733905 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rj8h8\" (UniqueName: \"kubernetes.io/projected/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-kube-api-access-rj8h8\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.734659 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.734633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-manager-config\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.736299 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.736273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.736299 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.736287 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-metrics-cert\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.748848 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.748822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj8h8\" (UniqueName: \"kubernetes.io/projected/4ccf82e3-7e3e-4907-9304-d074ae73ec3c-kube-api-access-rj8h8\") pod \"lws-controller-manager-68f6db4d77-ccjk9\" (UID: \"4ccf82e3-7e3e-4907-9304-d074ae73ec3c\") " pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.835181 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.835142 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:18.979674 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:18.979511 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9"] May 21 15:00:18.982342 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:00:18.982312 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccf82e3_7e3e_4907_9304_d074ae73ec3c.slice/crio-7641815cd75a623d66f07568c3758262f1a07521b6348b0e95d7083b54ea073b WatchSource:0}: Error finding container 7641815cd75a623d66f07568c3758262f1a07521b6348b0e95d7083b54ea073b: Status 404 returned error can't find the container with id 7641815cd75a623d66f07568c3758262f1a07521b6348b0e95d7083b54ea073b May 21 15:00:19.355660 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:19.355623 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" event={"ID":"4ccf82e3-7e3e-4907-9304-d074ae73ec3c","Type":"ContainerStarted","Data":"7641815cd75a623d66f07568c3758262f1a07521b6348b0e95d7083b54ea073b"} May 21 15:00:21.363601 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:21.363564 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" event={"ID":"4ccf82e3-7e3e-4907-9304-d074ae73ec3c","Type":"ContainerStarted","Data":"2211848be040470cf4ba4cbb3852219f151ea4fc52304f9516f680ec1afb179d"} May 21 15:00:21.363997 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:21.363692 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:21.383612 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:21.383567 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" podStartSLOduration=1.537430401 podStartE2EDuration="3.383552292s" podCreationTimestamp="2026-05-21 15:00:18 +0000 UTC" firstStartedPulling="2026-05-21 15:00:18.984110251 +0000 UTC m=+367.470007463" lastFinishedPulling="2026-05-21 15:00:20.830232139 +0000 UTC m=+369.316129354" observedRunningTime="2026-05-21 15:00:21.381543229 +0000 UTC m=+369.867440464" watchObservedRunningTime="2026-05-21 15:00:21.383552292 +0000 UTC m=+369.869449526" May 21 15:00:23.330660 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:23.330630 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-jcln4" May 21 15:00:27.999571 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:27.999533 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4"] May 21 15:00:28.003108 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.003090 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.007433 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.007405 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 15:00:28.007433 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.007405 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 15:00:28.008167 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.008151 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 15:00:28.014041 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.014003 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4"] May 21 15:00:28.117381 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.117349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.117594 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.117418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.117594 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.117511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdvf\" (UniqueName: \"kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.218399 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.218358 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdvf\" (UniqueName: \"kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.218586 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.218409 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.218586 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.218467 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.218949 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.218915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.219110 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.218927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.228296 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.228266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdvf\" (UniqueName: \"kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.312731 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.312701 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:28.442383 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:28.442256 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4"] May 21 15:00:28.445151 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:00:28.445118 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87f6d1b_ed51_4bef_a524_ccea1490632e.slice/crio-b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669 WatchSource:0}: Error finding container b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669: Status 404 returned error can't find the container with id b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669 May 21 15:00:29.391168 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:29.391131 2559 generic.go:358] "Generic (PLEG): container finished" podID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerID="085618e116ef545901be9d5f3313da6aea836b738d041954ba577960042d9691" exitCode=0 May 21 15:00:29.391566 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:29.391191 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" event={"ID":"d87f6d1b-ed51-4bef-a524-ccea1490632e","Type":"ContainerDied","Data":"085618e116ef545901be9d5f3313da6aea836b738d041954ba577960042d9691"} May 21 15:00:29.391566 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:29.391214 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" event={"ID":"d87f6d1b-ed51-4bef-a524-ccea1490632e","Type":"ContainerStarted","Data":"b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669"} May 21 15:00:31.405870 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:31.405831 2559 generic.go:358] "Generic (PLEG): container finished" podID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerID="68202b01bb3bd9deef5b86dbcb6abb709eb0e0c19534e16bd4a75223c030c60a" exitCode=0 May 21 15:00:31.406312 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:31.405893 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" event={"ID":"d87f6d1b-ed51-4bef-a524-ccea1490632e","Type":"ContainerDied","Data":"68202b01bb3bd9deef5b86dbcb6abb709eb0e0c19534e16bd4a75223c030c60a"} May 21 15:00:32.369485 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:32.369455 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68f6db4d77-ccjk9" May 21 15:00:32.411942 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:32.411911 2559 generic.go:358] "Generic (PLEG): container finished" podID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerID="70c68267a574f05e2d0ef6aa803afbc4f0f57bbebcb09f4bbbd592561f894e95" exitCode=0 May 21 15:00:32.412341 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:32.411987 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" event={"ID":"d87f6d1b-ed51-4bef-a524-ccea1490632e","Type":"ContainerDied","Data":"70c68267a574f05e2d0ef6aa803afbc4f0f57bbebcb09f4bbbd592561f894e95"} May 21 15:00:33.540617 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.540593 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:33.562501 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.562460 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util\") pod \"d87f6d1b-ed51-4bef-a524-ccea1490632e\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " May 21 15:00:33.562501 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.562500 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle\") pod \"d87f6d1b-ed51-4bef-a524-ccea1490632e\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " May 21 15:00:33.562736 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.562623 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzdvf\" (UniqueName: \"kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf\") pod \"d87f6d1b-ed51-4bef-a524-ccea1490632e\" (UID: \"d87f6d1b-ed51-4bef-a524-ccea1490632e\") " May 21 15:00:33.563927 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.563897 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle" (OuterVolumeSpecName: "bundle") pod "d87f6d1b-ed51-4bef-a524-ccea1490632e" (UID: "d87f6d1b-ed51-4bef-a524-ccea1490632e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:33.565105 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.565073 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf" (OuterVolumeSpecName: "kube-api-access-nzdvf") pod "d87f6d1b-ed51-4bef-a524-ccea1490632e" (UID: "d87f6d1b-ed51-4bef-a524-ccea1490632e"). InnerVolumeSpecName "kube-api-access-nzdvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:00:33.571196 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.571172 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util" (OuterVolumeSpecName: "util") pod "d87f6d1b-ed51-4bef-a524-ccea1490632e" (UID: "d87f6d1b-ed51-4bef-a524-ccea1490632e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:33.663752 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.663707 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzdvf\" (UniqueName: \"kubernetes.io/projected/d87f6d1b-ed51-4bef-a524-ccea1490632e-kube-api-access-nzdvf\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:33.663752 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.663743 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:33.663752 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:33.663759 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87f6d1b-ed51-4bef-a524-ccea1490632e-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:34.421903 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:34.421812 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" event={"ID":"d87f6d1b-ed51-4bef-a524-ccea1490632e","Type":"ContainerDied","Data":"b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669"} May 21 15:00:34.421903 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:34.421846 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b999cb40aec5faaac5025a8ff51146db9862a27fe7460bc52974fdb3d4cef669" May 21 15:00:34.421903 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:34.421872 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n8jc4" May 21 15:00:45.222444 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222405 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc"] May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222727 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="pull" May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222738 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="pull" May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222753 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="util" May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222760 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="util" May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222774 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="extract" May 21 15:00:45.222921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222782 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="extract" May 21 15:00:45.223250 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.222970 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d87f6d1b-ed51-4bef-a524-ccea1490632e" containerName="extract" May 21 15:00:45.236807 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.236778 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.238794 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.238764 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc"] May 21 15:00:45.239236 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.239213 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 15:00:45.239349 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.239284 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8cfw\"" May 21 15:00:45.239996 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.239979 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 15:00:45.369188 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.369156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.369359 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.369199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5jk\" (UniqueName: \"kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.369359 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.369276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.470488 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.470455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.470641 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.470497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5jk\" (UniqueName: \"kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.470641 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.470545 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.470930 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.470909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.470930 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.470923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.479216 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.479158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5jk\" (UniqueName: \"kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.547803 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.547768 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:45.693555 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:45.693390 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc"] May 21 15:00:45.695898 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:00:45.695873 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3192f02_ad76_47bb_972f_318a8c0731f2.slice/crio-1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7 WatchSource:0}: Error finding container 1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7: Status 404 returned error can't find the container with id 1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7 May 21 15:00:46.469379 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:46.469343 2559 generic.go:358] "Generic (PLEG): container finished" podID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerID="a0215848d2872739fd23402eab6544286451d4f6c9a578d6b1a070ed164932b2" exitCode=0 May 21 15:00:46.469776 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:46.469422 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" event={"ID":"d3192f02-ad76-47bb-972f-318a8c0731f2","Type":"ContainerDied","Data":"a0215848d2872739fd23402eab6544286451d4f6c9a578d6b1a070ed164932b2"} May 21 15:00:46.469776 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:46.469447 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" event={"ID":"d3192f02-ad76-47bb-972f-318a8c0731f2","Type":"ContainerStarted","Data":"1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7"} May 21 15:00:48.478843 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:48.478803 2559 generic.go:358] "Generic (PLEG): container finished" podID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerID="3b72bd4dced52b0e52d702ce878d7b993be6997c277a894a69442ae4dd3da4ef" exitCode=0 May 21 15:00:48.479338 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:48.478856 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" event={"ID":"d3192f02-ad76-47bb-972f-318a8c0731f2","Type":"ContainerDied","Data":"3b72bd4dced52b0e52d702ce878d7b993be6997c277a894a69442ae4dd3da4ef"} May 21 15:00:49.484194 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:49.484156 2559 generic.go:358] "Generic (PLEG): container finished" podID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerID="e3277a2c9a1160dc1b82f969243a776e375705fafa39aeb9c808c17dbd3d1924" exitCode=0 May 21 15:00:49.484625 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:49.484246 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" event={"ID":"d3192f02-ad76-47bb-972f-318a8c0731f2","Type":"ContainerDied","Data":"e3277a2c9a1160dc1b82f969243a776e375705fafa39aeb9c808c17dbd3d1924"} May 21 15:00:50.624326 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.624297 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:00:50.717460 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.717423 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx5jk\" (UniqueName: \"kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk\") pod \"d3192f02-ad76-47bb-972f-318a8c0731f2\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " May 21 15:00:50.717639 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.717475 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle\") pod \"d3192f02-ad76-47bb-972f-318a8c0731f2\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " May 21 15:00:50.717639 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.717515 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util\") pod \"d3192f02-ad76-47bb-972f-318a8c0731f2\" (UID: \"d3192f02-ad76-47bb-972f-318a8c0731f2\") " May 21 15:00:50.718434 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.718401 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle" (OuterVolumeSpecName: "bundle") pod "d3192f02-ad76-47bb-972f-318a8c0731f2" (UID: "d3192f02-ad76-47bb-972f-318a8c0731f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:50.719579 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.719548 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk" (OuterVolumeSpecName: "kube-api-access-nx5jk") pod "d3192f02-ad76-47bb-972f-318a8c0731f2" (UID: "d3192f02-ad76-47bb-972f-318a8c0731f2"). InnerVolumeSpecName "kube-api-access-nx5jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:00:50.723479 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.723452 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util" (OuterVolumeSpecName: "util") pod "d3192f02-ad76-47bb-972f-318a8c0731f2" (UID: "d3192f02-ad76-47bb-972f-318a8c0731f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:00:50.818596 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.818561 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx5jk\" (UniqueName: \"kubernetes.io/projected/d3192f02-ad76-47bb-972f-318a8c0731f2-kube-api-access-nx5jk\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:50.818596 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.818598 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:50.818905 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:50.818608 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3192f02-ad76-47bb-972f-318a8c0731f2-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:00:51.492564 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:51.492523 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" event={"ID":"d3192f02-ad76-47bb-972f-318a8c0731f2","Type":"ContainerDied","Data":"1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7"} May 21 15:00:51.492564 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:51.492558 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f590503037ae782598897557e38e6e3c7fb32bce77c65a4882f8bfc8a943cb7" May 21 15:00:51.492773 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:00:51.492578 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7kwwc" May 21 15:01:00.953233 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953195 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc"] May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953524 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="extract" May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953539 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="extract" May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953563 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="pull" May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953569 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="pull" May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953576 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="util" May 21 15:01:00.953627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953581 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="util" May 21 15:01:00.953809 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.953637 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3192f02-ad76-47bb-972f-318a8c0731f2" containerName="extract" May 21 15:01:00.955623 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.955605 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:00.958297 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.958270 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 15:01:00.958426 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.958316 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 15:01:00.958426 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.958342 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-slgs9\"" May 21 15:01:00.958426 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.958376 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 15:01:00.974332 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:00.974296 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc"] May 21 15:01:01.114598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114784 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vtkm\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-kube-api-access-4vtkm\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114784 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114784 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114912 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114912 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.114912 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34041596-3d07-4873-8a9b-b1be26af7242-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.115006 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.115006 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.114949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34041596-3d07-4873-8a9b-b1be26af7242-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215419 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215329 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34041596-3d07-4873-8a9b-b1be26af7242-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215419 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215617 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215512 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vtkm\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-kube-api-access-4vtkm\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215617 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215563 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215617 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215603 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215761 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215634 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215761 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215761 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215706 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215973 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215765 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34041596-3d07-4873-8a9b-b1be26af7242-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215973 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215793 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.215973 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.215953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.216124 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.216095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34041596-3d07-4873-8a9b-b1be26af7242-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.216343 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.216327 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.216405 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.216352 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.218040 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.217989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34041596-3d07-4873-8a9b-b1be26af7242-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.218402 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.218383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34041596-3d07-4873-8a9b-b1be26af7242-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.224240 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.224213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.224340 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.224284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vtkm\" (UniqueName: \"kubernetes.io/projected/34041596-3d07-4873-8a9b-b1be26af7242-kube-api-access-4vtkm\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btt9hc\" (UID: \"34041596-3d07-4873-8a9b-b1be26af7242\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.266521 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.266485 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:01.411313 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.411285 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc"] May 21 15:01:01.414291 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:01.414261 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34041596_3d07_4873_8a9b_b1be26af7242.slice/crio-799acfa0b315e3bc7621fa354a49804e2d97be334df5c2ccede96c5cd121103b WatchSource:0}: Error finding container 799acfa0b315e3bc7621fa354a49804e2d97be334df5c2ccede96c5cd121103b: Status 404 returned error can't find the container with id 799acfa0b315e3bc7621fa354a49804e2d97be334df5c2ccede96c5cd121103b May 21 15:01:01.533690 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:01.533655 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" event={"ID":"34041596-3d07-4873-8a9b-b1be26af7242","Type":"ContainerStarted","Data":"799acfa0b315e3bc7621fa354a49804e2d97be334df5c2ccede96c5cd121103b"} May 21 15:01:04.353508 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:04.353468 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:01:04.353756 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:04.353546 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:01:04.353756 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:04.353577 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:01:04.546121 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:04.546068 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" event={"ID":"34041596-3d07-4873-8a9b-b1be26af7242","Type":"ContainerStarted","Data":"2f8a61bf7593210133e95b9a1f200e1eff9b0868bfc76b9ad2bb2a871db80302"} May 21 15:01:04.571181 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:04.571131 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" podStartSLOduration=1.633979091 podStartE2EDuration="4.571117403s" podCreationTimestamp="2026-05-21 15:01:00 +0000 UTC" firstStartedPulling="2026-05-21 15:01:01.416087709 +0000 UTC m=+409.901984922" lastFinishedPulling="2026-05-21 15:01:04.353226018 +0000 UTC m=+412.839123234" observedRunningTime="2026-05-21 15:01:04.568468213 +0000 UTC m=+413.054365451" watchObservedRunningTime="2026-05-21 15:01:04.571117403 +0000 UTC m=+413.057014637" May 21 15:01:05.267606 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:05.267561 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:05.272339 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:05.272314 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:05.549466 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:05.549433 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:05.550401 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:05.550388 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btt9hc" May 21 15:01:26.778709 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.778672 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:26.782024 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.781989 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:26.784312 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.784289 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 15:01:26.784605 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.784585 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 15:01:26.785313 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.785296 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zg2jj\"" May 21 15:01:26.790675 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.790651 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:26.839912 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.839882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ghms\" (UniqueName: \"kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms\") pod \"kuadrant-operator-catalog-l2lvd\" (UID: \"d9274d99-56ff-4d0a-b4d6-20c9d4dff627\") " pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:26.941393 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.941354 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ghms\" (UniqueName: \"kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms\") pod \"kuadrant-operator-catalog-l2lvd\" (UID: \"d9274d99-56ff-4d0a-b4d6-20c9d4dff627\") " pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:26.949772 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:26.949740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ghms\" (UniqueName: \"kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms\") pod \"kuadrant-operator-catalog-l2lvd\" (UID: \"d9274d99-56ff-4d0a-b4d6-20c9d4dff627\") " pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:27.094689 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.094658 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:27.153293 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.153264 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:27.224990 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.224966 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:27.227637 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:27.227608 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9274d99_56ff_4d0a_b4d6_20c9d4dff627.slice/crio-2aba672a6b5004d9f0a0952fbd1b2361d1d7cc533651c28e395ce80701c8aa59 WatchSource:0}: Error finding container 2aba672a6b5004d9f0a0952fbd1b2361d1d7cc533651c28e395ce80701c8aa59: Status 404 returned error can't find the container with id 2aba672a6b5004d9f0a0952fbd1b2361d1d7cc533651c28e395ce80701c8aa59 May 21 15:01:27.357422 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.357323 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mzqk8"] May 21 15:01:27.362079 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.362052 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:27.367398 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.367372 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mzqk8"] May 21 15:01:27.445390 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.445347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qnn\" (UniqueName: \"kubernetes.io/projected/aa3f90c6-28d3-4a5d-839e-45d464f7fb12-kube-api-access-76qnn\") pod \"kuadrant-operator-catalog-mzqk8\" (UID: \"aa3f90c6-28d3-4a5d-839e-45d464f7fb12\") " pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:27.546882 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.546843 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76qnn\" (UniqueName: \"kubernetes.io/projected/aa3f90c6-28d3-4a5d-839e-45d464f7fb12-kube-api-access-76qnn\") pod \"kuadrant-operator-catalog-mzqk8\" (UID: \"aa3f90c6-28d3-4a5d-839e-45d464f7fb12\") " pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:27.557149 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.557110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qnn\" (UniqueName: \"kubernetes.io/projected/aa3f90c6-28d3-4a5d-839e-45d464f7fb12-kube-api-access-76qnn\") pod \"kuadrant-operator-catalog-mzqk8\" (UID: \"aa3f90c6-28d3-4a5d-839e-45d464f7fb12\") " pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:27.627117 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.627033 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" event={"ID":"d9274d99-56ff-4d0a-b4d6-20c9d4dff627","Type":"ContainerStarted","Data":"2aba672a6b5004d9f0a0952fbd1b2361d1d7cc533651c28e395ce80701c8aa59"} May 21 15:01:27.673390 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.673357 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:27.800373 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:27.800344 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mzqk8"] May 21 15:01:27.803372 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:27.803347 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3f90c6_28d3_4a5d_839e_45d464f7fb12.slice/crio-f517b2743be82ec9cd7c877f0537e21a90d758f2af902f241899135ce0d367ea WatchSource:0}: Error finding container f517b2743be82ec9cd7c877f0537e21a90d758f2af902f241899135ce0d367ea: Status 404 returned error can't find the container with id f517b2743be82ec9cd7c877f0537e21a90d758f2af902f241899135ce0d367ea May 21 15:01:28.631384 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:28.631350 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" event={"ID":"aa3f90c6-28d3-4a5d-839e-45d464f7fb12","Type":"ContainerStarted","Data":"f517b2743be82ec9cd7c877f0537e21a90d758f2af902f241899135ce0d367ea"} May 21 15:01:30.640337 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.640232 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" event={"ID":"aa3f90c6-28d3-4a5d-839e-45d464f7fb12","Type":"ContainerStarted","Data":"f899173fda90ad9ab38c366d8aa9218a05e19f81ef9da2c006fe5fe9b180258c"} May 21 15:01:30.641524 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.641497 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" event={"ID":"d9274d99-56ff-4d0a-b4d6-20c9d4dff627","Type":"ContainerStarted","Data":"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738"} May 21 15:01:30.641637 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.641561 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" podUID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" containerName="registry-server" containerID="cri-o://af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738" gracePeriod=2 May 21 15:01:30.658127 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.658076 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" podStartSLOduration=1.094811356 podStartE2EDuration="3.658061336s" podCreationTimestamp="2026-05-21 15:01:27 +0000 UTC" firstStartedPulling="2026-05-21 15:01:27.804733399 +0000 UTC m=+436.290630612" lastFinishedPulling="2026-05-21 15:01:30.367983379 +0000 UTC m=+438.853880592" observedRunningTime="2026-05-21 15:01:30.655504996 +0000 UTC m=+439.141402231" watchObservedRunningTime="2026-05-21 15:01:30.658061336 +0000 UTC m=+439.143958571" May 21 15:01:30.671762 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.671717 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" podStartSLOduration=1.529204231 podStartE2EDuration="4.671703919s" podCreationTimestamp="2026-05-21 15:01:26 +0000 UTC" firstStartedPulling="2026-05-21 15:01:27.228969582 +0000 UTC m=+435.714866795" lastFinishedPulling="2026-05-21 15:01:30.371469258 +0000 UTC m=+438.857366483" observedRunningTime="2026-05-21 15:01:30.670365794 +0000 UTC m=+439.156263247" watchObservedRunningTime="2026-05-21 15:01:30.671703919 +0000 UTC m=+439.157601202" May 21 15:01:30.895982 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.895924 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:30.979923 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.979884 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ghms\" (UniqueName: \"kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms\") pod \"d9274d99-56ff-4d0a-b4d6-20c9d4dff627\" (UID: \"d9274d99-56ff-4d0a-b4d6-20c9d4dff627\") " May 21 15:01:30.982078 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:30.982054 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms" (OuterVolumeSpecName: "kube-api-access-6ghms") pod "d9274d99-56ff-4d0a-b4d6-20c9d4dff627" (UID: "d9274d99-56ff-4d0a-b4d6-20c9d4dff627"). InnerVolumeSpecName "kube-api-access-6ghms". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:01:31.081240 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.081206 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ghms\" (UniqueName: \"kubernetes.io/projected/d9274d99-56ff-4d0a-b4d6-20c9d4dff627-kube-api-access-6ghms\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:31.646515 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.646414 2559 generic.go:358] "Generic (PLEG): container finished" podID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" containerID="af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738" exitCode=0 May 21 15:01:31.646515 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.646478 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" May 21 15:01:31.646515 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.646504 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" event={"ID":"d9274d99-56ff-4d0a-b4d6-20c9d4dff627","Type":"ContainerDied","Data":"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738"} May 21 15:01:31.647106 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.646546 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l2lvd" event={"ID":"d9274d99-56ff-4d0a-b4d6-20c9d4dff627","Type":"ContainerDied","Data":"2aba672a6b5004d9f0a0952fbd1b2361d1d7cc533651c28e395ce80701c8aa59"} May 21 15:01:31.647106 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.646567 2559 scope.go:117] "RemoveContainer" containerID="af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738" May 21 15:01:31.655933 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.655908 2559 scope.go:117] "RemoveContainer" containerID="af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738" May 21 15:01:31.656208 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:01:31.656190 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738\": container with ID starting with af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738 not found: ID does not exist" containerID="af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738" May 21 15:01:31.656285 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.656218 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738"} err="failed to get container status \"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738\": rpc error: code = NotFound desc = could not find container \"af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738\": container with ID starting with af4925e037f96fc0f43274d9a96656ab41cb5b9f95554a7166b162e7735b6738 not found: ID does not exist" May 21 15:01:31.666974 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.666951 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:31.672955 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:31.672931 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l2lvd"] May 21 15:01:32.099660 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:32.099629 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" path="/var/lib/kubelet/pods/d9274d99-56ff-4d0a-b4d6-20c9d4dff627/volumes" May 21 15:01:37.674420 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:37.674379 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:37.674420 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:37.674427 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:37.696252 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:37.696228 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:38.692625 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:38.692587 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mzqk8" May 21 15:01:42.993077 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.993038 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx"] May 21 15:01:42.993453 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.993375 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" containerName="registry-server" May 21 15:01:42.993453 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.993387 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" containerName="registry-server" May 21 15:01:42.993453 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.993445 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9274d99-56ff-4d0a-b4d6-20c9d4dff627" containerName="registry-server" May 21 15:01:42.996967 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.996949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:42.999119 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:42.999101 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4fcgv\"" May 21 15:01:43.004605 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.004574 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx"] May 21 15:01:43.092428 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.092390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqlx\" (UniqueName: \"kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.092606 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.092494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.092606 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.092520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.193242 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.193201 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.193242 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.193241 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.193480 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.193314 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqlx\" (UniqueName: \"kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.193598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.193576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.193681 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.193658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.204277 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.204247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqlx\" (UniqueName: \"kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.307387 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.307341 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:43.444532 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.444505 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx"] May 21 15:01:43.446696 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:43.446656 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9741615e_974a_4441_baa2_a100c94e8e84.slice/crio-755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8 WatchSource:0}: Error finding container 755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8: Status 404 returned error can't find the container with id 755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8 May 21 15:01:43.593004 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.592930 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z"] May 21 15:01:43.595316 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.595299 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.605578 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.605551 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z"] May 21 15:01:43.691092 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.691058 2559 generic.go:358] "Generic (PLEG): container finished" podID="9741615e-974a-4441-baa2-a100c94e8e84" containerID="338cce28714312a5ae2b62a165beb98be88aaa7de45ff6d168a7916052bb674f" exitCode=0 May 21 15:01:43.691254 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.691108 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerDied","Data":"338cce28714312a5ae2b62a165beb98be88aaa7de45ff6d168a7916052bb674f"} May 21 15:01:43.691254 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.691129 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerStarted","Data":"755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8"} May 21 15:01:43.700327 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.700298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prf27\" (UniqueName: \"kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.700464 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.700354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.700464 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.700436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.801561 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.801523 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.801731 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.801568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.801731 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.801647 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prf27\" (UniqueName: \"kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.802064 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.802043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.802112 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.802045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.809369 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.809341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prf27\" (UniqueName: \"kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.919491 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.919412 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:43.996667 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:43.996634 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp"] May 21 15:01:44.000391 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.000365 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.007607 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.007575 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp"] May 21 15:01:44.054388 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.054354 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z"] May 21 15:01:44.057252 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:44.057230 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cf93fe_b5bd_4c83_870f_07f7447eea99.slice/crio-181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605 WatchSource:0}: Error finding container 181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605: Status 404 returned error can't find the container with id 181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605 May 21 15:01:44.104554 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.104533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.104609 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.104574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cq48\" (UniqueName: \"kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.104698 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.104678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.205639 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.205547 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.205639 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.205617 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.205872 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.205650 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cq48\" (UniqueName: \"kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.205938 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.205922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.206047 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.205994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.214926 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.214903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cq48\" (UniqueName: \"kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.312705 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.312669 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:44.394214 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.393832 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb"] May 21 15:01:44.398333 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.397046 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.408850 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.408821 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb"] May 21 15:01:44.450818 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.450790 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp"] May 21 15:01:44.453042 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:44.452994 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222a7346_b33f_44f3_9194_9593f899a360.slice/crio-f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff WatchSource:0}: Error finding container f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff: Status 404 returned error can't find the container with id f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff May 21 15:01:44.508265 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.508236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.508360 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.508279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.508400 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.508361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fbl\" (UniqueName: \"kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.609220 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.609184 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.609220 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.609226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.609470 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.609248 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fbl\" (UniqueName: \"kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.609619 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.609595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.609681 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.609628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.617922 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.617899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fbl\" (UniqueName: \"kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.697320 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.697279 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerStarted","Data":"47dfbeb8d57c07dd6847934b3689656600281e2feeb7824e1ab813e486b462eb"} May 21 15:01:44.698873 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.698841 2559 generic.go:358] "Generic (PLEG): container finished" podID="222a7346-b33f-44f3-9194-9593f899a360" containerID="b7911bdb93da9c02a93d8a4e7f429bcde9b0abd93e05645de547bbd49dece594" exitCode=0 May 21 15:01:44.699000 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.698914 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" event={"ID":"222a7346-b33f-44f3-9194-9593f899a360","Type":"ContainerDied","Data":"b7911bdb93da9c02a93d8a4e7f429bcde9b0abd93e05645de547bbd49dece594"} May 21 15:01:44.699000 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.698945 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" event={"ID":"222a7346-b33f-44f3-9194-9593f899a360","Type":"ContainerStarted","Data":"f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff"} May 21 15:01:44.700491 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.700466 2559 generic.go:358] "Generic (PLEG): container finished" podID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerID="0a6d6f9631d091d16d448e9b3699a96c8823594a1675fe141c20a624a17f58cd" exitCode=0 May 21 15:01:44.700588 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.700513 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" event={"ID":"47cf93fe-b5bd-4c83-870f-07f7447eea99","Type":"ContainerDied","Data":"0a6d6f9631d091d16d448e9b3699a96c8823594a1675fe141c20a624a17f58cd"} May 21 15:01:44.700588 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.700536 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" event={"ID":"47cf93fe-b5bd-4c83-870f-07f7447eea99","Type":"ContainerStarted","Data":"181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605"} May 21 15:01:44.710681 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.710655 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:44.841649 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:44.841618 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb"] May 21 15:01:44.844216 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:01:44.844192 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b27f482_b7dc_4fe0_82f8_cff7456a5e01.slice/crio-7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3 WatchSource:0}: Error finding container 7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3: Status 404 returned error can't find the container with id 7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3 May 21 15:01:45.707046 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.706990 2559 generic.go:358] "Generic (PLEG): container finished" podID="222a7346-b33f-44f3-9194-9593f899a360" containerID="5b686ce3a9cc0314ee68c3ca898efe76e898d1b1c06ac33fb1392ead5db6e323" exitCode=0 May 21 15:01:45.707482 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.707045 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" event={"ID":"222a7346-b33f-44f3-9194-9593f899a360","Type":"ContainerDied","Data":"5b686ce3a9cc0314ee68c3ca898efe76e898d1b1c06ac33fb1392ead5db6e323"} May 21 15:01:45.708769 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.708703 2559 generic.go:358] "Generic (PLEG): container finished" podID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerID="defe870ac1ded9d69f7a471aa538d42578289aeb3d6615233af60ca83d213e7c" exitCode=0 May 21 15:01:45.708834 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.708786 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" event={"ID":"47cf93fe-b5bd-4c83-870f-07f7447eea99","Type":"ContainerDied","Data":"defe870ac1ded9d69f7a471aa538d42578289aeb3d6615233af60ca83d213e7c"} May 21 15:01:45.710156 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.710130 2559 generic.go:358] "Generic (PLEG): container finished" podID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerID="819868d9b81989432100371f3e4bd2583278cca1e8c4fba707f8389cd43dda4f" exitCode=0 May 21 15:01:45.710274 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.710158 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" event={"ID":"6b27f482-b7dc-4fe0-82f8-cff7456a5e01","Type":"ContainerDied","Data":"819868d9b81989432100371f3e4bd2583278cca1e8c4fba707f8389cd43dda4f"} May 21 15:01:45.710274 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.710181 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" event={"ID":"6b27f482-b7dc-4fe0-82f8-cff7456a5e01","Type":"ContainerStarted","Data":"7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3"} May 21 15:01:45.712404 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.712282 2559 generic.go:358] "Generic (PLEG): container finished" podID="9741615e-974a-4441-baa2-a100c94e8e84" containerID="47dfbeb8d57c07dd6847934b3689656600281e2feeb7824e1ab813e486b462eb" exitCode=0 May 21 15:01:45.712404 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:45.712350 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerDied","Data":"47dfbeb8d57c07dd6847934b3689656600281e2feeb7824e1ab813e486b462eb"} May 21 15:01:46.718189 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.718090 2559 generic.go:358] "Generic (PLEG): container finished" podID="9741615e-974a-4441-baa2-a100c94e8e84" containerID="b0b3bb35079bb2d809a4e7e763fdff57b6620e8f60eadc1f6117f6974013a14d" exitCode=0 May 21 15:01:46.718613 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.718188 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerDied","Data":"b0b3bb35079bb2d809a4e7e763fdff57b6620e8f60eadc1f6117f6974013a14d"} May 21 15:01:46.720115 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.720090 2559 generic.go:358] "Generic (PLEG): container finished" podID="222a7346-b33f-44f3-9194-9593f899a360" containerID="3fa6be5cf6454afb40d2a7800f4d8f64fcf12e7bd791b18f2b8b60d217a1ecbb" exitCode=0 May 21 15:01:46.720246 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.720153 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" event={"ID":"222a7346-b33f-44f3-9194-9593f899a360","Type":"ContainerDied","Data":"3fa6be5cf6454afb40d2a7800f4d8f64fcf12e7bd791b18f2b8b60d217a1ecbb"} May 21 15:01:46.721916 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.721891 2559 generic.go:358] "Generic (PLEG): container finished" podID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerID="fd01ca4af6df78add449abb53470db87b34d8af8e10c314a3c1eabfcc0186241" exitCode=0 May 21 15:01:46.722027 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.721966 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" event={"ID":"47cf93fe-b5bd-4c83-870f-07f7447eea99","Type":"ContainerDied","Data":"fd01ca4af6df78add449abb53470db87b34d8af8e10c314a3c1eabfcc0186241"} May 21 15:01:46.723509 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.723489 2559 generic.go:358] "Generic (PLEG): container finished" podID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerID="5071616d041d7c92bc2c31e8c83b752da3191e8347683843f8054dbb840b8a60" exitCode=0 May 21 15:01:46.723591 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:46.723520 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" event={"ID":"6b27f482-b7dc-4fe0-82f8-cff7456a5e01","Type":"ContainerDied","Data":"5071616d041d7c92bc2c31e8c83b752da3191e8347683843f8054dbb840b8a60"} May 21 15:01:47.729156 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:47.729124 2559 generic.go:358] "Generic (PLEG): container finished" podID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerID="5dd592185f90100cbe584a99e3803a60101925ac4ffdae016be33166e878f314" exitCode=0 May 21 15:01:47.729581 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:47.729204 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" event={"ID":"6b27f482-b7dc-4fe0-82f8-cff7456a5e01","Type":"ContainerDied","Data":"5dd592185f90100cbe584a99e3803a60101925ac4ffdae016be33166e878f314"} May 21 15:01:47.871327 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:47.871299 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:47.927258 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:47.927238 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:47.930323 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:47.930298 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:48.040137 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040098 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util\") pod \"9741615e-974a-4441-baa2-a100c94e8e84\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " May 21 15:01:48.040137 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040142 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util\") pod \"47cf93fe-b5bd-4c83-870f-07f7447eea99\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " May 21 15:01:48.040392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040161 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util\") pod \"222a7346-b33f-44f3-9194-9593f899a360\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " May 21 15:01:48.040392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040184 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle\") pod \"47cf93fe-b5bd-4c83-870f-07f7447eea99\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " May 21 15:01:48.040392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040230 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle\") pod \"9741615e-974a-4441-baa2-a100c94e8e84\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " May 21 15:01:48.040392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040318 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle\") pod \"222a7346-b33f-44f3-9194-9593f899a360\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " May 21 15:01:48.040392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040372 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nqlx\" (UniqueName: \"kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx\") pod \"9741615e-974a-4441-baa2-a100c94e8e84\" (UID: \"9741615e-974a-4441-baa2-a100c94e8e84\") " May 21 15:01:48.040627 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040415 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cq48\" (UniqueName: \"kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48\") pod \"222a7346-b33f-44f3-9194-9593f899a360\" (UID: \"222a7346-b33f-44f3-9194-9593f899a360\") " May 21 15:01:48.040983 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle" (OuterVolumeSpecName: "bundle") pod "222a7346-b33f-44f3-9194-9593f899a360" (UID: "222a7346-b33f-44f3-9194-9593f899a360"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.040983 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040855 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prf27\" (UniqueName: \"kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27\") pod \"47cf93fe-b5bd-4c83-870f-07f7447eea99\" (UID: \"47cf93fe-b5bd-4c83-870f-07f7447eea99\") " May 21 15:01:48.040983 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040954 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle" (OuterVolumeSpecName: "bundle") pod "47cf93fe-b5bd-4c83-870f-07f7447eea99" (UID: "47cf93fe-b5bd-4c83-870f-07f7447eea99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.040983 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.040951 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle" (OuterVolumeSpecName: "bundle") pod "9741615e-974a-4441-baa2-a100c94e8e84" (UID: "9741615e-974a-4441-baa2-a100c94e8e84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.041283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.041233 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.041283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.041253 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.041283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.041267 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.042880 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.042848 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27" (OuterVolumeSpecName: "kube-api-access-prf27") pod "47cf93fe-b5bd-4c83-870f-07f7447eea99" (UID: "47cf93fe-b5bd-4c83-870f-07f7447eea99"). InnerVolumeSpecName "kube-api-access-prf27". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:01:48.043220 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.042984 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48" (OuterVolumeSpecName: "kube-api-access-5cq48") pod "222a7346-b33f-44f3-9194-9593f899a360" (UID: "222a7346-b33f-44f3-9194-9593f899a360"). InnerVolumeSpecName "kube-api-access-5cq48". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:01:48.043220 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.043119 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx" (OuterVolumeSpecName: "kube-api-access-5nqlx") pod "9741615e-974a-4441-baa2-a100c94e8e84" (UID: "9741615e-974a-4441-baa2-a100c94e8e84"). InnerVolumeSpecName "kube-api-access-5nqlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:01:48.046234 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.046211 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util" (OuterVolumeSpecName: "util") pod "9741615e-974a-4441-baa2-a100c94e8e84" (UID: "9741615e-974a-4441-baa2-a100c94e8e84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.046316 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.046296 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util" (OuterVolumeSpecName: "util") pod "47cf93fe-b5bd-4c83-870f-07f7447eea99" (UID: "47cf93fe-b5bd-4c83-870f-07f7447eea99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.046664 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.046647 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util" (OuterVolumeSpecName: "util") pod "222a7346-b33f-44f3-9194-9593f899a360" (UID: "222a7346-b33f-44f3-9194-9593f899a360"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.141698 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141664 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nqlx\" (UniqueName: \"kubernetes.io/projected/9741615e-974a-4441-baa2-a100c94e8e84-kube-api-access-5nqlx\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.141698 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141694 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cq48\" (UniqueName: \"kubernetes.io/projected/222a7346-b33f-44f3-9194-9593f899a360-kube-api-access-5cq48\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.141698 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141704 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prf27\" (UniqueName: \"kubernetes.io/projected/47cf93fe-b5bd-4c83-870f-07f7447eea99-kube-api-access-prf27\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.141910 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141713 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9741615e-974a-4441-baa2-a100c94e8e84-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.141910 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141723 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47cf93fe-b5bd-4c83-870f-07f7447eea99-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.141910 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.141731 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222a7346-b33f-44f3-9194-9593f899a360-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:48.734514 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.734476 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" event={"ID":"222a7346-b33f-44f3-9194-9593f899a360","Type":"ContainerDied","Data":"f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff"} May 21 15:01:48.734514 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.734513 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp" May 21 15:01:48.735023 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.734519 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f38f875cd5b58b56b39a497d97934c69bf570c631514cae3df31ad80049f29ff" May 21 15:01:48.736357 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.736319 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" event={"ID":"47cf93fe-b5bd-4c83-870f-07f7447eea99","Type":"ContainerDied","Data":"181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605"} May 21 15:01:48.736357 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.736351 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="181d41f31b908049398241fd65b71154cb7fbc9d7be02302aaf1dab7e4f27605" May 21 15:01:48.736357 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.736329 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z" May 21 15:01:48.738578 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.738461 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" event={"ID":"9741615e-974a-4441-baa2-a100c94e8e84","Type":"ContainerDied","Data":"755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8"} May 21 15:01:48.738578 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.738500 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="755104f14a506a3e2c8291d1d45d5f0b2cecbbff5cc113d173cedcfd6d833ce8" May 21 15:01:48.738769 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.738667 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx" May 21 15:01:48.868978 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.868958 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:01:48.947819 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.947768 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9fbl\" (UniqueName: \"kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl\") pod \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " May 21 15:01:48.948003 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.947865 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util\") pod \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " May 21 15:01:48.948075 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.948032 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle\") pod \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\" (UID: \"6b27f482-b7dc-4fe0-82f8-cff7456a5e01\") " May 21 15:01:48.948474 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.948448 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle" (OuterVolumeSpecName: "bundle") pod "6b27f482-b7dc-4fe0-82f8-cff7456a5e01" (UID: "6b27f482-b7dc-4fe0-82f8-cff7456a5e01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:48.949880 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.949858 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl" (OuterVolumeSpecName: "kube-api-access-c9fbl") pod "6b27f482-b7dc-4fe0-82f8-cff7456a5e01" (UID: "6b27f482-b7dc-4fe0-82f8-cff7456a5e01"). InnerVolumeSpecName "kube-api-access-c9fbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:01:48.955628 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:48.955585 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util" (OuterVolumeSpecName: "util") pod "6b27f482-b7dc-4fe0-82f8-cff7456a5e01" (UID: "6b27f482-b7dc-4fe0-82f8-cff7456a5e01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:01:49.049150 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.049116 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:49.049150 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.049150 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9fbl\" (UniqueName: \"kubernetes.io/projected/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-kube-api-access-c9fbl\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:49.049351 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.049162 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b27f482-b7dc-4fe0-82f8-cff7456a5e01-util\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:01:49.743442 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.743399 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" event={"ID":"6b27f482-b7dc-4fe0-82f8-cff7456a5e01","Type":"ContainerDied","Data":"7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3"} May 21 15:01:49.743442 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.743443 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a2031f2906cb494b95551564fdb58d23bdedeee467d4c8b1d8e1b4e6a7528e3" May 21 15:01:49.743850 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:01:49.743417 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb" May 21 15:02:01.193827 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.193788 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8"] May 21 15:02:01.194524 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194500 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="util" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194527 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="util" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194543 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="extract" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194551 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="extract" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194564 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="pull" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194573 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="pull" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194597 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="util" May 21 15:02:01.194608 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194605 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="util" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194617 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="util" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194625 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="util" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194636 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194644 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194654 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194662 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194672 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194680 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194691 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="util" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194700 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="util" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194711 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194719 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194729 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194737 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="pull" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194749 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194757 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194838 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9741615e-974a-4441-baa2-a100c94e8e84" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194851 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="222a7346-b33f-44f3-9194-9593f899a360" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194864 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6b27f482-b7dc-4fe0-82f8-cff7456a5e01" containerName="extract" May 21 15:02:01.194925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.194874 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="47cf93fe-b5bd-4c83-870f-07f7447eea99" containerName="extract" May 21 15:02:01.197144 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.197122 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.199644 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.199623 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-54j4h\"" May 21 15:02:01.207931 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.207908 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8"] May 21 15:02:01.356160 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.356119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjdh\" (UniqueName: \"kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.356345 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.356186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.457459 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.457369 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjdh\" (UniqueName: \"kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.457459 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.457437 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.457789 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.457771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.468366 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.468339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjdh\" (UniqueName: \"kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.508981 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.508951 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:01.648196 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.648163 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8"] May 21 15:02:01.650523 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:01.650496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf925849_47c0_4878_ab63_730f61bc85bc.slice/crio-7370a659ae8b2145ab14903d570a452e7bb39653ca435fc28c8306dfb10a3652 WatchSource:0}: Error finding container 7370a659ae8b2145ab14903d570a452e7bb39653ca435fc28c8306dfb10a3652: Status 404 returned error can't find the container with id 7370a659ae8b2145ab14903d570a452e7bb39653ca435fc28c8306dfb10a3652 May 21 15:02:01.789299 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:01.789259 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" event={"ID":"af925849-47c0-4878-ab63-730f61bc85bc","Type":"ContainerStarted","Data":"7370a659ae8b2145ab14903d570a452e7bb39653ca435fc28c8306dfb10a3652"} May 21 15:02:07.818096 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:07.817474 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" event={"ID":"af925849-47c0-4878-ab63-730f61bc85bc","Type":"ContainerStarted","Data":"139087142e48fb72a8dba6b09d170a76b0f0c23dfb20df7533677f3719bd4e36"} May 21 15:02:07.818599 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:07.818125 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:09.492952 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.492888 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" podStartSLOduration=3.235474434 podStartE2EDuration="8.492873103s" podCreationTimestamp="2026-05-21 15:02:01 +0000 UTC" firstStartedPulling="2026-05-21 15:02:01.652808907 +0000 UTC m=+470.138706120" lastFinishedPulling="2026-05-21 15:02:06.910207576 +0000 UTC m=+475.396104789" observedRunningTime="2026-05-21 15:02:07.840315623 +0000 UTC m=+476.326212858" watchObservedRunningTime="2026-05-21 15:02:09.492873103 +0000 UTC m=+477.978770339" May 21 15:02:09.493629 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.493517 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ns4m5"] May 21 15:02:09.495933 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.495913 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:09.499100 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.499069 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fj4vk\"" May 21 15:02:09.509767 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.509740 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ns4m5"] May 21 15:02:09.528198 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.528159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgjh\" (UniqueName: \"kubernetes.io/projected/ad3022bf-7ca5-40b9-8c53-92c4dd997e65-kube-api-access-bsgjh\") pod \"authorino-operator-657f44b778-ns4m5\" (UID: \"ad3022bf-7ca5-40b9-8c53-92c4dd997e65\") " pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:09.629482 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.629439 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgjh\" (UniqueName: \"kubernetes.io/projected/ad3022bf-7ca5-40b9-8c53-92c4dd997e65-kube-api-access-bsgjh\") pod \"authorino-operator-657f44b778-ns4m5\" (UID: \"ad3022bf-7ca5-40b9-8c53-92c4dd997e65\") " pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:09.641344 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.641305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgjh\" (UniqueName: \"kubernetes.io/projected/ad3022bf-7ca5-40b9-8c53-92c4dd997e65-kube-api-access-bsgjh\") pod \"authorino-operator-657f44b778-ns4m5\" (UID: \"ad3022bf-7ca5-40b9-8c53-92c4dd997e65\") " pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:09.806760 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.806722 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:09.945629 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:09.945597 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ns4m5"] May 21 15:02:09.947580 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:09.947552 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3022bf_7ca5_40b9_8c53_92c4dd997e65.slice/crio-8faa3b760432488c30744d7a83dc2234f8b9b0c0b67e7efff696e18162e937c9 WatchSource:0}: Error finding container 8faa3b760432488c30744d7a83dc2234f8b9b0c0b67e7efff696e18162e937c9: Status 404 returned error can't find the container with id 8faa3b760432488c30744d7a83dc2234f8b9b0c0b67e7efff696e18162e937c9 May 21 15:02:10.833142 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:10.833086 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" event={"ID":"ad3022bf-7ca5-40b9-8c53-92c4dd997e65","Type":"ContainerStarted","Data":"8faa3b760432488c30744d7a83dc2234f8b9b0c0b67e7efff696e18162e937c9"} May 21 15:02:12.844123 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:12.844087 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" event={"ID":"ad3022bf-7ca5-40b9-8c53-92c4dd997e65","Type":"ContainerStarted","Data":"e6b69ccc5e95788e9f4879a37820d829c1b12d8dedaea6c5819e8d00c240b2c8"} May 21 15:02:12.844517 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:12.844186 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:12.886175 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:12.886107 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" podStartSLOduration=1.730904386 podStartE2EDuration="3.886092081s" podCreationTimestamp="2026-05-21 15:02:09 +0000 UTC" firstStartedPulling="2026-05-21 15:02:09.949627468 +0000 UTC m=+478.435524696" lastFinishedPulling="2026-05-21 15:02:12.104815179 +0000 UTC m=+480.590712391" observedRunningTime="2026-05-21 15:02:12.885172758 +0000 UTC m=+481.371069993" watchObservedRunningTime="2026-05-21 15:02:12.886092081 +0000 UTC m=+481.371989315" May 21 15:02:18.823848 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:18.823807 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:20.719305 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.719270 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8"] May 21 15:02:20.719754 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.719484 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" podUID="af925849-47c0-4878-ab63-730f61bc85bc" containerName="manager" containerID="cri-o://139087142e48fb72a8dba6b09d170a76b0f0c23dfb20df7533677f3719bd4e36" gracePeriod=2 May 21 15:02:20.725363 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.725332 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8"] May 21 15:02:20.744997 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.744963 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:20.745327 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.745312 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af925849-47c0-4878-ab63-730f61bc85bc" containerName="manager" May 21 15:02:20.745327 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.745328 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="af925849-47c0-4878-ab63-730f61bc85bc" containerName="manager" May 21 15:02:20.745467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.745405 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="af925849-47c0-4878-ab63-730f61bc85bc" containerName="manager" May 21 15:02:20.747993 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.747971 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.750336 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.750306 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:20.762507 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.762476 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:20.830220 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.830186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.830385 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.830327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtcx5\" (UniqueName: \"kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.883259 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.883228 2559 generic.go:358] "Generic (PLEG): container finished" podID="af925849-47c0-4878-ab63-730f61bc85bc" containerID="139087142e48fb72a8dba6b09d170a76b0f0c23dfb20df7533677f3719bd4e36" exitCode=0 May 21 15:02:20.931491 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.931449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtcx5\" (UniqueName: \"kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.931666 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.931553 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.931949 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.931929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.940338 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.940307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtcx5\" (UniqueName: \"kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2ns4p\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:20.972614 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.972553 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:20.974694 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:20.974635 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:21.032309 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.032271 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume\") pod \"af925849-47c0-4878-ab63-730f61bc85bc\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " May 21 15:02:21.032488 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.032396 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxjdh\" (UniqueName: \"kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh\") pod \"af925849-47c0-4878-ab63-730f61bc85bc\" (UID: \"af925849-47c0-4878-ab63-730f61bc85bc\") " May 21 15:02:21.032720 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.032699 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "af925849-47c0-4878-ab63-730f61bc85bc" (UID: "af925849-47c0-4878-ab63-730f61bc85bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:02:21.034547 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.034522 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh" (OuterVolumeSpecName: "kube-api-access-dxjdh") pod "af925849-47c0-4878-ab63-730f61bc85bc" (UID: "af925849-47c0-4878-ab63-730f61bc85bc"). InnerVolumeSpecName "kube-api-access-dxjdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:02:21.108292 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.108255 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:21.133320 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.133292 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxjdh\" (UniqueName: \"kubernetes.io/projected/af925849-47c0-4878-ab63-730f61bc85bc-kube-api-access-dxjdh\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:21.133320 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.133320 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af925849-47c0-4878-ab63-730f61bc85bc-extensions-socket-volume\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:21.252191 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.252161 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:21.253866 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:21.253838 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b483421_ccfc_4949_8331_db324c7605b3.slice/crio-02e723ddd96a416c817c833a410873b66044b53427fb28b8d67d4b53d8e6b68c WatchSource:0}: Error finding container 02e723ddd96a416c817c833a410873b66044b53427fb28b8d67d4b53d8e6b68c: Status 404 returned error can't find the container with id 02e723ddd96a416c817c833a410873b66044b53427fb28b8d67d4b53d8e6b68c May 21 15:02:21.888295 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.888258 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" May 21 15:02:21.888760 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.888270 2559 scope.go:117] "RemoveContainer" containerID="139087142e48fb72a8dba6b09d170a76b0f0c23dfb20df7533677f3719bd4e36" May 21 15:02:21.889935 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.889906 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" event={"ID":"9b483421-ccfc-4949-8331-db324c7605b3","Type":"ContainerStarted","Data":"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891"} May 21 15:02:21.890044 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.889948 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" event={"ID":"9b483421-ccfc-4949-8331-db324c7605b3","Type":"ContainerStarted","Data":"02e723ddd96a416c817c833a410873b66044b53427fb28b8d67d4b53d8e6b68c"} May 21 15:02:21.890102 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.890047 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:21.890502 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.890476 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:21.892162 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.892138 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:21.913509 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.913473 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:21.914269 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:21.914221 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" podStartSLOduration=1.914204171 podStartE2EDuration="1.914204171s" podCreationTimestamp="2026-05-21 15:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:02:21.911629517 +0000 UTC m=+490.397526755" watchObservedRunningTime="2026-05-21 15:02:21.914204171 +0000 UTC m=+490.400101407" May 21 15:02:22.099566 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:22.099528 2559 status_manager.go:895] "Failed to get status for pod" podUID="af925849-47c0-4878-ab63-730f61bc85bc" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bbrg8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-bbrg8\" is forbidden: User \"system:node:ip-10-0-143-65.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-65.ec2.internal' and this object" May 21 15:02:22.099766 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:22.099709 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af925849-47c0-4878-ab63-730f61bc85bc" path="/var/lib/kubelet/pods/af925849-47c0-4878-ab63-730f61bc85bc/volumes" May 21 15:02:22.997686 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:22.997651 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75cd94f5f6-gk5z6"] May 21 15:02:23.001024 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.000994 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.013974 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.013943 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cd94f5f6-gk5z6"] May 21 15:02:23.051643 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051643 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-service-ca\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-oauth-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk99j\" (UniqueName: \"kubernetes.io/projected/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-kube-api-access-gk99j\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-oauth-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.051866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.051848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-trusted-ca-bundle\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153321 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153286 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-service-ca\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153501 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-oauth-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153501 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153364 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk99j\" (UniqueName: \"kubernetes.io/projected/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-kube-api-access-gk99j\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153501 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153630 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153522 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-oauth-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153630 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-trusted-ca-bundle\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.153723 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.153661 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.154217 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.154191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-service-ca\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.154352 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.154269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-oauth-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.154352 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.154335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.154481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.154460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-trusted-ca-bundle\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.156192 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.156167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-serving-cert\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.156305 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.156170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-console-oauth-config\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.167332 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.167302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk99j\" (UniqueName: \"kubernetes.io/projected/7f82de6b-74b4-4dbb-bed3-5a8865ec849c-kube-api-access-gk99j\") pod \"console-75cd94f5f6-gk5z6\" (UID: \"7f82de6b-74b4-4dbb-bed3-5a8865ec849c\") " pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.310227 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.310187 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:23.453797 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.453765 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75cd94f5f6-gk5z6"] May 21 15:02:23.455951 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:23.455916 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f82de6b_74b4_4dbb_bed3_5a8865ec849c.slice/crio-34e909194cffeb1a5bdf8ea98d016428cd6b1c154b4f766d514a7737ba262a36 WatchSource:0}: Error finding container 34e909194cffeb1a5bdf8ea98d016428cd6b1c154b4f766d514a7737ba262a36: Status 404 returned error can't find the container with id 34e909194cffeb1a5bdf8ea98d016428cd6b1c154b4f766d514a7737ba262a36 May 21 15:02:23.850368 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.850336 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-ns4m5" May 21 15:02:23.900303 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.900265 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cd94f5f6-gk5z6" event={"ID":"7f82de6b-74b4-4dbb-bed3-5a8865ec849c","Type":"ContainerStarted","Data":"8e025350b88504ef6ae417a7d69d045bba6528cbb972d4d00c81359caf8e7d46"} May 21 15:02:23.900303 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.900306 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75cd94f5f6-gk5z6" event={"ID":"7f82de6b-74b4-4dbb-bed3-5a8865ec849c","Type":"ContainerStarted","Data":"34e909194cffeb1a5bdf8ea98d016428cd6b1c154b4f766d514a7737ba262a36"} May 21 15:02:23.928085 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:23.928034 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75cd94f5f6-gk5z6" podStartSLOduration=1.9280040010000001 podStartE2EDuration="1.928004001s" podCreationTimestamp="2026-05-21 15:02:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:02:23.924936577 +0000 UTC m=+492.410833812" watchObservedRunningTime="2026-05-21 15:02:23.928004001 +0000 UTC m=+492.413901236" May 21 15:02:32.897234 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:32.897203 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:33.311002 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:33.310964 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:33.311223 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:33.311038 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:33.316421 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:33.316384 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:33.945284 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:33.945248 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75cd94f5f6-gk5z6" May 21 15:02:33.993743 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:33.993712 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 15:02:37.870312 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:37.870273 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:37.870767 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:37.870510 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" podUID="9b483421-ccfc-4949-8331-db324c7605b3" containerName="manager" containerID="cri-o://1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891" gracePeriod=10 May 21 15:02:38.134288 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.134184 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:38.290530 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.290493 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume\") pod \"9b483421-ccfc-4949-8331-db324c7605b3\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " May 21 15:02:38.290530 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.290536 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtcx5\" (UniqueName: \"kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5\") pod \"9b483421-ccfc-4949-8331-db324c7605b3\" (UID: \"9b483421-ccfc-4949-8331-db324c7605b3\") " May 21 15:02:38.290877 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.290854 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b483421-ccfc-4949-8331-db324c7605b3" (UID: "9b483421-ccfc-4949-8331-db324c7605b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:02:38.292676 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.292654 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5" (OuterVolumeSpecName: "kube-api-access-rtcx5") pod "9b483421-ccfc-4949-8331-db324c7605b3" (UID: "9b483421-ccfc-4949-8331-db324c7605b3"). InnerVolumeSpecName "kube-api-access-rtcx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:02:38.391695 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.391609 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b483421-ccfc-4949-8331-db324c7605b3-extensions-socket-volume\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:38.391695 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.391646 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtcx5\" (UniqueName: \"kubernetes.io/projected/9b483421-ccfc-4949-8331-db324c7605b3-kube-api-access-rtcx5\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:38.965852 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.965817 2559 generic.go:358] "Generic (PLEG): container finished" podID="9b483421-ccfc-4949-8331-db324c7605b3" containerID="1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891" exitCode=0 May 21 15:02:38.966358 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.965890 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" May 21 15:02:38.966358 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.965900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" event={"ID":"9b483421-ccfc-4949-8331-db324c7605b3","Type":"ContainerDied","Data":"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891"} May 21 15:02:38.966358 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.965939 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p" event={"ID":"9b483421-ccfc-4949-8331-db324c7605b3","Type":"ContainerDied","Data":"02e723ddd96a416c817c833a410873b66044b53427fb28b8d67d4b53d8e6b68c"} May 21 15:02:38.966358 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.965954 2559 scope.go:117] "RemoveContainer" containerID="1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891" May 21 15:02:38.974986 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.974970 2559 scope.go:117] "RemoveContainer" containerID="1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891" May 21 15:02:38.975311 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:02:38.975291 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891\": container with ID starting with 1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891 not found: ID does not exist" containerID="1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891" May 21 15:02:38.975383 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.975320 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891"} err="failed to get container status \"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891\": rpc error: code = NotFound desc = could not find container \"1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891\": container with ID starting with 1e5d8e9bdef1272260b442d9d159a3a5220e22788af5b35a93f1e37fb4312891 not found: ID does not exist" May 21 15:02:38.988808 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.988776 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:38.995716 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:38.995688 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2ns4p"] May 21 15:02:40.099664 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:40.099626 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b483421-ccfc-4949-8331-db324c7605b3" path="/var/lib/kubelet/pods/9b483421-ccfc-4949-8331-db324c7605b3/volumes" May 21 15:02:54.089559 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.089524 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm"] May 21 15:02:54.090036 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.089864 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b483421-ccfc-4949-8331-db324c7605b3" containerName="manager" May 21 15:02:54.090036 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.089877 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b483421-ccfc-4949-8331-db324c7605b3" containerName="manager" May 21 15:02:54.090036 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.089952 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b483421-ccfc-4949-8331-db324c7605b3" containerName="manager" May 21 15:02:54.095394 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.095362 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.097729 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.097709 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h8trf\"" May 21 15:02:54.106353 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.106322 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm"] May 21 15:02:54.127852 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.127822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.127985 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.127865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.127985 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.127887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.127985 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.127950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.128128 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.128002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.128128 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.128055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.128128 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.128076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.128226 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.128130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z6xf\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-kube-api-access-7z6xf\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.128226 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.128168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229263 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229225 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229278 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229310 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229329 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229359 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229383 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229451 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229423 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z6xf\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-kube-api-access-7z6xf\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229740 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229740 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229515 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229842 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229842 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229835 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.229976 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.229950 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.230134 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.230113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.230201 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.230173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.231956 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.231926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.232116 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.232096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.239974 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.239953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z6xf\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-kube-api-access-7z6xf\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.240222 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.240202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1353882d-a5c6-46c5-90cf-a6a82e1dec82-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fm9dm\" (UID: \"1353882d-a5c6-46c5-90cf-a6a82e1dec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.409544 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.409445 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:54.550456 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.549580 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm"] May 21 15:02:54.551638 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.550751 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:02:54.551638 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.550883 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:02:54.551638 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:54.550991 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 15:02:55.029723 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:55.029688 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" event={"ID":"1353882d-a5c6-46c5-90cf-a6a82e1dec82","Type":"ContainerStarted","Data":"48c39b255f69daa7b1b5814e5810d1513c2766dd67538c9723dcfc5fad21b98e"} May 21 15:02:55.029723 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:55.029728 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" event={"ID":"1353882d-a5c6-46c5-90cf-a6a82e1dec82","Type":"ContainerStarted","Data":"a415e2431959ae62c0efd90998b9bb9f54a4b13e87ba76db2eb5e32e680ba72b"} May 21 15:02:55.048847 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:55.048787 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" podStartSLOduration=1.048773204 podStartE2EDuration="1.048773204s" podCreationTimestamp="2026-05-21 15:02:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:02:55.046545283 +0000 UTC m=+523.532442518" watchObservedRunningTime="2026-05-21 15:02:55.048773204 +0000 UTC m=+523.534670439" May 21 15:02:55.409836 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:55.409791 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:55.414714 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:55.414685 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:56.034177 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:56.034135 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:56.035316 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:56.035292 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fm9dm" May 21 15:02:58.411934 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.411897 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:02:58.414365 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.414348 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.416631 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.416608 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 15:02:58.416753 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.416610 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4fcgv\"" May 21 15:02:58.424703 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.424680 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:02:58.471424 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.471378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.471424 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.471422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8pdt\" (UniqueName: \"kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.509960 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.509924 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:02:58.572162 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.572126 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.572162 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.572164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8pdt\" (UniqueName: \"kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.572881 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.572862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.580112 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.580081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8pdt\" (UniqueName: \"kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt\") pod \"limitador-limitador-7d549b5b-wr4qh\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.726143 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.726052 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:02:58.860645 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:58.860615 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:02:58.862523 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:58.862496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76bd828_d098_4c12_8678_29b0f82e72cf.slice/crio-57a700dffd99f2ab50c375cc360ef6a9b0ba47c4a8e18ce6175e2f2e213c3866 WatchSource:0}: Error finding container 57a700dffd99f2ab50c375cc360ef6a9b0ba47c4a8e18ce6175e2f2e213c3866: Status 404 returned error can't find the container with id 57a700dffd99f2ab50c375cc360ef6a9b0ba47c4a8e18ce6175e2f2e213c3866 May 21 15:02:59.019342 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.019253 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84b4586896-xwhqg" podUID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" containerName="console" containerID="cri-o://dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8" gracePeriod=15 May 21 15:02:59.046037 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.045983 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" event={"ID":"a76bd828-d098-4c12-8678-29b0f82e72cf","Type":"ContainerStarted","Data":"57a700dffd99f2ab50c375cc360ef6a9b0ba47c4a8e18ce6175e2f2e213c3866"} May 21 15:02:59.216389 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.216359 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:02:59.218861 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.218841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:02:59.221336 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.221318 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gg8sc\"" May 21 15:02:59.227155 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.227130 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:02:59.253568 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.253545 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84b4586896-xwhqg_d05ceada-c926-4f28-9cd4-17e0694dc4eb/console/0.log" May 21 15:02:59.253694 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.253603 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b4586896-xwhqg" May 21 15:02:59.279505 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279411 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279505 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279494 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279721 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279534 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279721 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279652 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxvzn\" (UniqueName: \"kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279721 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279691 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279721 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279716 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279939 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279752 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config\") pod \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\" (UID: \"d05ceada-c926-4f28-9cd4-17e0694dc4eb\") " May 21 15:02:59.279996 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbkz\" (UniqueName: \"kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz\") pod \"authorino-f99f4b5cd-sg444\" (UID: \"93b59802-1aed-4678-b528-1e97f1642d74\") " pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:02:59.279996 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279973 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:02:59.280126 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.279981 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:02:59.280185 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.280162 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-trusted-ca-bundle\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.280185 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.280181 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-oauth-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.280431 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.280406 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config" (OuterVolumeSpecName: "console-config") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:02:59.280520 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.280481 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:02:59.281954 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.281931 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:02:59.282270 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.282252 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:02:59.282347 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.282324 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn" (OuterVolumeSpecName: "kube-api-access-cxvzn") pod "d05ceada-c926-4f28-9cd4-17e0694dc4eb" (UID: "d05ceada-c926-4f28-9cd4-17e0694dc4eb"). InnerVolumeSpecName "kube-api-access-cxvzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:02:59.381321 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381277 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whbkz\" (UniqueName: \"kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz\") pod \"authorino-f99f4b5cd-sg444\" (UID: \"93b59802-1aed-4678-b528-1e97f1642d74\") " pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:02:59.381481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381396 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.381481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381409 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d05ceada-c926-4f28-9cd4-17e0694dc4eb-service-ca\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.381481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381417 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-oauth-config\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.381481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381428 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d05ceada-c926-4f28-9cd4-17e0694dc4eb-console-serving-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.381481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.381437 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxvzn\" (UniqueName: \"kubernetes.io/projected/d05ceada-c926-4f28-9cd4-17e0694dc4eb-kube-api-access-cxvzn\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:02:59.389697 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.389668 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbkz\" (UniqueName: \"kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz\") pod \"authorino-f99f4b5cd-sg444\" (UID: \"93b59802-1aed-4678-b528-1e97f1642d74\") " pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:02:59.423198 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.423164 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:02:59.423598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.423560 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" containerName="console" May 21 15:02:59.423598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.423578 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" containerName="console" May 21 15:02:59.423685 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.423651 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" containerName="console" May 21 15:02:59.426541 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.426520 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:02:59.434269 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.434246 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:02:59.482712 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.482676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tss6r\" (UniqueName: \"kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r\") pod \"authorino-7498df8756-78mnd\" (UID: \"bced50b8-41c1-476b-966b-d3e541971700\") " pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:02:59.531800 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.531502 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:02:59.584483 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.584438 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tss6r\" (UniqueName: \"kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r\") pod \"authorino-7498df8756-78mnd\" (UID: \"bced50b8-41c1-476b-966b-d3e541971700\") " pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:02:59.594462 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.594436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tss6r\" (UniqueName: \"kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r\") pod \"authorino-7498df8756-78mnd\" (UID: \"bced50b8-41c1-476b-966b-d3e541971700\") " pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:02:59.706540 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.706496 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:02:59.736343 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.736302 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:02:59.912838 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:02:59.912812 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:02:59.914652 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:02:59.914608 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbced50b8_41c1_476b_966b_d3e541971700.slice/crio-4df86a871bb511f930d1315b6a2d21fa1f14629c71fe0d5516f61964ee8aab81 WatchSource:0}: Error finding container 4df86a871bb511f930d1315b6a2d21fa1f14629c71fe0d5516f61964ee8aab81: Status 404 returned error can't find the container with id 4df86a871bb511f930d1315b6a2d21fa1f14629c71fe0d5516f61964ee8aab81 May 21 15:03:00.051971 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.051930 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sg444" event={"ID":"93b59802-1aed-4678-b528-1e97f1642d74","Type":"ContainerStarted","Data":"f02102a2fcdcc5c30b5d20bf1a72bfc93babaaae527ffc8ef4ec2da66f8c4343"} May 21 15:03:00.053234 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.053161 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-78mnd" event={"ID":"bced50b8-41c1-476b-966b-d3e541971700","Type":"ContainerStarted","Data":"4df86a871bb511f930d1315b6a2d21fa1f14629c71fe0d5516f61964ee8aab81"} May 21 15:03:00.054678 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054661 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84b4586896-xwhqg_d05ceada-c926-4f28-9cd4-17e0694dc4eb/console/0.log" May 21 15:03:00.054792 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054702 2559 generic.go:358] "Generic (PLEG): container finished" podID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" containerID="dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8" exitCode=2 May 21 15:03:00.054792 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054747 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b4586896-xwhqg" event={"ID":"d05ceada-c926-4f28-9cd4-17e0694dc4eb","Type":"ContainerDied","Data":"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8"} May 21 15:03:00.054792 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054771 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b4586896-xwhqg" event={"ID":"d05ceada-c926-4f28-9cd4-17e0694dc4eb","Type":"ContainerDied","Data":"5f66867d2f907d0eb5d6013db6292f43a56d34264ee9d9abcd022dd9e5626eee"} May 21 15:03:00.054957 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054791 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b4586896-xwhqg" May 21 15:03:00.054957 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.054795 2559 scope.go:117] "RemoveContainer" containerID="dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8" May 21 15:03:00.066230 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.066207 2559 scope.go:117] "RemoveContainer" containerID="dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8" May 21 15:03:00.066517 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:00.066492 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8\": container with ID starting with dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8 not found: ID does not exist" containerID="dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8" May 21 15:03:00.066609 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.066529 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8"} err="failed to get container status \"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8\": rpc error: code = NotFound desc = could not find container \"dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8\": container with ID starting with dab37c1485120759c3aaa1d9dd44ca9b768404d2b40d12b14b37cb9fbd0ed6d8 not found: ID does not exist" May 21 15:03:00.080397 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.080364 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 15:03:00.083481 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.083459 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b4586896-xwhqg"] May 21 15:03:00.100135 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:00.100105 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05ceada-c926-4f28-9cd4-17e0694dc4eb" path="/var/lib/kubelet/pods/d05ceada-c926-4f28-9cd4-17e0694dc4eb/volumes" May 21 15:03:02.068371 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:02.068266 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" event={"ID":"a76bd828-d098-4c12-8678-29b0f82e72cf","Type":"ContainerStarted","Data":"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456"} May 21 15:03:02.068837 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:02.068545 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:03:02.088034 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:02.086295 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" podStartSLOduration=1.048052635 podStartE2EDuration="4.086275253s" podCreationTimestamp="2026-05-21 15:02:58 +0000 UTC" firstStartedPulling="2026-05-21 15:02:58.864374111 +0000 UTC m=+527.350271325" lastFinishedPulling="2026-05-21 15:03:01.902596723 +0000 UTC m=+530.388493943" observedRunningTime="2026-05-21 15:03:02.083910103 +0000 UTC m=+530.569807338" watchObservedRunningTime="2026-05-21 15:03:02.086275253 +0000 UTC m=+530.572172488" May 21 15:03:05.082991 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:05.082952 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-78mnd" event={"ID":"bced50b8-41c1-476b-966b-d3e541971700","Type":"ContainerStarted","Data":"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d"} May 21 15:03:05.084334 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:05.084299 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sg444" event={"ID":"93b59802-1aed-4678-b528-1e97f1642d74","Type":"ContainerStarted","Data":"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae"} May 21 15:03:05.099303 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:05.099256 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-78mnd" podStartSLOduration=1.876368356 podStartE2EDuration="6.099240745s" podCreationTimestamp="2026-05-21 15:02:59 +0000 UTC" firstStartedPulling="2026-05-21 15:02:59.916709043 +0000 UTC m=+528.402606261" lastFinishedPulling="2026-05-21 15:03:04.139581419 +0000 UTC m=+532.625478650" observedRunningTime="2026-05-21 15:03:05.097220381 +0000 UTC m=+533.583117616" watchObservedRunningTime="2026-05-21 15:03:05.099240745 +0000 UTC m=+533.585137979" May 21 15:03:05.112956 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:05.112905 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-sg444" podStartSLOduration=1.696547279 podStartE2EDuration="6.112891461s" podCreationTimestamp="2026-05-21 15:02:59 +0000 UTC" firstStartedPulling="2026-05-21 15:02:59.710594053 +0000 UTC m=+528.196491272" lastFinishedPulling="2026-05-21 15:03:04.126938233 +0000 UTC m=+532.612835454" observedRunningTime="2026-05-21 15:03:05.110054947 +0000 UTC m=+533.595952186" watchObservedRunningTime="2026-05-21 15:03:05.112891461 +0000 UTC m=+533.598788696" May 21 15:03:05.140099 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:05.140066 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:03:07.091085 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:07.090998 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-sg444" podUID="93b59802-1aed-4678-b528-1e97f1642d74" containerName="authorino" containerID="cri-o://41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae" gracePeriod=30 May 21 15:03:07.353959 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:07.353884 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:03:07.466296 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:07.466249 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whbkz\" (UniqueName: \"kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz\") pod \"93b59802-1aed-4678-b528-1e97f1642d74\" (UID: \"93b59802-1aed-4678-b528-1e97f1642d74\") " May 21 15:03:07.468394 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:07.468370 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz" (OuterVolumeSpecName: "kube-api-access-whbkz") pod "93b59802-1aed-4678-b528-1e97f1642d74" (UID: "93b59802-1aed-4678-b528-1e97f1642d74"). InnerVolumeSpecName "kube-api-access-whbkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:07.567834 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:07.567796 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whbkz\" (UniqueName: \"kubernetes.io/projected/93b59802-1aed-4678-b528-1e97f1642d74-kube-api-access-whbkz\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:08.096321 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.096281 2559 generic.go:358] "Generic (PLEG): container finished" podID="93b59802-1aed-4678-b528-1e97f1642d74" containerID="41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae" exitCode=0 May 21 15:03:08.096802 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.096370 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sg444" May 21 15:03:08.098730 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.098704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sg444" event={"ID":"93b59802-1aed-4678-b528-1e97f1642d74","Type":"ContainerDied","Data":"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae"} May 21 15:03:08.098730 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.098731 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sg444" event={"ID":"93b59802-1aed-4678-b528-1e97f1642d74","Type":"ContainerDied","Data":"f02102a2fcdcc5c30b5d20bf1a72bfc93babaaae527ffc8ef4ec2da66f8c4343"} May 21 15:03:08.098928 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.098747 2559 scope.go:117] "RemoveContainer" containerID="41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae" May 21 15:03:08.108555 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.108532 2559 scope.go:117] "RemoveContainer" containerID="41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae" May 21 15:03:08.108814 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:08.108795 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae\": container with ID starting with 41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae not found: ID does not exist" containerID="41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae" May 21 15:03:08.108874 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.108822 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae"} err="failed to get container status \"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae\": rpc error: code = NotFound desc = could not find container \"41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae\": container with ID starting with 41c8d50ed0be7eca9f7064d75924994d80b1786e39c2356abb289d4007b755ae not found: ID does not exist" May 21 15:03:08.120409 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.120379 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:03:08.127058 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:08.127025 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sg444"] May 21 15:03:10.099767 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:10.099723 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b59802-1aed-4678-b528-1e97f1642d74" path="/var/lib/kubelet/pods/93b59802-1aed-4678-b528-1e97f1642d74/volumes" May 21 15:03:12.916211 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:12.916173 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:03:12.916689 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:12.916418 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" podUID="a76bd828-d098-4c12-8678-29b0f82e72cf" containerName="limitador" containerID="cri-o://cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456" gracePeriod=30 May 21 15:03:12.917058 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:12.917033 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:03:13.869681 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:13.869653 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:03:13.923296 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:13.923263 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8pdt\" (UniqueName: \"kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt\") pod \"a76bd828-d098-4c12-8678-29b0f82e72cf\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " May 21 15:03:13.923664 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:13.923393 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file\") pod \"a76bd828-d098-4c12-8678-29b0f82e72cf\" (UID: \"a76bd828-d098-4c12-8678-29b0f82e72cf\") " May 21 15:03:13.923735 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:13.923713 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file" (OuterVolumeSpecName: "config-file") pod "a76bd828-d098-4c12-8678-29b0f82e72cf" (UID: "a76bd828-d098-4c12-8678-29b0f82e72cf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:03:13.925290 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:13.925268 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt" (OuterVolumeSpecName: "kube-api-access-q8pdt") pod "a76bd828-d098-4c12-8678-29b0f82e72cf" (UID: "a76bd828-d098-4c12-8678-29b0f82e72cf"). InnerVolumeSpecName "kube-api-access-q8pdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:14.024863 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.024769 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a76bd828-d098-4c12-8678-29b0f82e72cf-config-file\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:14.024863 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.024806 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8pdt\" (UniqueName: \"kubernetes.io/projected/a76bd828-d098-4c12-8678-29b0f82e72cf-kube-api-access-q8pdt\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:14.120904 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.120865 2559 generic.go:358] "Generic (PLEG): container finished" podID="a76bd828-d098-4c12-8678-29b0f82e72cf" containerID="cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456" exitCode=0 May 21 15:03:14.121091 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.120923 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" May 21 15:03:14.121091 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.120961 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" event={"ID":"a76bd828-d098-4c12-8678-29b0f82e72cf","Type":"ContainerDied","Data":"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456"} May 21 15:03:14.121091 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.121002 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-wr4qh" event={"ID":"a76bd828-d098-4c12-8678-29b0f82e72cf","Type":"ContainerDied","Data":"57a700dffd99f2ab50c375cc360ef6a9b0ba47c4a8e18ce6175e2f2e213c3866"} May 21 15:03:14.121091 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.121040 2559 scope.go:117] "RemoveContainer" containerID="cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456" May 21 15:03:14.129509 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.129490 2559 scope.go:117] "RemoveContainer" containerID="cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456" May 21 15:03:14.129772 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:14.129754 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456\": container with ID starting with cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456 not found: ID does not exist" containerID="cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456" May 21 15:03:14.129830 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.129777 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456"} err="failed to get container status \"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456\": rpc error: code = NotFound desc = could not find container \"cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456\": container with ID starting with cee6178ad337b37157e23c89446134ba2160c6b173ce5cda0c3570b53b98b456 not found: ID does not exist" May 21 15:03:14.137559 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.137531 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:03:14.144087 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.144064 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-wr4qh"] May 21 15:03:14.524598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.524558 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-z7rbc"] May 21 15:03:14.525081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525060 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b59802-1aed-4678-b528-1e97f1642d74" containerName="authorino" May 21 15:03:14.525081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525081 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b59802-1aed-4678-b528-1e97f1642d74" containerName="authorino" May 21 15:03:14.525285 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525098 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76bd828-d098-4c12-8678-29b0f82e72cf" containerName="limitador" May 21 15:03:14.525285 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525107 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76bd828-d098-4c12-8678-29b0f82e72cf" containerName="limitador" May 21 15:03:14.525285 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525184 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a76bd828-d098-4c12-8678-29b0f82e72cf" containerName="limitador" May 21 15:03:14.525285 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.525197 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="93b59802-1aed-4678-b528-1e97f1642d74" containerName="authorino" May 21 15:03:14.528354 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.528332 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.530506 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.530481 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 15:03:14.530620 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.530553 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k4kmw\"" May 21 15:03:14.536989 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.536350 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-z7rbc"] May 21 15:03:14.630563 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.630529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-data\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.630756 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.630612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp44k\" (UniqueName: \"kubernetes.io/projected/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-kube-api-access-qp44k\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.732230 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.732193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-data\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.732230 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.732231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp44k\" (UniqueName: \"kubernetes.io/projected/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-kube-api-access-qp44k\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.732598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.732577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-data\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.739854 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.739831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp44k\" (UniqueName: \"kubernetes.io/projected/b1611eb4-af6d-4da2-b6c4-9917c3c9581b-kube-api-access-qp44k\") pod \"postgres-68c4fbbd6f-z7rbc\" (UID: \"b1611eb4-af6d-4da2-b6c4-9917c3c9581b\") " pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.841533 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.841492 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:14.971725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:14.971697 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-z7rbc"] May 21 15:03:14.973509 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:14.973483 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1611eb4_af6d_4da2_b6c4_9917c3c9581b.slice/crio-42f0aa12e029d89c5fb13af659c80eff7e3ff24dcf23bf8eaa0c008823549d25 WatchSource:0}: Error finding container 42f0aa12e029d89c5fb13af659c80eff7e3ff24dcf23bf8eaa0c008823549d25: Status 404 returned error can't find the container with id 42f0aa12e029d89c5fb13af659c80eff7e3ff24dcf23bf8eaa0c008823549d25 May 21 15:03:15.127154 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:15.127068 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" event={"ID":"b1611eb4-af6d-4da2-b6c4-9917c3c9581b","Type":"ContainerStarted","Data":"42f0aa12e029d89c5fb13af659c80eff7e3ff24dcf23bf8eaa0c008823549d25"} May 21 15:03:16.102783 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:16.102367 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76bd828-d098-4c12-8678-29b0f82e72cf" path="/var/lib/kubelet/pods/a76bd828-d098-4c12-8678-29b0f82e72cf/volumes" May 21 15:03:20.152459 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:20.152424 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" event={"ID":"b1611eb4-af6d-4da2-b6c4-9917c3c9581b","Type":"ContainerStarted","Data":"92b03444d7bcdf716ae8862a131267918e8cd283169984256b96efb90c6f0943"} May 21 15:03:20.152831 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:20.152501 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:20.168483 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:20.168430 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" podStartSLOduration=1.1279021519999999 podStartE2EDuration="6.168417001s" podCreationTimestamp="2026-05-21 15:03:14 +0000 UTC" firstStartedPulling="2026-05-21 15:03:14.975257223 +0000 UTC m=+543.461154437" lastFinishedPulling="2026-05-21 15:03:20.015772072 +0000 UTC m=+548.501669286" observedRunningTime="2026-05-21 15:03:20.166939992 +0000 UTC m=+548.652837229" watchObservedRunningTime="2026-05-21 15:03:20.168417001 +0000 UTC m=+548.654314236" May 21 15:03:26.185569 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.185535 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-z7rbc" May 21 15:03:26.745933 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.745894 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:26.751089 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.751066 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:26.757988 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.757963 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:26.848161 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.848125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgpn\" (UniqueName: \"kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn\") pod \"authorino-8b475cf9f-zjd4g\" (UID: \"6d7c9d41-55f8-4e04-89da-13c8f96a641b\") " pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:26.948682 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.948646 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgpn\" (UniqueName: \"kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn\") pod \"authorino-8b475cf9f-zjd4g\" (UID: \"6d7c9d41-55f8-4e04-89da-13c8f96a641b\") " pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:26.961504 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.961471 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgpn\" (UniqueName: \"kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn\") pod \"authorino-8b475cf9f-zjd4g\" (UID: \"6d7c9d41-55f8-4e04-89da-13c8f96a641b\") " pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:26.975189 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.975163 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:26.975437 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.975425 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:26.999396 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:26.999325 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-96dc7dbc7-z77ml"] May 21 15:03:27.004156 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.004132 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.008900 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.008872 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96dc7dbc7-z77ml"] May 21 15:03:27.102487 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.102456 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-96dc7dbc7-z77ml"] May 21 15:03:27.102756 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:27.102726 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7v8ln], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-96dc7dbc7-z77ml" podUID="70b4c9e4-86a7-430b-a7ce-df1383ed2b5d" May 21 15:03:27.140244 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.140213 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:27.141860 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:27.141830 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d7c9d41_55f8_4e04_89da_13c8f96a641b.slice/crio-ae2a531bcc1154b67c819679f9b0932db1c1cb90f758a58c73e83dfea15cab50 WatchSource:0}: Error finding container ae2a531bcc1154b67c819679f9b0932db1c1cb90f758a58c73e83dfea15cab50: Status 404 returned error can't find the container with id ae2a531bcc1154b67c819679f9b0932db1c1cb90f758a58c73e83dfea15cab50 May 21 15:03:27.146224 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.146203 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:03:27.150646 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.150623 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.150950 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.150930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v8ln\" (UniqueName: \"kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln\") pod \"authorino-96dc7dbc7-z77ml\" (UID: \"70b4c9e4-86a7-430b-a7ce-df1383ed2b5d\") " pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.153228 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.153212 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 15:03:27.162863 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.162840 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:03:27.181742 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.181720 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.181877 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.181753 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" event={"ID":"6d7c9d41-55f8-4e04-89da-13c8f96a641b","Type":"ContainerStarted","Data":"ae2a531bcc1154b67c819679f9b0932db1c1cb90f758a58c73e83dfea15cab50"} May 21 15:03:27.186108 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.186088 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.252359 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.252282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.252495 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.252399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v8ln\" (UniqueName: \"kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln\") pod \"authorino-96dc7dbc7-z77ml\" (UID: \"70b4c9e4-86a7-430b-a7ce-df1383ed2b5d\") " pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.252495 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.252432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9gd\" (UniqueName: \"kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.260458 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.260423 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v8ln\" (UniqueName: \"kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln\") pod \"authorino-96dc7dbc7-z77ml\" (UID: \"70b4c9e4-86a7-430b-a7ce-df1383ed2b5d\") " pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:27.353690 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.353660 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v8ln\" (UniqueName: \"kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln\") pod \"70b4c9e4-86a7-430b-a7ce-df1383ed2b5d\" (UID: \"70b4c9e4-86a7-430b-a7ce-df1383ed2b5d\") " May 21 15:03:27.353862 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.353823 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9gd\" (UniqueName: \"kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.353913 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.353882 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.355759 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.355731 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln" (OuterVolumeSpecName: "kube-api-access-7v8ln") pod "70b4c9e4-86a7-430b-a7ce-df1383ed2b5d" (UID: "70b4c9e4-86a7-430b-a7ce-df1383ed2b5d"). InnerVolumeSpecName "kube-api-access-7v8ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:27.356143 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.356127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.361005 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.360981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9gd\" (UniqueName: \"kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd\") pod \"authorino-78d8d8c4b5-ng26k\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.454460 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.454423 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v8ln\" (UniqueName: \"kubernetes.io/projected/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d-kube-api-access-7v8ln\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:27.460146 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.460120 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:03:27.613392 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:27.613349 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:03:27.615838 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:27.615797 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f629c28_7d27_41c0_a1b8_7ba09c8f58c3.slice/crio-ffd95d132d39824365ce344669ef3f7485489d28af96b114d80436a98194e581 WatchSource:0}: Error finding container ffd95d132d39824365ce344669ef3f7485489d28af96b114d80436a98194e581: Status 404 returned error can't find the container with id ffd95d132d39824365ce344669ef3f7485489d28af96b114d80436a98194e581 May 21 15:03:28.186802 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.186698 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" event={"ID":"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3","Type":"ContainerStarted","Data":"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6"} May 21 15:03:28.186802 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.186735 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" event={"ID":"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3","Type":"ContainerStarted","Data":"ffd95d132d39824365ce344669ef3f7485489d28af96b114d80436a98194e581"} May 21 15:03:28.188101 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.188072 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" podUID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" containerName="authorino" containerID="cri-o://4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106" gracePeriod=30 May 21 15:03:28.188101 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.188093 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" event={"ID":"6d7c9d41-55f8-4e04-89da-13c8f96a641b","Type":"ContainerStarted","Data":"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106"} May 21 15:03:28.188288 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.188083 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dc7dbc7-z77ml" May 21 15:03:28.202287 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.202225 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" podStartSLOduration=0.882210983 podStartE2EDuration="1.202209647s" podCreationTimestamp="2026-05-21 15:03:27 +0000 UTC" firstStartedPulling="2026-05-21 15:03:27.617294471 +0000 UTC m=+556.103191684" lastFinishedPulling="2026-05-21 15:03:27.937293134 +0000 UTC m=+556.423190348" observedRunningTime="2026-05-21 15:03:28.200956348 +0000 UTC m=+556.686853582" watchObservedRunningTime="2026-05-21 15:03:28.202209647 +0000 UTC m=+556.688106881" May 21 15:03:28.225229 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.225197 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-96dc7dbc7-z77ml"] May 21 15:03:28.228897 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.228856 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:03:28.229177 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.229149 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-78mnd" podUID="bced50b8-41c1-476b-966b-d3e541971700" containerName="authorino" containerID="cri-o://f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d" gracePeriod=30 May 21 15:03:28.231449 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.231419 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-96dc7dbc7-z77ml"] May 21 15:03:28.249624 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.249563 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" podStartSLOduration=1.9121097759999999 podStartE2EDuration="2.249543667s" podCreationTimestamp="2026-05-21 15:03:26 +0000 UTC" firstStartedPulling="2026-05-21 15:03:27.143228323 +0000 UTC m=+555.629125541" lastFinishedPulling="2026-05-21 15:03:27.480662219 +0000 UTC m=+555.966559432" observedRunningTime="2026-05-21 15:03:28.246321718 +0000 UTC m=+556.732218970" watchObservedRunningTime="2026-05-21 15:03:28.249543667 +0000 UTC m=+556.735440903" May 21 15:03:28.499275 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.499249 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:28.511966 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.511944 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:03:28.666927 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.666834 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpgpn\" (UniqueName: \"kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn\") pod \"6d7c9d41-55f8-4e04-89da-13c8f96a641b\" (UID: \"6d7c9d41-55f8-4e04-89da-13c8f96a641b\") " May 21 15:03:28.667136 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.666964 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tss6r\" (UniqueName: \"kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r\") pod \"bced50b8-41c1-476b-966b-d3e541971700\" (UID: \"bced50b8-41c1-476b-966b-d3e541971700\") " May 21 15:03:28.669117 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.669088 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn" (OuterVolumeSpecName: "kube-api-access-wpgpn") pod "6d7c9d41-55f8-4e04-89da-13c8f96a641b" (UID: "6d7c9d41-55f8-4e04-89da-13c8f96a641b"). InnerVolumeSpecName "kube-api-access-wpgpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:28.669219 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.669170 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r" (OuterVolumeSpecName: "kube-api-access-tss6r") pod "bced50b8-41c1-476b-966b-d3e541971700" (UID: "bced50b8-41c1-476b-966b-d3e541971700"). InnerVolumeSpecName "kube-api-access-tss6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:28.768618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.768536 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpgpn\" (UniqueName: \"kubernetes.io/projected/6d7c9d41-55f8-4e04-89da-13c8f96a641b-kube-api-access-wpgpn\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:28.768618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:28.768570 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tss6r\" (UniqueName: \"kubernetes.io/projected/bced50b8-41c1-476b-966b-d3e541971700-kube-api-access-tss6r\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:29.193202 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.193158 2559 generic.go:358] "Generic (PLEG): container finished" podID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" containerID="4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106" exitCode=0 May 21 15:03:29.193668 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.193230 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" May 21 15:03:29.193668 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.193241 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" event={"ID":"6d7c9d41-55f8-4e04-89da-13c8f96a641b","Type":"ContainerDied","Data":"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106"} May 21 15:03:29.193668 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.193288 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-zjd4g" event={"ID":"6d7c9d41-55f8-4e04-89da-13c8f96a641b","Type":"ContainerDied","Data":"ae2a531bcc1154b67c819679f9b0932db1c1cb90f758a58c73e83dfea15cab50"} May 21 15:03:29.193668 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.193310 2559 scope.go:117] "RemoveContainer" containerID="4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106" May 21 15:03:29.194581 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.194560 2559 generic.go:358] "Generic (PLEG): container finished" podID="bced50b8-41c1-476b-966b-d3e541971700" containerID="f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d" exitCode=0 May 21 15:03:29.194641 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.194616 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-78mnd" event={"ID":"bced50b8-41c1-476b-966b-d3e541971700","Type":"ContainerDied","Data":"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d"} May 21 15:03:29.194738 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.194660 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-78mnd" event={"ID":"bced50b8-41c1-476b-966b-d3e541971700","Type":"ContainerDied","Data":"4df86a871bb511f930d1315b6a2d21fa1f14629c71fe0d5516f61964ee8aab81"} May 21 15:03:29.194738 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.194626 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-78mnd" May 21 15:03:29.202584 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.202564 2559 scope.go:117] "RemoveContainer" containerID="4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106" May 21 15:03:29.202900 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:29.202873 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106\": container with ID starting with 4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106 not found: ID does not exist" containerID="4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106" May 21 15:03:29.203004 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.202912 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106"} err="failed to get container status \"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106\": rpc error: code = NotFound desc = could not find container \"4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106\": container with ID starting with 4289f2e45239c2ddad596a4ff22a960111fe9fd22de09d11f42286f621148106 not found: ID does not exist" May 21 15:03:29.203004 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.202940 2559 scope.go:117] "RemoveContainer" containerID="f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d" May 21 15:03:29.211190 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.211169 2559 scope.go:117] "RemoveContainer" containerID="f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d" May 21 15:03:29.211447 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:29.211428 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d\": container with ID starting with f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d not found: ID does not exist" containerID="f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d" May 21 15:03:29.211517 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.211454 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d"} err="failed to get container status \"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d\": rpc error: code = NotFound desc = could not find container \"f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d\": container with ID starting with f979017cc8526dd70a35ad693a0934f59c5518a02f49f71369f0713edb14568d not found: ID does not exist" May 21 15:03:29.218488 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.218460 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:03:29.222195 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.222170 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-78mnd"] May 21 15:03:29.231925 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.231904 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:29.239610 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:29.239591 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zjd4g"] May 21 15:03:30.100180 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:30.100144 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" path="/var/lib/kubelet/pods/6d7c9d41-55f8-4e04-89da-13c8f96a641b/volumes" May 21 15:03:30.100520 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:30.100505 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70b4c9e4-86a7-430b-a7ce-df1383ed2b5d" path="/var/lib/kubelet/pods/70b4c9e4-86a7-430b-a7ce-df1383ed2b5d/volumes" May 21 15:03:30.100725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:30.100713 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bced50b8-41c1-476b-966b-d3e541971700" path="/var/lib/kubelet/pods/bced50b8-41c1-476b-966b-d3e541971700/volumes" May 21 15:03:31.325529 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325491 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325843 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" containerName="authorino" May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325854 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" containerName="authorino" May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325872 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bced50b8-41c1-476b-966b-d3e541971700" containerName="authorino" May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325878 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bced50b8-41c1-476b-966b-d3e541971700" containerName="authorino" May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325936 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="bced50b8-41c1-476b-966b-d3e541971700" containerName="authorino" May 21 15:03:31.325946 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.325946 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d7c9d41-55f8-4e04-89da-13c8f96a641b" containerName="authorino" May 21 15:03:31.357763 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.357721 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:31.374817 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.374784 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:31.377488 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.377466 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 15:03:31.377772 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.377751 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vx9s9\"" May 21 15:03:31.470484 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.470446 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:03:31.495084 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.495054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv8d6\" (UniqueName: \"kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6\") pod \"maas-controller-6d54995f5c-wtq76\" (UID: \"569a8599-9261-41c8-9717-e70ad4227652\") " pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:31.495890 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.495868 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:03:31.495994 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.495983 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:31.595802 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.595720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85n2h\" (UniqueName: \"kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h\") pod \"maas-controller-64f8b7bbc4-lmb88\" (UID: \"c75ebcbd-cf93-411f-92d5-179707a1eaf0\") " pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:31.595802 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.595767 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lv8d6\" (UniqueName: \"kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6\") pod \"maas-controller-6d54995f5c-wtq76\" (UID: \"569a8599-9261-41c8-9717-e70ad4227652\") " pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:31.605378 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.605345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv8d6\" (UniqueName: \"kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6\") pod \"maas-controller-6d54995f5c-wtq76\" (UID: \"569a8599-9261-41c8-9717-e70ad4227652\") " pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:31.684634 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.684601 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:31.696376 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.696347 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85n2h\" (UniqueName: \"kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h\") pod \"maas-controller-64f8b7bbc4-lmb88\" (UID: \"c75ebcbd-cf93-411f-92d5-179707a1eaf0\") " pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:31.705688 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.705631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85n2h\" (UniqueName: \"kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h\") pod \"maas-controller-64f8b7bbc4-lmb88\" (UID: \"c75ebcbd-cf93-411f-92d5-179707a1eaf0\") " pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:31.806533 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.806478 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:31.818653 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.818532 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:31.821058 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:31.820977 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569a8599_9261_41c8_9717_e70ad4227652.slice/crio-0ff4b0786c36522e04f075035834ab4e749f1ba259cfde8f00a425501c9169b7 WatchSource:0}: Error finding container 0ff4b0786c36522e04f075035834ab4e749f1ba259cfde8f00a425501c9169b7: Status 404 returned error can't find the container with id 0ff4b0786c36522e04f075035834ab4e749f1ba259cfde8f00a425501c9169b7 May 21 15:03:31.939807 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:31.939780 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:03:31.941611 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:31.941579 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75ebcbd_cf93_411f_92d5_179707a1eaf0.slice/crio-2f652dd3e132d9b4d26f44f5948333a788d382d316c675556104aed6ed9ecbf2 WatchSource:0}: Error finding container 2f652dd3e132d9b4d26f44f5948333a788d382d316c675556104aed6ed9ecbf2: Status 404 returned error can't find the container with id 2f652dd3e132d9b4d26f44f5948333a788d382d316c675556104aed6ed9ecbf2 May 21 15:03:32.211881 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:32.211794 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" event={"ID":"c75ebcbd-cf93-411f-92d5-179707a1eaf0","Type":"ContainerStarted","Data":"2f652dd3e132d9b4d26f44f5948333a788d382d316c675556104aed6ed9ecbf2"} May 21 15:03:32.212823 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:32.212797 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d54995f5c-wtq76" event={"ID":"569a8599-9261-41c8-9717-e70ad4227652","Type":"ContainerStarted","Data":"0ff4b0786c36522e04f075035834ab4e749f1ba259cfde8f00a425501c9169b7"} May 21 15:03:35.230781 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.230685 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" event={"ID":"c75ebcbd-cf93-411f-92d5-179707a1eaf0","Type":"ContainerStarted","Data":"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712"} May 21 15:03:35.231226 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.230877 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:35.232575 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.232538 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d54995f5c-wtq76" event={"ID":"569a8599-9261-41c8-9717-e70ad4227652","Type":"ContainerStarted","Data":"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b"} May 21 15:03:35.232697 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.232685 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:35.248081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.248034 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" podStartSLOduration=1.3852902120000001 podStartE2EDuration="4.248000228s" podCreationTimestamp="2026-05-21 15:03:31 +0000 UTC" firstStartedPulling="2026-05-21 15:03:31.943043319 +0000 UTC m=+560.428940531" lastFinishedPulling="2026-05-21 15:03:34.805753333 +0000 UTC m=+563.291650547" observedRunningTime="2026-05-21 15:03:35.245423591 +0000 UTC m=+563.731320826" watchObservedRunningTime="2026-05-21 15:03:35.248000228 +0000 UTC m=+563.733897462" May 21 15:03:35.263411 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:35.263363 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6d54995f5c-wtq76" podStartSLOduration=1.29026389 podStartE2EDuration="4.263349589s" podCreationTimestamp="2026-05-21 15:03:31 +0000 UTC" firstStartedPulling="2026-05-21 15:03:31.822595002 +0000 UTC m=+560.308492219" lastFinishedPulling="2026-05-21 15:03:34.795680696 +0000 UTC m=+563.281577918" observedRunningTime="2026-05-21 15:03:35.261321675 +0000 UTC m=+563.747218911" watchObservedRunningTime="2026-05-21 15:03:35.263349589 +0000 UTC m=+563.749246823" May 21 15:03:46.243096 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.243059 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:46.243589 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.243116 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:46.304910 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.304876 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:46.305125 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.305101 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6d54995f5c-wtq76" podUID="569a8599-9261-41c8-9717-e70ad4227652" containerName="manager" containerID="cri-o://bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b" gracePeriod=30 May 21 15:03:46.477386 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.477354 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:03:46.480495 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.480471 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:46.489986 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.489956 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:03:46.521609 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.521521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvdxg\" (UniqueName: \"kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg\") pod \"maas-controller-567c845bcf-r6t7k\" (UID: \"3e968b19-27c0-4899-81f4-dbf2ef60e2f2\") " pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:46.542603 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.542579 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:46.622332 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.622289 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv8d6\" (UniqueName: \"kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6\") pod \"569a8599-9261-41c8-9717-e70ad4227652\" (UID: \"569a8599-9261-41c8-9717-e70ad4227652\") " May 21 15:03:46.622552 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.622534 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvdxg\" (UniqueName: \"kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg\") pod \"maas-controller-567c845bcf-r6t7k\" (UID: \"3e968b19-27c0-4899-81f4-dbf2ef60e2f2\") " pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:46.624625 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.624602 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6" (OuterVolumeSpecName: "kube-api-access-lv8d6") pod "569a8599-9261-41c8-9717-e70ad4227652" (UID: "569a8599-9261-41c8-9717-e70ad4227652"). InnerVolumeSpecName "kube-api-access-lv8d6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:46.630753 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.630731 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvdxg\" (UniqueName: \"kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg\") pod \"maas-controller-567c845bcf-r6t7k\" (UID: \"3e968b19-27c0-4899-81f4-dbf2ef60e2f2\") " pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:46.723074 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.723035 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv8d6\" (UniqueName: \"kubernetes.io/projected/569a8599-9261-41c8-9717-e70ad4227652-kube-api-access-lv8d6\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:03:46.794212 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.794178 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:46.929243 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:46.929213 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:03:46.930797 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:03:46.930772 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e968b19_27c0_4899_81f4_dbf2ef60e2f2.slice/crio-56cf8e1e6d22e45c91bfdc3a8cc292373ae1897d74df7ed63b7648f2ff0c3cbd WatchSource:0}: Error finding container 56cf8e1e6d22e45c91bfdc3a8cc292373ae1897d74df7ed63b7648f2ff0c3cbd: Status 404 returned error can't find the container with id 56cf8e1e6d22e45c91bfdc3a8cc292373ae1897d74df7ed63b7648f2ff0c3cbd May 21 15:03:47.279519 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.279423 2559 generic.go:358] "Generic (PLEG): container finished" podID="569a8599-9261-41c8-9717-e70ad4227652" containerID="bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b" exitCode=0 May 21 15:03:47.279519 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.279495 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d54995f5c-wtq76" May 21 15:03:47.279519 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.279505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d54995f5c-wtq76" event={"ID":"569a8599-9261-41c8-9717-e70ad4227652","Type":"ContainerDied","Data":"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b"} May 21 15:03:47.280127 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.279548 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d54995f5c-wtq76" event={"ID":"569a8599-9261-41c8-9717-e70ad4227652","Type":"ContainerDied","Data":"0ff4b0786c36522e04f075035834ab4e749f1ba259cfde8f00a425501c9169b7"} May 21 15:03:47.280127 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.279564 2559 scope.go:117] "RemoveContainer" containerID="bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b" May 21 15:03:47.280778 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.280758 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-r6t7k" event={"ID":"3e968b19-27c0-4899-81f4-dbf2ef60e2f2","Type":"ContainerStarted","Data":"56cf8e1e6d22e45c91bfdc3a8cc292373ae1897d74df7ed63b7648f2ff0c3cbd"} May 21 15:03:47.288511 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.288486 2559 scope.go:117] "RemoveContainer" containerID="bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b" May 21 15:03:47.288743 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:03:47.288724 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b\": container with ID starting with bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b not found: ID does not exist" containerID="bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b" May 21 15:03:47.288794 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.288750 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b"} err="failed to get container status \"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b\": rpc error: code = NotFound desc = could not find container \"bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b\": container with ID starting with bbedd82e4d09d68841ffe8ffedc4b6d3addbac9c28416e97c05311bf874ffd1b not found: ID does not exist" May 21 15:03:47.304750 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.304717 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:47.308082 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:47.308061 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d54995f5c-wtq76"] May 21 15:03:48.099073 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:48.099041 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569a8599-9261-41c8-9717-e70ad4227652" path="/var/lib/kubelet/pods/569a8599-9261-41c8-9717-e70ad4227652/volumes" May 21 15:03:48.286370 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:48.286338 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-r6t7k" event={"ID":"3e968b19-27c0-4899-81f4-dbf2ef60e2f2","Type":"ContainerStarted","Data":"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50"} May 21 15:03:48.286807 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:48.286434 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:48.302403 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:48.302352 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-567c845bcf-r6t7k" podStartSLOduration=1.756506031 podStartE2EDuration="2.30233502s" podCreationTimestamp="2026-05-21 15:03:46 +0000 UTC" firstStartedPulling="2026-05-21 15:03:46.932129685 +0000 UTC m=+575.418026898" lastFinishedPulling="2026-05-21 15:03:47.47795867 +0000 UTC m=+575.963855887" observedRunningTime="2026-05-21 15:03:48.301263288 +0000 UTC m=+576.787160534" watchObservedRunningTime="2026-05-21 15:03:48.30233502 +0000 UTC m=+576.788232266" May 21 15:03:59.296648 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.296612 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:03:59.336810 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.336774 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:03:59.337059 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.337034 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" podUID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" containerName="manager" containerID="cri-o://5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712" gracePeriod=30 May 21 15:03:59.575249 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.575226 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:03:59.643735 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.643705 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85n2h\" (UniqueName: \"kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h\") pod \"c75ebcbd-cf93-411f-92d5-179707a1eaf0\" (UID: \"c75ebcbd-cf93-411f-92d5-179707a1eaf0\") " May 21 15:03:59.645789 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.645760 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h" (OuterVolumeSpecName: "kube-api-access-85n2h") pod "c75ebcbd-cf93-411f-92d5-179707a1eaf0" (UID: "c75ebcbd-cf93-411f-92d5-179707a1eaf0"). InnerVolumeSpecName "kube-api-access-85n2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:59.744990 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:03:59.744926 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85n2h\" (UniqueName: \"kubernetes.io/projected/c75ebcbd-cf93-411f-92d5-179707a1eaf0-kube-api-access-85n2h\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:04:00.332626 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.332585 2559 generic.go:358] "Generic (PLEG): container finished" podID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" containerID="5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712" exitCode=0 May 21 15:04:00.333124 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.332647 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" May 21 15:04:00.333124 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.332671 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" event={"ID":"c75ebcbd-cf93-411f-92d5-179707a1eaf0","Type":"ContainerDied","Data":"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712"} May 21 15:04:00.333124 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.332717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64f8b7bbc4-lmb88" event={"ID":"c75ebcbd-cf93-411f-92d5-179707a1eaf0","Type":"ContainerDied","Data":"2f652dd3e132d9b4d26f44f5948333a788d382d316c675556104aed6ed9ecbf2"} May 21 15:04:00.333124 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.332740 2559 scope.go:117] "RemoveContainer" containerID="5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712" May 21 15:04:00.341795 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.341596 2559 scope.go:117] "RemoveContainer" containerID="5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712" May 21 15:04:00.341881 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:04:00.341861 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712\": container with ID starting with 5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712 not found: ID does not exist" containerID="5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712" May 21 15:04:00.341924 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.341892 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712"} err="failed to get container status \"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712\": rpc error: code = NotFound desc = could not find container \"5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712\": container with ID starting with 5240b8e9c2ff5fc43b1a3fde27e37f8d608623cb42363d6403638be3cd452712 not found: ID does not exist" May 21 15:04:00.350254 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.350222 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:04:00.354553 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:00.354527 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64f8b7bbc4-lmb88"] May 21 15:04:02.099566 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:02.099534 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" path="/var/lib/kubelet/pods/c75ebcbd-cf93-411f-92d5-179707a1eaf0/volumes" May 21 15:04:21.319930 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.319894 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fsw2g"] May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320267 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" containerName="manager" May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320279 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" containerName="manager" May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320305 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569a8599-9261-41c8-9717-e70ad4227652" containerName="manager" May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320312 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="569a8599-9261-41c8-9717-e70ad4227652" containerName="manager" May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320365 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="c75ebcbd-cf93-411f-92d5-179707a1eaf0" containerName="manager" May 21 15:04:21.321618 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.320373 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="569a8599-9261-41c8-9717-e70ad4227652" containerName="manager" May 21 15:04:21.322253 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.322237 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:21.325267 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.325243 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 15:04:21.325412 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.325273 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m8f9p\"" May 21 15:04:21.346465 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.346437 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fsw2g"] May 21 15:04:21.446892 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.446859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6m2s\" (UniqueName: \"kubernetes.io/projected/c0135a1a-553a-403c-a0a6-16b8b0394930-kube-api-access-r6m2s\") pod \"payload-processing-58b6c8fdc7-fsw2g\" (UID: \"c0135a1a-553a-403c-a0a6-16b8b0394930\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:21.548176 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.548140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6m2s\" (UniqueName: \"kubernetes.io/projected/c0135a1a-553a-403c-a0a6-16b8b0394930-kube-api-access-r6m2s\") pod \"payload-processing-58b6c8fdc7-fsw2g\" (UID: \"c0135a1a-553a-403c-a0a6-16b8b0394930\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:21.558283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.558246 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6m2s\" (UniqueName: \"kubernetes.io/projected/c0135a1a-553a-403c-a0a6-16b8b0394930-kube-api-access-r6m2s\") pod \"payload-processing-58b6c8fdc7-fsw2g\" (UID: \"c0135a1a-553a-403c-a0a6-16b8b0394930\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:21.632642 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.632560 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:21.770613 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.770579 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fsw2g"] May 21 15:04:21.772516 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:04:21.772488 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0135a1a_553a_403c_a0a6_16b8b0394930.slice/crio-d136c196837708c07689cb91bf2742d5a81734d7c0071495564a0a74d986682b WatchSource:0}: Error finding container d136c196837708c07689cb91bf2742d5a81734d7c0071495564a0a74d986682b: Status 404 returned error can't find the container with id d136c196837708c07689cb91bf2742d5a81734d7c0071495564a0a74d986682b May 21 15:04:21.774572 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:21.774557 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:04:22.442334 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:22.442295 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" event={"ID":"c0135a1a-553a-403c-a0a6-16b8b0394930","Type":"ContainerStarted","Data":"d136c196837708c07689cb91bf2742d5a81734d7c0071495564a0a74d986682b"} May 21 15:04:25.457781 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:25.457745 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" event={"ID":"c0135a1a-553a-403c-a0a6-16b8b0394930","Type":"ContainerStarted","Data":"ae9b1bf4b7ed815e44261843274f8f6d65ba42c73464632466981a85d88ace88"} May 21 15:04:25.458206 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:25.457871 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:25.473984 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:25.473937 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" podStartSLOduration=1.545156916 podStartE2EDuration="4.473923734s" podCreationTimestamp="2026-05-21 15:04:21 +0000 UTC" firstStartedPulling="2026-05-21 15:04:21.774682688 +0000 UTC m=+610.260579900" lastFinishedPulling="2026-05-21 15:04:24.703449489 +0000 UTC m=+613.189346718" observedRunningTime="2026-05-21 15:04:25.471693764 +0000 UTC m=+613.957590999" watchObservedRunningTime="2026-05-21 15:04:25.473923734 +0000 UTC m=+613.959820968" May 21 15:04:36.464132 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.464095 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fsw2g" May 21 15:04:36.737328 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.737239 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh"] May 21 15:04:36.739973 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.739957 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.743089 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.743065 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6htq4\"" May 21 15:04:36.743089 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.743075 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 15:04:36.743270 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.743080 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 15:04:36.743270 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.743122 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 15:04:36.748128 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.748104 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh"] May 21 15:04:36.777818 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.777782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.777818 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.777820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad40225-dc96-47bf-9f80-abaff69e08a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.778097 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.777849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.778097 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.777900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.778097 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.777926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9724\" (UniqueName: \"kubernetes.io/projected/cad40225-dc96-47bf-9f80-abaff69e08a6-kube-api-access-s9724\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.778097 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.778067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879270 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879234 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879332 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879354 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad40225-dc96-47bf-9f80-abaff69e08a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879467 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879429 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9724\" (UniqueName: \"kubernetes.io/projected/cad40225-dc96-47bf-9f80-abaff69e08a6-kube-api-access-s9724\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879745 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879810 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.879868 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.879821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.881646 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.881623 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cad40225-dc96-47bf-9f80-abaff69e08a6-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.881921 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.881902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cad40225-dc96-47bf-9f80-abaff69e08a6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:36.886721 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:36.886699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9724\" (UniqueName: \"kubernetes.io/projected/cad40225-dc96-47bf-9f80-abaff69e08a6-kube-api-access-s9724\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh\" (UID: \"cad40225-dc96-47bf-9f80-abaff69e08a6\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:37.051229 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:37.051192 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:37.187731 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:37.187708 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh"] May 21 15:04:37.189444 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:04:37.189409 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad40225_dc96_47bf_9f80_abaff69e08a6.slice/crio-82c07fbb48327013118d0a39da967949b696138a1dbc7bc57f7442b00b2dded0 WatchSource:0}: Error finding container 82c07fbb48327013118d0a39da967949b696138a1dbc7bc57f7442b00b2dded0: Status 404 returned error can't find the container with id 82c07fbb48327013118d0a39da967949b696138a1dbc7bc57f7442b00b2dded0 May 21 15:04:37.505391 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:37.505307 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" event={"ID":"cad40225-dc96-47bf-9f80-abaff69e08a6","Type":"ContainerStarted","Data":"82c07fbb48327013118d0a39da967949b696138a1dbc7bc57f7442b00b2dded0"} May 21 15:04:43.532700 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:43.532650 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" event={"ID":"cad40225-dc96-47bf-9f80-abaff69e08a6","Type":"ContainerStarted","Data":"9f8edb3a8baad35914eb0ae40e6c0e092698b86d9698182c027b411a58cb9226"} May 21 15:04:49.558754 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:49.558716 2559 generic.go:358] "Generic (PLEG): container finished" podID="cad40225-dc96-47bf-9f80-abaff69e08a6" containerID="9f8edb3a8baad35914eb0ae40e6c0e092698b86d9698182c027b411a58cb9226" exitCode=0 May 21 15:04:49.559158 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:49.558789 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" event={"ID":"cad40225-dc96-47bf-9f80-abaff69e08a6","Type":"ContainerDied","Data":"9f8edb3a8baad35914eb0ae40e6c0e092698b86d9698182c027b411a58cb9226"} May 21 15:04:51.571844 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:51.571806 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" event={"ID":"cad40225-dc96-47bf-9f80-abaff69e08a6","Type":"ContainerStarted","Data":"4c3f25817f51f718f45047722bb246bff388d6cac5cbf7b5cdc4cf53f67daf31"} May 21 15:04:51.572281 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:51.572067 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:04:51.590867 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:04:51.590819 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" podStartSLOduration=1.874819269 podStartE2EDuration="15.590806545s" podCreationTimestamp="2026-05-21 15:04:36 +0000 UTC" firstStartedPulling="2026-05-21 15:04:37.191252525 +0000 UTC m=+625.677149742" lastFinishedPulling="2026-05-21 15:04:50.907239803 +0000 UTC m=+639.393137018" observedRunningTime="2026-05-21 15:04:51.589196181 +0000 UTC m=+640.075093416" watchObservedRunningTime="2026-05-21 15:04:51.590806545 +0000 UTC m=+640.076703780" May 21 15:05:02.589178 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:02.589149 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh" May 21 15:05:17.149887 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.149848 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8"] May 21 15:05:17.155578 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.155558 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.157979 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.157961 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 15:05:17.162275 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.162253 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8"] May 21 15:05:17.270121 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.270283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270131 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.270283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.270283 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.270390 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.270390 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.270364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57r4k\" (UniqueName: \"kubernetes.io/projected/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kube-api-access-57r4k\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371042 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371081 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371088 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57r4k\" (UniqueName: \"kubernetes.io/projected/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kube-api-access-57r4k\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371325 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371122 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371325 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371325 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371325 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371208 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371615 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371814 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.371814 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.371647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.373576 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.373554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.373718 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.373699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.378759 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.378733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57r4k\" (UniqueName: \"kubernetes.io/projected/4ca76786-e0ad-4bc3-b05d-121d7c1849ee-kube-api-access-57r4k\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-46pz8\" (UID: \"4ca76786-e0ad-4bc3-b05d-121d7c1849ee\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.466437 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.466348 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:17.604258 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.604227 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8"] May 21 15:05:17.605993 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:05:17.605966 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca76786_e0ad_4bc3_b05d_121d7c1849ee.slice/crio-d6cbb854c2727aaa9c01e6a86fe66a50c2bad7f5d5cbcdbfc70ba60d8039a7c0 WatchSource:0}: Error finding container d6cbb854c2727aaa9c01e6a86fe66a50c2bad7f5d5cbcdbfc70ba60d8039a7c0: Status 404 returned error can't find the container with id d6cbb854c2727aaa9c01e6a86fe66a50c2bad7f5d5cbcdbfc70ba60d8039a7c0 May 21 15:05:17.674264 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:17.674228 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" event={"ID":"4ca76786-e0ad-4bc3-b05d-121d7c1849ee","Type":"ContainerStarted","Data":"d6cbb854c2727aaa9c01e6a86fe66a50c2bad7f5d5cbcdbfc70ba60d8039a7c0"} May 21 15:05:18.679866 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:18.679828 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" event={"ID":"4ca76786-e0ad-4bc3-b05d-121d7c1849ee","Type":"ContainerStarted","Data":"975a94f59bc8891529374a2cde59354a962d6760a297c63bd8a2af593c8d1f89"} May 21 15:05:26.713534 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:26.713496 2559 generic.go:358] "Generic (PLEG): container finished" podID="4ca76786-e0ad-4bc3-b05d-121d7c1849ee" containerID="975a94f59bc8891529374a2cde59354a962d6760a297c63bd8a2af593c8d1f89" exitCode=0 May 21 15:05:26.713967 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:26.713570 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" event={"ID":"4ca76786-e0ad-4bc3-b05d-121d7c1849ee","Type":"ContainerDied","Data":"975a94f59bc8891529374a2cde59354a962d6760a297c63bd8a2af593c8d1f89"} May 21 15:05:32.750041 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:32.749980 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" event={"ID":"4ca76786-e0ad-4bc3-b05d-121d7c1849ee","Type":"ContainerStarted","Data":"588304258cde85db5d2cd3efe4185019d0e419865968d3ebb9f178799aa92140"} May 21 15:05:32.750598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:32.750217 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:05:32.769424 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:32.769373 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" podStartSLOduration=10.608140871 podStartE2EDuration="15.76936108s" podCreationTimestamp="2026-05-21 15:05:17 +0000 UTC" firstStartedPulling="2026-05-21 15:05:26.71427661 +0000 UTC m=+675.200173824" lastFinishedPulling="2026-05-21 15:05:31.875496819 +0000 UTC m=+680.361394033" observedRunningTime="2026-05-21 15:05:32.766371649 +0000 UTC m=+681.252268883" watchObservedRunningTime="2026-05-21 15:05:32.76936108 +0000 UTC m=+681.255258315" May 21 15:05:43.766887 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:05:43.766854 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-46pz8" May 21 15:06:03.591563 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.591486 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75577bc6c6-fmr9p"] May 21 15:06:03.594022 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.593995 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.602062 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.602032 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75577bc6c6-fmr9p"] May 21 15:06:03.688606 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.688559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d684g\" (UniqueName: \"kubernetes.io/projected/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-kube-api-access-d684g\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.688606 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.688611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-tls-cert\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.789405 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.789368 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d684g\" (UniqueName: \"kubernetes.io/projected/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-kube-api-access-d684g\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.789575 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.789419 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-tls-cert\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.791981 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.791958 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-tls-cert\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.796323 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.796304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d684g\" (UniqueName: \"kubernetes.io/projected/2ae65b1c-9678-4b30-9ce0-dfd8d7494650-kube-api-access-d684g\") pod \"authorino-75577bc6c6-fmr9p\" (UID: \"2ae65b1c-9678-4b30-9ce0-dfd8d7494650\") " pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:03.904719 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:03.904627 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75577bc6c6-fmr9p" May 21 15:06:04.037619 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.037590 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75577bc6c6-fmr9p"] May 21 15:06:04.039548 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:06:04.039522 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ae65b1c_9678_4b30_9ce0_dfd8d7494650.slice/crio-43d0131b4013483d41ab9b3fc747daa21bc261cb2e3260ab4175cf5c3a56071a WatchSource:0}: Error finding container 43d0131b4013483d41ab9b3fc747daa21bc261cb2e3260ab4175cf5c3a56071a: Status 404 returned error can't find the container with id 43d0131b4013483d41ab9b3fc747daa21bc261cb2e3260ab4175cf5c3a56071a May 21 15:06:04.884571 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.884535 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75577bc6c6-fmr9p" event={"ID":"2ae65b1c-9678-4b30-9ce0-dfd8d7494650","Type":"ContainerStarted","Data":"a9f1e590a8833c1e21716690ae93f3807a2c1344dc6d6cfed33b291d58a26776"} May 21 15:06:04.884571 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.884576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75577bc6c6-fmr9p" event={"ID":"2ae65b1c-9678-4b30-9ce0-dfd8d7494650","Type":"ContainerStarted","Data":"43d0131b4013483d41ab9b3fc747daa21bc261cb2e3260ab4175cf5c3a56071a"} May 21 15:06:04.899716 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.899656 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-75577bc6c6-fmr9p" podStartSLOduration=1.490777497 podStartE2EDuration="1.899638503s" podCreationTimestamp="2026-05-21 15:06:03 +0000 UTC" firstStartedPulling="2026-05-21 15:06:04.040729537 +0000 UTC m=+712.526626750" lastFinishedPulling="2026-05-21 15:06:04.44959054 +0000 UTC m=+712.935487756" observedRunningTime="2026-05-21 15:06:04.898605643 +0000 UTC m=+713.384502884" watchObservedRunningTime="2026-05-21 15:06:04.899638503 +0000 UTC m=+713.385535742" May 21 15:06:04.940424 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.940365 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:06:04.941043 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:04.940979 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" podUID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" containerName="authorino" containerID="cri-o://b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6" gracePeriod=30 May 21 15:06:05.194112 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.194088 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:06:05.302384 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.302347 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert\") pod \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " May 21 15:06:05.302384 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.302394 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh9gd\" (UniqueName: \"kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd\") pod \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\" (UID: \"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3\") " May 21 15:06:05.304484 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.304460 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd" (OuterVolumeSpecName: "kube-api-access-dh9gd") pod "9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" (UID: "9f629c28-7d27-41c0-a1b8-7ba09c8f58c3"). InnerVolumeSpecName "kube-api-access-dh9gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:06:05.313133 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.313107 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" (UID: "9f629c28-7d27-41c0-a1b8-7ba09c8f58c3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:06:05.403755 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.403711 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-tls-cert\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:06:05.403755 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.403743 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh9gd\" (UniqueName: \"kubernetes.io/projected/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3-kube-api-access-dh9gd\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:06:05.889642 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.889608 2559 generic.go:358] "Generic (PLEG): container finished" podID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" containerID="b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6" exitCode=0 May 21 15:06:05.890077 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.889659 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" May 21 15:06:05.890077 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.889658 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" event={"ID":"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3","Type":"ContainerDied","Data":"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6"} May 21 15:06:05.890077 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.889704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d8d8c4b5-ng26k" event={"ID":"9f629c28-7d27-41c0-a1b8-7ba09c8f58c3","Type":"ContainerDied","Data":"ffd95d132d39824365ce344669ef3f7485489d28af96b114d80436a98194e581"} May 21 15:06:05.890077 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.889733 2559 scope.go:117] "RemoveContainer" containerID="b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6" May 21 15:06:05.899034 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.898992 2559 scope.go:117] "RemoveContainer" containerID="b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6" May 21 15:06:05.899307 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:06:05.899287 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6\": container with ID starting with b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6 not found: ID does not exist" containerID="b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6" May 21 15:06:05.899359 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.899319 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6"} err="failed to get container status \"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6\": rpc error: code = NotFound desc = could not find container \"b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6\": container with ID starting with b18dbd24edf6e915472ea26a9e0558eb1fc6d720ef0c4d2d7c2cac6e7ffbc2e6 not found: ID does not exist" May 21 15:06:05.910589 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.910564 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:06:05.921335 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:05.921308 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78d8d8c4b5-ng26k"] May 21 15:06:06.105864 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:06:06.105784 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" path="/var/lib/kubelet/pods/9f629c28-7d27-41c0-a1b8-7ba09c8f58c3/volumes" May 21 15:07:30.231652 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.231566 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:07:30.232299 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.231880 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-567c845bcf-r6t7k" podUID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" containerName="manager" containerID="cri-o://698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50" gracePeriod=30 May 21 15:07:30.478452 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.478424 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:07:30.495655 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.495579 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvdxg\" (UniqueName: \"kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg\") pod \"3e968b19-27c0-4899-81f4-dbf2ef60e2f2\" (UID: \"3e968b19-27c0-4899-81f4-dbf2ef60e2f2\") " May 21 15:07:30.498337 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.498301 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg" (OuterVolumeSpecName: "kube-api-access-hvdxg") pod "3e968b19-27c0-4899-81f4-dbf2ef60e2f2" (UID: "3e968b19-27c0-4899-81f4-dbf2ef60e2f2"). InnerVolumeSpecName "kube-api-access-hvdxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:07:30.596842 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:30.596803 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvdxg\" (UniqueName: \"kubernetes.io/projected/3e968b19-27c0-4899-81f4-dbf2ef60e2f2-kube-api-access-hvdxg\") on node \"ip-10-0-143-65.ec2.internal\" DevicePath \"\"" May 21 15:07:31.224649 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.224611 2559 generic.go:358] "Generic (PLEG): container finished" podID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" containerID="698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50" exitCode=0 May 21 15:07:31.224858 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.224678 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-r6t7k" May 21 15:07:31.224858 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.224694 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-r6t7k" event={"ID":"3e968b19-27c0-4899-81f4-dbf2ef60e2f2","Type":"ContainerDied","Data":"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50"} May 21 15:07:31.224858 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.224732 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-r6t7k" event={"ID":"3e968b19-27c0-4899-81f4-dbf2ef60e2f2","Type":"ContainerDied","Data":"56cf8e1e6d22e45c91bfdc3a8cc292373ae1897d74df7ed63b7648f2ff0c3cbd"} May 21 15:07:31.224858 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.224748 2559 scope.go:117] "RemoveContainer" containerID="698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50" May 21 15:07:31.234296 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.234093 2559 scope.go:117] "RemoveContainer" containerID="698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50" May 21 15:07:31.234536 ip-10-0-143-65 kubenswrapper[2559]: E0521 15:07:31.234365 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50\": container with ID starting with 698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50 not found: ID does not exist" containerID="698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50" May 21 15:07:31.234536 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.234387 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50"} err="failed to get container status \"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50\": rpc error: code = NotFound desc = could not find container \"698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50\": container with ID starting with 698ffa2db914da92951405bbd5b42b81c4f66482b130d5c328b9f778c57f6e50 not found: ID does not exist" May 21 15:07:31.247386 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.247360 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:07:31.251068 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.251049 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-567c845bcf-r6t7k"] May 21 15:07:31.983137 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983101 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-567c845bcf-7zfvx"] May 21 15:07:31.983585 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983568 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" containerName="authorino" May 21 15:07:31.983585 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983587 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" containerName="authorino" May 21 15:07:31.983691 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983595 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" containerName="manager" May 21 15:07:31.983691 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983601 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" containerName="manager" May 21 15:07:31.983691 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983665 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" containerName="manager" May 21 15:07:31.983691 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.983676 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f629c28-7d27-41c0-a1b8-7ba09c8f58c3" containerName="authorino" May 21 15:07:31.986650 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.986635 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:31.989101 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.989077 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vx9s9\"" May 21 15:07:31.989216 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.989115 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 15:07:31.995063 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:31.995041 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c845bcf-7zfvx"] May 21 15:07:32.009806 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.009777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzqkj\" (UniqueName: \"kubernetes.io/projected/2a10680f-a957-4b42-8c41-9c51dfb56d84-kube-api-access-nzqkj\") pod \"maas-controller-567c845bcf-7zfvx\" (UID: \"2a10680f-a957-4b42-8c41-9c51dfb56d84\") " pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:32.101806 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.101769 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e968b19-27c0-4899-81f4-dbf2ef60e2f2" path="/var/lib/kubelet/pods/3e968b19-27c0-4899-81f4-dbf2ef60e2f2/volumes" May 21 15:07:32.110789 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.110759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzqkj\" (UniqueName: \"kubernetes.io/projected/2a10680f-a957-4b42-8c41-9c51dfb56d84-kube-api-access-nzqkj\") pod \"maas-controller-567c845bcf-7zfvx\" (UID: \"2a10680f-a957-4b42-8c41-9c51dfb56d84\") " pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:32.120269 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.120234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzqkj\" (UniqueName: \"kubernetes.io/projected/2a10680f-a957-4b42-8c41-9c51dfb56d84-kube-api-access-nzqkj\") pod \"maas-controller-567c845bcf-7zfvx\" (UID: \"2a10680f-a957-4b42-8c41-9c51dfb56d84\") " pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:32.298243 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.298210 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:32.435987 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:32.435568 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-567c845bcf-7zfvx"] May 21 15:07:32.438457 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:07:32.438427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a10680f_a957_4b42_8c41_9c51dfb56d84.slice/crio-44a9c8fdceefac71c62cca8acf3888bc1da49df3ee0f7306e9ddab303ea39f81 WatchSource:0}: Error finding container 44a9c8fdceefac71c62cca8acf3888bc1da49df3ee0f7306e9ddab303ea39f81: Status 404 returned error can't find the container with id 44a9c8fdceefac71c62cca8acf3888bc1da49df3ee0f7306e9ddab303ea39f81 May 21 15:07:33.240856 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:33.240761 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-7zfvx" event={"ID":"2a10680f-a957-4b42-8c41-9c51dfb56d84","Type":"ContainerStarted","Data":"b8053b736224534e4c569dcd9287129c585d0f5cda948c71019bef1cd3f3cecc"} May 21 15:07:33.240856 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:33.240803 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-567c845bcf-7zfvx" event={"ID":"2a10680f-a957-4b42-8c41-9c51dfb56d84","Type":"ContainerStarted","Data":"44a9c8fdceefac71c62cca8acf3888bc1da49df3ee0f7306e9ddab303ea39f81"} May 21 15:07:33.240856 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:33.240826 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:07:33.258789 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:33.258739 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-567c845bcf-7zfvx" podStartSLOduration=1.833249846 podStartE2EDuration="2.258726673s" podCreationTimestamp="2026-05-21 15:07:31 +0000 UTC" firstStartedPulling="2026-05-21 15:07:32.439724988 +0000 UTC m=+800.925622201" lastFinishedPulling="2026-05-21 15:07:32.86520181 +0000 UTC m=+801.351099028" observedRunningTime="2026-05-21 15:07:33.255559315 +0000 UTC m=+801.741456550" watchObservedRunningTime="2026-05-21 15:07:33.258726673 +0000 UTC m=+801.744623907" May 21 15:07:44.251443 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:07:44.251409 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-567c845bcf-7zfvx" May 21 15:28:34.302375 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:34.302345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75577bc6c6-fmr9p_2ae65b1c-9678-4b30-9ce0-dfd8d7494650/authorino/0.log" May 21 15:28:39.118513 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:39.118481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-567c845bcf-7zfvx_2a10680f-a957-4b42-8c41-9c51dfb56d84/manager/0.log" May 21 15:28:39.566698 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:39.566670 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677f98f9b9-jcln4_472d8b6e-bd1c-4bf2-88df-7b4831a5902e/manager/0.log" May 21 15:28:39.675227 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:39.675200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-z7rbc_b1611eb4-af6d-4da2-b6c4-9917c3c9581b/postgres/0.log" May 21 15:28:40.411650 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.411623 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/util/0.log" May 21 15:28:40.418393 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.418366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/pull/0.log" May 21 15:28:40.424699 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.424683 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/extract/0.log" May 21 15:28:40.537504 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.537468 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/pull/0.log" May 21 15:28:40.544225 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.544204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/extract/0.log" May 21 15:28:40.550631 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.550605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/util/0.log" May 21 15:28:40.658643 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.658613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/util/0.log" May 21 15:28:40.665183 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.665116 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/pull/0.log" May 21 15:28:40.671094 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.671074 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/extract/0.log" May 21 15:28:40.777321 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.777293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/util/0.log" May 21 15:28:40.783307 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.783286 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/pull/0.log" May 21 15:28:40.789918 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.789894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/extract/0.log" May 21 15:28:40.904305 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:40.904274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75577bc6c6-fmr9p_2ae65b1c-9678-4b30-9ce0-dfd8d7494650/authorino/0.log" May 21 15:28:41.017280 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:41.017191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ns4m5_ad3022bf-7ca5-40b9-8c53-92c4dd997e65/manager/0.log" May 21 15:28:41.383951 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:41.383918 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mzqk8_aa3f90c6-28d3-4a5d-839e-45d464f7fb12/registry-server/0.log" May 21 15:28:42.066626 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:42.066578 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4btt9hc_34041596-3d07-4873-8a9b-b1be26af7242/istio-proxy/0.log" May 21 15:28:42.520942 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:42.520857 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fm9dm_1353882d-a5c6-46c5-90cf-a6a82e1dec82/istio-proxy/0.log" May 21 15:28:42.643945 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:42.643915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fsw2g_c0135a1a-553a-403c-a0a6-16b8b0394930/payload-processing/0.log" May 21 15:28:43.580904 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:43.580871 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh_cad40225-dc96-47bf-9f80-abaff69e08a6/storage-initializer/0.log" May 21 15:28:43.586891 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:43.586868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-4dkvh_cad40225-dc96-47bf-9f80-abaff69e08a6/main/0.log" May 21 15:28:43.696167 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:43.696138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-46pz8_4ca76786-e0ad-4bc3-b05d-121d7c1849ee/storage-initializer/0.log" May 21 15:28:43.704051 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:43.703998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-46pz8_4ca76786-e0ad-4bc3-b05d-121d7c1849ee/main/0.log" May 21 15:28:47.522109 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.522071 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zxzd6/must-gather-m5ngf"] May 21 15:28:47.525667 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.525649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.527929 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.527908 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zxzd6\"/\"kube-root-ca.crt\"" May 21 15:28:47.528691 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.528676 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zxzd6\"/\"default-dockercfg-g8d8k\"" May 21 15:28:47.528868 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.528854 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zxzd6\"/\"openshift-service-ca.crt\"" May 21 15:28:47.540493 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.540473 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/must-gather-m5ngf"] May 21 15:28:47.625749 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.625717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/311e4109-24bd-4369-889c-7b973b09399e-must-gather-output\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.625945 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.625766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjpr\" (UniqueName: \"kubernetes.io/projected/311e4109-24bd-4369-889c-7b973b09399e-kube-api-access-xrjpr\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.727527 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.727482 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/311e4109-24bd-4369-889c-7b973b09399e-must-gather-output\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.727731 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.727565 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjpr\" (UniqueName: \"kubernetes.io/projected/311e4109-24bd-4369-889c-7b973b09399e-kube-api-access-xrjpr\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.727904 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.727877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/311e4109-24bd-4369-889c-7b973b09399e-must-gather-output\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.736157 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.736126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjpr\" (UniqueName: \"kubernetes.io/projected/311e4109-24bd-4369-889c-7b973b09399e-kube-api-access-xrjpr\") pod \"must-gather-m5ngf\" (UID: \"311e4109-24bd-4369-889c-7b973b09399e\") " pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.835679 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.835643 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" May 21 15:28:47.965980 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.965950 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/must-gather-m5ngf"] May 21 15:28:47.967784 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:28:47.967756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod311e4109_24bd_4369_889c_7b973b09399e.slice/crio-d6efda4d2779889f70db5410e99dce12dd8deda44b7599f826f9d3f1687eeaf0 WatchSource:0}: Error finding container d6efda4d2779889f70db5410e99dce12dd8deda44b7599f826f9d3f1687eeaf0: Status 404 returned error can't find the container with id d6efda4d2779889f70db5410e99dce12dd8deda44b7599f826f9d3f1687eeaf0 May 21 15:28:47.969624 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:47.969608 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:28:48.265549 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:48.265463 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" event={"ID":"311e4109-24bd-4369-889c-7b973b09399e","Type":"ContainerStarted","Data":"d6efda4d2779889f70db5410e99dce12dd8deda44b7599f826f9d3f1687eeaf0"} May 21 15:28:49.275725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:49.274956 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" event={"ID":"311e4109-24bd-4369-889c-7b973b09399e","Type":"ContainerStarted","Data":"03cc6e4890165a65f7ec1e02dfea84ba24cdbe7fee98c9d5afd1130576f7845e"} May 21 15:28:49.275725 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:49.275034 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" event={"ID":"311e4109-24bd-4369-889c-7b973b09399e","Type":"ContainerStarted","Data":"3b1a18f2ff1c4ddebbabe7eec3aa78c2c171078cf49c6bb36a89a588e62724a4"} May 21 15:28:49.322275 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:49.322198 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zxzd6/must-gather-m5ngf" podStartSLOduration=1.4898324170000001 podStartE2EDuration="2.322168237s" podCreationTimestamp="2026-05-21 15:28:47 +0000 UTC" firstStartedPulling="2026-05-21 15:28:47.969730431 +0000 UTC m=+2076.455627644" lastFinishedPulling="2026-05-21 15:28:48.80206625 +0000 UTC m=+2077.287963464" observedRunningTime="2026-05-21 15:28:49.319263789 +0000 UTC m=+2077.805161037" watchObservedRunningTime="2026-05-21 15:28:49.322168237 +0000 UTC m=+2077.808065475" May 21 15:28:50.587171 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:50.587131 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sllss_b769e610-efc4-4f28-af2f-f01e19dc5b26/global-pull-secret-syncer/0.log" May 21 15:28:50.681343 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:50.681311 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pnkhs_27a4de00-323c-4547-be9a-16138406a7ef/konnectivity-agent/0.log" May 21 15:28:50.773552 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:50.773517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-65.ec2.internal_3e860e65447da6b42d64abb9f280bafd/haproxy/0.log" May 21 15:28:54.324789 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.324756 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/extract/0.log" May 21 15:28:54.351528 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.351444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/util/0.log" May 21 15:28:54.375087 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.374978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v99bp_222a7346-b33f-44f3-9194-9593f899a360/pull/0.log" May 21 15:28:54.422234 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.422179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/extract/0.log" May 21 15:28:54.448342 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.448313 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/util/0.log" May 21 15:28:54.480668 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.480636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kswxb_6b27f482-b7dc-4fe0-82f8-cff7456a5e01/pull/0.log" May 21 15:28:54.514791 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.514764 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/extract/0.log" May 21 15:28:54.542620 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.542578 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/util/0.log" May 21 15:28:54.567056 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.567031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73llm6z_47cf93fe-b5bd-4c83-870f-07f7447eea99/pull/0.log" May 21 15:28:54.597919 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.597812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/extract/0.log" May 21 15:28:54.618741 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.618672 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/util/0.log" May 21 15:28:54.643335 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.643310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbvvx_9741615e-974a-4441-baa2-a100c94e8e84/pull/0.log" May 21 15:28:54.893711 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.893606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75577bc6c6-fmr9p_2ae65b1c-9678-4b30-9ce0-dfd8d7494650/authorino/0.log" May 21 15:28:54.925455 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:54.925414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ns4m5_ad3022bf-7ca5-40b9-8c53-92c4dd997e65/manager/0.log" May 21 15:28:55.020478 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:55.020430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mzqk8_aa3f90c6-28d3-4a5d-839e-45d464f7fb12/registry-server/0.log" May 21 15:28:56.723441 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:56.723400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-788949c7-cj68q_e770d37d-80fe-410f-86c5-59b98c9e80c5/metrics-server/0.log" May 21 15:28:56.873386 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:56.873315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwm7d_4a99c05b-9def-4b2c-8fa6-1fab200efe78/node-exporter/0.log" May 21 15:28:56.897309 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:56.897243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwm7d_4a99c05b-9def-4b2c-8fa6-1fab200efe78/kube-rbac-proxy/0.log" May 21 15:28:56.926360 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:56.926332 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwm7d_4a99c05b-9def-4b2c-8fa6-1fab200efe78/init-textfile/0.log" May 21 15:28:57.035424 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.035385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ks26k_370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629/kube-rbac-proxy-main/0.log" May 21 15:28:57.081103 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.081066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ks26k_370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629/kube-rbac-proxy-self/0.log" May 21 15:28:57.105110 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.105080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ks26k_370b6eb7-2c0f-4ca9-84b3-3d4d0f5da629/openshift-state-metrics/0.log" May 21 15:28:57.492584 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.492495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/thanos-query/0.log" May 21 15:28:57.513150 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.513117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/kube-rbac-proxy-web/0.log" May 21 15:28:57.536986 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.536955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/kube-rbac-proxy/0.log" May 21 15:28:57.563141 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.563113 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/prom-label-proxy/0.log" May 21 15:28:57.583468 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.583435 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/kube-rbac-proxy-rules/0.log" May 21 15:28:57.607586 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:57.607555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8657446d-26n8k_116d1c55-92d4-4a64-8fda-51a3722dd841/kube-rbac-proxy-metrics/0.log" May 21 15:28:59.675043 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.674988 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz"] May 21 15:28:59.683985 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.683955 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz"] May 21 15:28:59.684178 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.684152 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.753291 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.753234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-proc\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.753494 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.753446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-sys\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.753560 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.753496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-lib-modules\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.753620 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.753527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-podres\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.753675 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.753657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4xn\" (UniqueName: \"kubernetes.io/projected/7fbffd52-ab95-41ed-ae41-b4de59fc578a-kube-api-access-cv4xn\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.760908 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.760841 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75cd94f5f6-gk5z6_7f82de6b-74b4-4dbb-bed3-5a8865ec849c/console/0.log" May 21 15:28:59.796463 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.796428 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-qtglm_15839093-71c0-47e1-a6fb-c77e01bc70f7/download-server/0.log" May 21 15:28:59.855351 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855307 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-sys\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855556 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855362 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-lib-modules\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855556 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855396 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-podres\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855556 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4xn\" (UniqueName: \"kubernetes.io/projected/7fbffd52-ab95-41ed-ae41-b4de59fc578a-kube-api-access-cv4xn\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855556 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855539 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-proc\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855790 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-lib-modules\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855790 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-podres\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855790 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-proc\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.855996 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.855968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fbffd52-ab95-41ed-ae41-b4de59fc578a-sys\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:28:59.864582 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:28:59.864547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4xn\" (UniqueName: \"kubernetes.io/projected/7fbffd52-ab95-41ed-ae41-b4de59fc578a-kube-api-access-cv4xn\") pod \"perf-node-gather-daemonset-fv8kz\" (UID: \"7fbffd52-ab95-41ed-ae41-b4de59fc578a\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:29:00.000700 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:00.000601 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:29:00.179776 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:00.179533 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz"] May 21 15:29:00.187760 ip-10-0-143-65 kubenswrapper[2559]: W0521 15:29:00.187728 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7fbffd52_ab95_41ed_ae41_b4de59fc578a.slice/crio-5447e0b05e2b8d10f2841cd2417bcc3159248009d6cc2f035f5357973470d112 WatchSource:0}: Error finding container 5447e0b05e2b8d10f2841cd2417bcc3159248009d6cc2f035f5357973470d112: Status 404 returned error can't find the container with id 5447e0b05e2b8d10f2841cd2417bcc3159248009d6cc2f035f5357973470d112 May 21 15:29:00.336844 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:00.336818 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" event={"ID":"7fbffd52-ab95-41ed-ae41-b4de59fc578a","Type":"ContainerStarted","Data":"5447e0b05e2b8d10f2841cd2417bcc3159248009d6cc2f035f5357973470d112"} May 21 15:29:01.219799 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.219763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6mcs_97a6b757-cbe5-45c7-ac93-0164412e7d2d/dns/0.log" May 21 15:29:01.242030 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.241983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6mcs_97a6b757-cbe5-45c7-ac93-0164412e7d2d/kube-rbac-proxy/0.log" May 21 15:29:01.266879 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.266856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4vdtv_4cf5132e-4137-42aa-a050-a855d65ef1b4/dns-node-resolver/0.log" May 21 15:29:01.350108 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.350058 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" event={"ID":"7fbffd52-ab95-41ed-ae41-b4de59fc578a","Type":"ContainerStarted","Data":"f892f2099fcf5f2a55d1cd0d922728a8067a8d558ad3fbb57183ca803d02cef6"} May 21 15:29:01.350568 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.350548 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:29:01.369818 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.369750 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" podStartSLOduration=2.369730612 podStartE2EDuration="2.369730612s" podCreationTimestamp="2026-05-21 15:28:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:29:01.36830623 +0000 UTC m=+2089.854203467" watchObservedRunningTime="2026-05-21 15:29:01.369730612 +0000 UTC m=+2089.855627852" May 21 15:29:01.869450 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.869420 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5448b59c7f-pchlj_0d076dd6-0f87-4a05-8887-b3d2e1ff4fa4/registry/0.log" May 21 15:29:01.887461 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:01.887431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6krr_b3c20876-c5a8-4a7f-9c2c-e45e5b1117b4/node-ca/0.log" May 21 15:29:02.780903 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:02.780870 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4btt9hc_34041596-3d07-4873-8a9b-b1be26af7242/istio-proxy/0.log" May 21 15:29:02.970585 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:02.970550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fm9dm_1353882d-a5c6-46c5-90cf-a6a82e1dec82/istio-proxy/0.log" May 21 15:29:03.042598 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:03.042566 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fsw2g_c0135a1a-553a-403c-a0a6-16b8b0394930/payload-processing/0.log" May 21 15:29:03.574306 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:03.574270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s47zt_c803a29c-0f7f-49ca-8b2f-561c51600efa/serve-healthcheck-canary/0.log" May 21 15:29:04.141433 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:04.141400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vpvlx_03cee9f1-cd81-4fe0-a09e-62b362165285/insights-operator/0.log" May 21 15:29:04.142793 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:04.142761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-vpvlx_03cee9f1-cd81-4fe0-a09e-62b362165285/insights-operator/1.log" May 21 15:29:04.258176 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:04.258148 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5x84l_37890673-7007-44c3-8c5a-b2487148b339/kube-rbac-proxy/0.log" May 21 15:29:04.294522 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:04.294498 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5x84l_37890673-7007-44c3-8c5a-b2487148b339/exporter/0.log" May 21 15:29:04.346614 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:04.346582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5x84l_37890673-7007-44c3-8c5a-b2487148b339/extractor/0.log" May 21 15:29:06.651463 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:06.651393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-567c845bcf-7zfvx_2a10680f-a957-4b42-8c41-9c51dfb56d84/manager/0.log" May 21 15:29:06.771694 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:06.771660 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677f98f9b9-jcln4_472d8b6e-bd1c-4bf2-88df-7b4831a5902e/manager/0.log" May 21 15:29:06.789594 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:06.789568 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-z7rbc_b1611eb4-af6d-4da2-b6c4-9917c3c9581b/postgres/0.log" May 21 15:29:07.364057 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:07.364030 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-fv8kz" May 21 15:29:07.918876 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:07.918839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68f6db4d77-ccjk9_4ccf82e3-7e3e-4907-9304-d074ae73ec3c/manager/0.log" May 21 15:29:12.881649 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:12.881615 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8c8f2_aaddbcb0-8f06-4bfa-a0a1-107710b07cda/kube-storage-version-migrator-operator/1.log" May 21 15:29:12.882572 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:12.882551 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8c8f2_aaddbcb0-8f06-4bfa-a0a1-107710b07cda/kube-storage-version-migrator-operator/0.log" May 21 15:29:14.308183 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.308150 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/kube-multus-additional-cni-plugins/0.log" May 21 15:29:14.337934 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.337908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/egress-router-binary-copy/0.log" May 21 15:29:14.362951 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.362923 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/cni-plugins/0.log" May 21 15:29:14.387716 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.387691 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/bond-cni-plugin/0.log" May 21 15:29:14.410326 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.410299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/routeoverride-cni/0.log" May 21 15:29:14.430973 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.430947 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/whereabouts-cni-bincopy/0.log" May 21 15:29:14.451107 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.451081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv5z2_f90aee8c-78a3-4a49-9e40-f87c42ccfbb9/whereabouts-cni/0.log" May 21 15:29:14.535593 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.535562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xf65f_ced8217a-b9d3-4ac7-9509-3ab5f1fe652a/kube-multus/0.log" May 21 15:29:14.556446 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.556419 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5656t_330a2b07-ef9d-48b1-9dc1-813b0a41b54b/network-metrics-daemon/0.log" May 21 15:29:14.575172 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:14.575094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5656t_330a2b07-ef9d-48b1-9dc1-813b0a41b54b/kube-rbac-proxy/0.log" May 21 15:29:15.745523 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.745496 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/ovn-controller/0.log" May 21 15:29:15.771778 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.771749 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/ovn-acl-logging/0.log" May 21 15:29:15.791538 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.791506 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/kube-rbac-proxy-node/0.log" May 21 15:29:15.812496 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.812462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:29:15.828006 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.827983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/northd/0.log" May 21 15:29:15.849922 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.849891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/nbdb/0.log" May 21 15:29:15.871930 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.871907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/sbdb/0.log" May 21 15:29:15.984543 ip-10-0-143-65 kubenswrapper[2559]: I0521 15:29:15.984519 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfp5m_f4571ed6-8695-4611-a836-a6bbc9c83e47/ovnkube-controller/0.log"