May 21 16:08:32.209000 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 16:08:32.209012 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 16:08:32.209019 ip-10-0-140-222 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 16:08:32.209230 ip-10-0-140-222 systemd[1]: Failed to start Kubernetes Kubelet. May 21 16:08:42.458329 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 16:08:42.458344 ip-10-0-140-222 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5a9952e2d0d543499c4223259ceeeed3 -- May 21 16:10:57.346864 ip-10-0-140-222 systemd[1]: Starting Kubernetes Kubelet... May 21 16:10:57.809864 ip-10-0-140-222 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:10:57.809864 ip-10-0-140-222 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 16:10:57.809864 ip-10-0-140-222 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:10:57.809864 ip-10-0-140-222 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 16:10:57.809864 ip-10-0-140-222 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:10:57.812129 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.812035 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 16:10:57.814687 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814672 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:10:57.814687 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814688 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814692 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814695 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814698 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814701 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814704 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814706 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814709 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814711 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814714 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814717 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814719 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814722 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814730 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814733 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814735 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814738 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814740 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814743 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814745 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:10:57.814752 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814748 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814750 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814753 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814756 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814758 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814761 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814763 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814766 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814769 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814771 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814773 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814776 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814778 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814781 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814783 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814785 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814788 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814790 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814793 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:10:57.815217 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814795 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814798 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814802 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814806 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814809 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814811 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814813 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814816 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814826 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814828 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814831 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814833 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814836 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814838 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814841 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814844 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814847 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814849 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814852 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:10:57.815699 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814855 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814857 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814859 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814862 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814864 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814868 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814870 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814873 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814876 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814878 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814881 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814884 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814886 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814889 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814891 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814894 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814896 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814899 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814902 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814904 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:10:57.816166 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814907 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814909 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814913 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814917 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814920 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814922 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.814925 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815310 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815315 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815318 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815320 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815324 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815326 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815329 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815331 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815334 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815336 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815339 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815341 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:10:57.816652 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815344 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815347 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815349 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815352 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815354 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815357 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815359 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815362 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815364 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815367 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815370 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815372 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815375 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815377 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815380 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815382 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815384 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815387 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815390 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:10:57.817101 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815392 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815395 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815398 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815401 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815404 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815406 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815409 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815411 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815414 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815416 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815419 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815422 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815424 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815427 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815430 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815433 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815436 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815440 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815442 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815445 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:10:57.817564 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815447 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815450 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815452 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815454 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815457 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815459 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815463 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815466 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815469 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815472 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815474 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815477 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815479 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815483 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815488 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815490 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815493 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815495 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815498 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:10:57.818076 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815500 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815503 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815505 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815507 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815510 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815512 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815514 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815517 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815519 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815522 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815524 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815527 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815529 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815531 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815533 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.815536 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816639 2555 flags.go:64] FLAG: --address="0.0.0.0" May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816650 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816657 2555 flags.go:64] FLAG: --anonymous-auth="true" May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816662 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816667 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 16:10:57.818530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816670 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816674 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816679 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816682 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816685 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816688 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816693 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816696 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816699 2555 flags.go:64] FLAG: --cgroup-root="" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816702 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816705 2555 flags.go:64] FLAG: --client-ca-file="" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816708 2555 flags.go:64] FLAG: --cloud-config="" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816710 2555 flags.go:64] FLAG: --cloud-provider="external" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816713 2555 flags.go:64] FLAG: --cluster-dns="[]" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816717 2555 flags.go:64] FLAG: --cluster-domain="" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816720 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816723 2555 flags.go:64] FLAG: --config-dir="" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816726 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816729 2555 flags.go:64] FLAG: --container-log-max-files="5" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816733 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816737 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816740 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816743 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816746 2555 flags.go:64] FLAG: --contention-profiling="false" May 21 16:10:57.819060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816749 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816752 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816755 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816758 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816762 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816766 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816769 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816771 2555 flags.go:64] FLAG: --enable-load-reader="false" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816774 2555 flags.go:64] FLAG: --enable-server="true" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816777 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816782 2555 flags.go:64] FLAG: --event-burst="100" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816785 2555 flags.go:64] FLAG: --event-qps="50" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816788 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816791 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816794 2555 flags.go:64] FLAG: --eviction-hard="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816798 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816801 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816804 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816807 2555 flags.go:64] FLAG: --eviction-soft="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816810 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816813 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816816 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816818 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816821 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816824 2555 flags.go:64] FLAG: --fail-swap-on="true" May 21 16:10:57.819676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816827 2555 flags.go:64] FLAG: --feature-gates="" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816831 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816834 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816837 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816840 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816843 2555 flags.go:64] FLAG: --healthz-port="10248" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816846 2555 flags.go:64] FLAG: --help="false" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816849 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-222.ec2.internal" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816852 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816854 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816857 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816861 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816865 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816867 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816870 2555 flags.go:64] FLAG: --image-service-endpoint="" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816873 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816876 2555 flags.go:64] FLAG: --kube-api-burst="100" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816879 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816882 2555 flags.go:64] FLAG: --kube-api-qps="50" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816885 2555 flags.go:64] FLAG: --kube-reserved="" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816888 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816890 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816893 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816896 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 16:10:57.820266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816899 2555 flags.go:64] FLAG: --lock-file="" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816902 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816905 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816908 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816913 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816916 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816919 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816922 2555 flags.go:64] FLAG: --logging-format="text" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816925 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816929 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816932 2555 flags.go:64] FLAG: --manifest-url="" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816935 2555 flags.go:64] FLAG: --manifest-url-header="" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816939 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816944 2555 flags.go:64] FLAG: --max-open-files="1000000" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816948 2555 flags.go:64] FLAG: --max-pods="110" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816951 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816954 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816957 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816960 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816962 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816965 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816968 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816976 2555 flags.go:64] FLAG: --node-status-max-images="50" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816979 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816982 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 21 16:10:57.820964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816985 2555 flags.go:64] FLAG: --pod-cidr="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816988 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816994 2555 flags.go:64] FLAG: --pod-manifest-path="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.816997 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817000 2555 flags.go:64] FLAG: --pods-per-core="0" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817003 2555 flags.go:64] FLAG: --port="10250" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817006 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817009 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b347c1635c634f7" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817012 2555 flags.go:64] FLAG: --qos-reserved="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817015 2555 flags.go:64] FLAG: --read-only-port="10255" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817018 2555 flags.go:64] FLAG: --register-node="true" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817021 2555 flags.go:64] FLAG: --register-schedulable="true" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817023 2555 flags.go:64] FLAG: --register-with-taints="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817027 2555 flags.go:64] FLAG: --registry-burst="10" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817030 2555 flags.go:64] FLAG: --registry-qps="5" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817032 2555 flags.go:64] FLAG: --reserved-cpus="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817035 2555 flags.go:64] FLAG: --reserved-memory="" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817039 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817042 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817045 2555 flags.go:64] FLAG: --rotate-certificates="false" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817048 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817051 2555 flags.go:64] FLAG: --runonce="false" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817054 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817057 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817060 2555 flags.go:64] FLAG: --seccomp-default="false" May 21 16:10:57.821548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817062 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817065 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817068 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817071 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817074 2555 flags.go:64] FLAG: --storage-driver-password="root" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817077 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817080 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817083 2555 flags.go:64] FLAG: --storage-driver-user="root" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817086 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817089 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817091 2555 flags.go:64] FLAG: --system-cgroups="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817094 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817100 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817103 2555 flags.go:64] FLAG: --tls-cert-file="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817106 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817110 2555 flags.go:64] FLAG: --tls-min-version="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817115 2555 flags.go:64] FLAG: --tls-private-key-file="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817118 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817121 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817124 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817128 2555 flags.go:64] FLAG: --v="2" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817132 2555 flags.go:64] FLAG: --version="false" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817136 2555 flags.go:64] FLAG: --vmodule="" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817140 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817143 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 16:10:57.822189 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817237 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817240 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817244 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817246 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817250 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817252 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817255 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817258 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817260 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817263 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817266 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817268 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817270 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817273 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817276 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817278 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817281 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817283 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817286 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817288 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:10:57.822797 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817291 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817294 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817296 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817303 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817306 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817308 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817311 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817313 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817316 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817319 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817322 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817324 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817327 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817329 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817332 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817334 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817336 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817339 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817342 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817344 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:10:57.823295 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817347 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817349 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817351 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817354 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817356 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817358 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817361 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817365 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817369 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817372 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817374 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817377 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817379 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817382 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817384 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817388 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817391 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817393 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817396 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817398 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:10:57.823803 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817401 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817403 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817405 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817408 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817410 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817413 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817415 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817418 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817421 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817425 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817428 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817431 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817434 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817437 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817440 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817442 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817445 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817447 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817453 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:10:57.824292 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817455 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817458 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817461 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817463 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817466 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817468 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.817470 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:10:57.824787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.817980 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:10:57.825226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.825207 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 16:10:57.825257 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.825227 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 16:10:57.825284 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825280 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:10:57.825284 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825285 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825288 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825292 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825295 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825298 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825301 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825303 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825306 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825308 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825311 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825313 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825316 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825319 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825322 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825324 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825327 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825330 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825332 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825335 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825338 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:10:57.825337 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825341 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825344 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825346 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825349 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825351 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825354 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825357 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825359 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825362 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825364 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825367 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825369 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825372 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825374 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825377 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825379 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825382 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825384 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825387 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825389 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:10:57.825915 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825391 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825394 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825396 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825399 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825401 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825410 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825412 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825415 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825417 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825419 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825422 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825424 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825434 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825436 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825440 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825442 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825445 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825454 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825457 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:10:57.826561 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825460 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825462 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825465 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825467 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825469 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825473 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825477 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825480 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825483 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825486 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825489 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825491 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825493 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825496 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825499 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825501 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825503 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825505 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825508 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:10:57.827255 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825515 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825518 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825520 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825523 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825525 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825528 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825530 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.825535 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825665 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825670 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825673 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825676 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825679 2555 feature_gate.go:328] unrecognized feature gate: Example May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825681 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825684 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:10:57.827770 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825687 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825689 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825691 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825694 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825696 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825699 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825701 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825703 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825706 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825708 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825711 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825713 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825716 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825718 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825720 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825723 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825726 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825730 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825741 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825744 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:10:57.828155 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825746 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825749 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825751 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825754 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825756 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825758 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825761 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825764 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825766 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825769 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825771 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825773 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825776 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825778 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825781 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825783 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825785 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825789 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825792 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:10:57.828650 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825795 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825798 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825800 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825803 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825805 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825808 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825810 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825812 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825815 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825817 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825819 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825822 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825829 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825832 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825835 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825837 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825839 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825842 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825844 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:10:57.829117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825847 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825849 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825852 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825854 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825856 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825859 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825861 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825863 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825866 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825868 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825871 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825873 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825876 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825878 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825880 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825883 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825885 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825887 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825890 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825892 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:10:57.829569 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:57.825895 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:10:57.830067 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.825900 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:10:57.830067 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.826879 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 21 16:10:57.830067 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.829712 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 16:10:57.831628 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.831615 2555 server.go:1019] "Starting client certificate rotation" May 21 16:10:57.831729 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.831714 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 16:10:57.831761 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.831752 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 16:10:57.854341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.854319 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 16:10:57.856173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.856154 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 16:10:57.868849 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.868826 2555 log.go:25] "Validated CRI v1 runtime API" May 21 16:10:57.874739 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.874718 2555 log.go:25] "Validated CRI v1 image API" May 21 16:10:57.876531 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.876507 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 16:10:57.881710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.881684 2555 fs.go:135] Filesystem UUIDs: map[715f06d7-e104-48b9-a4fa-52f6f7c7f34a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ce98c4e4-768c-4e4d-9aef-0dc528b06342:/dev/nvme0n1p3] May 21 16:10:57.881806 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.881708 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 16:10:57.887016 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.886904 2555 manager.go:217] Machine: {Timestamp:2026-05-21 16:10:57.886326223 +0000 UTC m=+0.416233210 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100045 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24beb5a7bdc705eade1e41525caabe SystemUUID:ec24beb5-a7bd-c705-eade-1e41525caabe BootID:5a9952e2-d0d5-4349-9c42-23259ceeeed3 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:e0:70:2a:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:e0:70:2a:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:60:82:ef:ad:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 16:10:57.887725 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.887714 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 16:10:57.887825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.887813 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 16:10:57.888206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.888191 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 16:10:57.890864 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.890621 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 16:10:57.891029 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.890871 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 16:10:57.891083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.891039 2555 topology_manager.go:138] "Creating topology manager with none policy" May 21 16:10:57.891083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.891048 2555 container_manager_linux.go:306] "Creating device plugin manager" May 21 16:10:57.891083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.891056 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 16:10:57.891571 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.891562 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 16:10:57.892693 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.892682 2555 state_mem.go:36] "Initialized new in-memory state store" May 21 16:10:57.892990 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.892979 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 16:10:57.895844 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.895833 2555 kubelet.go:491] "Attempting to sync node with API server" May 21 16:10:57.895888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.895848 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 16:10:57.895888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.895861 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 16:10:57.895888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.895871 2555 kubelet.go:397] "Adding apiserver pod source" May 21 16:10:57.895888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.895879 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 16:10:57.896953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.896942 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 16:10:57.896997 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.896961 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 16:10:57.900203 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.900175 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 16:10:57.901932 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.901918 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 16:10:57.902726 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902711 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 16:10:57.902768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902738 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 16:10:57.902768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902748 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 16:10:57.902768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902757 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902771 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902781 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902792 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902800 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902810 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902820 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 16:10:57.902852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902834 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 16:10:57.903034 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.902942 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 16:10:57.903819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.903805 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 16:10:57.903861 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.903821 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 16:10:57.907570 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.907556 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 16:10:57.907672 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.907614 2555 server.go:1295] "Started kubelet" May 21 16:10:57.907770 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.907722 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 16:10:57.907834 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.907822 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 16:10:57.908158 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.908128 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 16:10:57.908415 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.908390 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 16:10:57.908557 ip-10-0-140-222 systemd[1]: Started Kubernetes Kubelet. May 21 16:10:57.909007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.908900 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 16:10:57.909227 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.909163 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 16:10:57.909227 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.909163 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 16:10:57.910341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.910327 2555 server.go:317] "Adding debug handlers to kubelet server" May 21 16:10:57.916547 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.916515 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 16:10:57.916689 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.916618 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 16:10:57.916938 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.916921 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 16:10:57.917114 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917099 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 16:10:57.917201 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917132 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 16:10:57.917270 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917257 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 16:10:57.917315 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917306 2555 reconstruct.go:97] "Volume reconstruction finished" May 21 16:10:57.917344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917317 2555 reconciler.go:26] "Reconciler: start to sync state" May 21 16:10:57.917638 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.917614 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:57.917748 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917692 2555 factory.go:55] Registering systemd factory May 21 16:10:57.917748 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917707 2555 factory.go:223] Registration of the systemd container factory successfully May 21 16:10:57.917954 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917939 2555 factory.go:153] Registering CRI-O factory May 21 16:10:57.917998 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.917959 2555 factory.go:223] Registration of the crio container factory successfully May 21 16:10:57.918027 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.918007 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 16:10:57.918027 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.918023 2555 factory.go:103] Registering Raw factory May 21 16:10:57.918100 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.918040 2555 manager.go:1196] Started watching for new ooms in manager May 21 16:10:57.918157 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.915427 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-222.ec2.internal.18b1a08d9f10cc4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-222.ec2.internal,UID:ip-10-0-140-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-222.ec2.internal,},FirstTimestamp:2026-05-21 16:10:57.907567693 +0000 UTC m=+0.437474679,LastTimestamp:2026-05-21 16:10:57.907567693 +0000 UTC m=+0.437474679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-222.ec2.internal,}" May 21 16:10:57.918991 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.918978 2555 manager.go:319] Starting recovery of all containers May 21 16:10:57.920387 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.920351 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 16:10:57.920479 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.920369 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 16:10:57.930200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.930157 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h78l2" May 21 16:10:57.932451 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.932402 2555 manager.go:324] Recovery completed May 21 16:10:57.937044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.937030 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:57.937842 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.937824 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h78l2" May 21 16:10:57.939584 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.939569 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:57.939660 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.939617 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:57.939660 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.939629 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:57.940134 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.940120 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 16:10:57.940134 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.940132 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 16:10:57.940208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.940147 2555 state_mem.go:36] "Initialized new in-memory state store" May 21 16:10:57.941483 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.941410 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-222.ec2.internal.18b1a08da0f95382 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-222.ec2.internal,UID:ip-10-0-140-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-222.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-222.ec2.internal,},FirstTimestamp:2026-05-21 16:10:57.939583874 +0000 UTC m=+0.469490861,LastTimestamp:2026-05-21 16:10:57.939583874 +0000 UTC m=+0.469490861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-222.ec2.internal,}" May 21 16:10:57.942257 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.942241 2555 policy_none.go:49] "None policy: Start" May 21 16:10:57.942257 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.942259 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 16:10:57.942384 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.942270 2555 state_mem.go:35] "Initializing new in-memory state store" May 21 16:10:57.977428 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977408 2555 manager.go:341] "Starting Device Plugin manager" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.977447 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977460 2555 server.go:85] "Starting device plugin registration server" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977799 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977818 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977886 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977964 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:57.977974 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.978579 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 16:10:57.989200 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:57.978649 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.025886 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.025846 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 16:10:58.027347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.027325 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 16:10:58.027478 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.027363 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 16:10:58.027478 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.027387 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 16:10:58.027478 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.027395 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 21 16:10:58.027478 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.027438 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 16:10:58.030069 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.030045 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:10:58.078210 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.078119 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:58.079309 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.079281 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:58.079309 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.079313 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:58.079443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.079325 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:58.079443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.079349 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-222.ec2.internal" May 21 16:10:58.090084 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.090059 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-222.ec2.internal" May 21 16:10:58.090142 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.090090 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-222.ec2.internal\": node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.107624 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.107579 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.127760 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.127730 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal"] May 21 16:10:58.127864 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.127808 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:58.129528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.129513 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:58.129636 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.129550 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:58.129636 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.129566 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:58.131193 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131180 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:58.131366 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131352 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.131453 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131386 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:58.131953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131937 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:58.132052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131937 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:58.132052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131996 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:58.132052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.132011 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:58.132052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.131967 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:58.132052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.132041 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:58.133112 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.133096 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:58.133192 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.133119 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:10:58.133779 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.133752 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" May 21 16:10:58.133871 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.133783 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:10:58.133871 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.133795 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" May 21 16:10:58.163318 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.163288 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-222.ec2.internal\" not found" node="ip-10-0-140-222.ec2.internal" May 21 16:10:58.167654 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.167636 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-222.ec2.internal\" not found" node="ip-10-0-140-222.ec2.internal" May 21 16:10:58.208337 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.208291 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.219273 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.219246 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.219367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.219278 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b4d7d85952786a43a7e0615acac9d95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"0b4d7d85952786a43a7e0615acac9d95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:58.219367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.219298 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.309333 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.309304 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.319687 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319665 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.319766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319691 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.319766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319710 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b4d7d85952786a43a7e0615acac9d95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"0b4d7d85952786a43a7e0615acac9d95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:58.319766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319759 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b4d7d85952786a43a7e0615acac9d95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"0b4d7d85952786a43a7e0615acac9d95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:58.319879 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.319879 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.319773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5e6f309ba34e1c00a0316d5e7dc82cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"a5e6f309ba34e1c00a0316d5e7dc82cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.410198 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.410138 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.465744 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.465706 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:58.470696 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.470670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:58.510373 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.510337 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.610844 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.610814 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.711349 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.711279 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.811882 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.811848 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.830290 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.830270 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 16:10:58.830468 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.830452 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 16:10:58.912536 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:58.912509 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" May 21 16:10:58.917378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.917334 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 16:10:58.928572 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.928547 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 16:10:58.939989 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.939951 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 16:05:57 +0000 UTC" deadline="2027-12-22 00:59:59.365065945 +0000 UTC" May 21 16:10:58.939989 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.939988 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13904h49m0.42508671s" May 21 16:10:58.948137 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.948121 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:10:58.949263 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.949249 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwzv6" May 21 16:10:58.958544 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.958521 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nwzv6" May 21 16:10:58.971530 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:58.971468 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e6f309ba34e1c00a0316d5e7dc82cf.slice/crio-c4725b08e8c1108d09030155898a6d4b89e439f703b0e07b664f72c7f7ca42f0 WatchSource:0}: Error finding container c4725b08e8c1108d09030155898a6d4b89e439f703b0e07b664f72c7f7ca42f0: Status 404 returned error can't find the container with id c4725b08e8c1108d09030155898a6d4b89e439f703b0e07b664f72c7f7ca42f0 May 21 16:10:58.971747 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:10:58.971729 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4d7d85952786a43a7e0615acac9d95.slice/crio-4c7125f810a096ae0a0072f02a1b8f97bb73203829d1b278e8e6053a78dd8b2e WatchSource:0}: Error finding container 4c7125f810a096ae0a0072f02a1b8f97bb73203829d1b278e8e6053a78dd8b2e: Status 404 returned error can't find the container with id 4c7125f810a096ae0a0072f02a1b8f97bb73203829d1b278e8e6053a78dd8b2e May 21 16:10:58.974908 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.974890 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:10:58.992749 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:58.992723 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:10:59.008890 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.008864 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:10:59.017877 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.017857 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" May 21 16:10:59.030108 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.030080 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 16:10:59.030983 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.030965 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" May 21 16:10:59.031094 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.030970 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"a5e6f309ba34e1c00a0316d5e7dc82cf","Type":"ContainerStarted","Data":"c4725b08e8c1108d09030155898a6d4b89e439f703b0e07b664f72c7f7ca42f0"} May 21 16:10:59.031946 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.031925 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" event={"ID":"0b4d7d85952786a43a7e0615acac9d95","Type":"ContainerStarted","Data":"4c7125f810a096ae0a0072f02a1b8f97bb73203829d1b278e8e6053a78dd8b2e"} May 21 16:10:59.039858 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.039836 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 16:10:59.785359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.785329 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:10:59.896859 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.896817 2555 apiserver.go:52] "Watching apiserver" May 21 16:10:59.904786 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.904753 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 16:10:59.905978 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.905944 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m","openshift-cluster-node-tuning-operator/tuned-jlwlm","openshift-image-registry/node-ca-jg8qw","openshift-network-diagnostics/network-check-target-m4hpp","openshift-network-operator/iptables-alerter-h5wxh","openshift-ovn-kubernetes/ovnkube-node-7qqz6","kube-system/konnectivity-agent-cjzwf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal","openshift-multus/multus-2r6bb","openshift-multus/multus-additional-cni-plugins-g5t6s","openshift-multus/network-metrics-daemon-tphnz"] May 21 16:10:59.908575 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.908551 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.908717 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.908584 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.910957 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.910826 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jg8qw" May 21 16:10:59.911967 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.911947 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:10:59.912078 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:59.912024 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:10:59.912339 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912316 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q89ml\"" May 21 16:10:59.912453 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912440 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 16:10:59.912902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912744 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-59jlr\"" May 21 16:10:59.912902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912809 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 16:10:59.912902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912816 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 16:10:59.912902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.912860 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 16:10:59.913405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.913157 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:10:59.913528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.913501 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 16:10:59.913628 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.913550 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 16:10:59.914045 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.914023 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 16:10:59.914134 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.914077 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99ccr\"" May 21 16:10:59.914187 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.914137 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 16:10:59.914484 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.914464 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.915800 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.915688 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 16:10:59.916389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.915872 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ml626\"" May 21 16:10:59.916389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.915959 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:10:59.916389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.916046 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 16:10:59.916389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.916315 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 16:10:59.918076 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.917924 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 16:10:59.918153 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.918072 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 16:10:59.919370 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.918341 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 16:10:59.919370 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.918652 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 16:10:59.919725 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.919705 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 16:10:59.921218 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.921179 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 16:10:59.921316 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.921119 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2r6bb" May 21 16:10:59.921766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.921750 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.922038 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.922020 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-twtgb\"" May 21 16:10:59.922343 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.922329 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 16:10:59.922987 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.922970 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s4zsq\"" May 21 16:10:59.923099 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923078 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 16:10:59.923797 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923757 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 16:10:59.923965 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923946 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 16:10:59.924055 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923968 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 16:10:59.924055 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923897 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 16:10:59.924183 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923952 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fl7nw\"" May 21 16:10:59.924183 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923868 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:10:59.924183 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.923885 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 16:10:59.924183 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:10:59.924169 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:10:59.924523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.924503 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rd4bq\"" May 21 16:10:59.924656 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.924562 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 16:10:59.925167 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cni-binary-copy\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.925237 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-multus-certs\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.925282 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cnibin\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.925282 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-conf\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.925282 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-slash\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.925429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925295 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-conf-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.925429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-etc-kubernetes\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.925429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.925429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-modprobe-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.925429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-host\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-etc-tuned\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925481 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-system-cni-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-sys-fs\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrn4\" (UniqueName: \"kubernetes.io/projected/4518ce87-daea-496a-9271-7d153215a5fe-kube-api-access-2vrn4\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.925680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925678 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-bin\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-env-overrides\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925791 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-bin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ecc9ecc-01bd-4859-af63-919fcfa92e04-serviceca\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea42079d-6994-4f86-adbd-6ec471aa0228-konnectivity-ca\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-netns\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76nb\" (UniqueName: \"kubernetes.io/projected/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-kube-api-access-g76nb\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-kubelet\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-systemd-units\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.925996 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-netns\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-kubernetes\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-device-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926088 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-var-lib-kubelet\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-k8s-cni-cncf-io\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-kubelet\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea42079d-6994-4f86-adbd-6ec471aa0228-agent-certs\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-os-release\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-lib-modules\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-var-lib-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-log-socket\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-config\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926426 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cnibin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.926548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysconfig\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7xb\" (UniqueName: \"kubernetes.io/projected/488e5804-0e81-45e0-b444-af08d4f28819-kube-api-access-sl7xb\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926539 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-tmp\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/890d57f8-f340-486d-8f77-9ceffc7549ef-ovn-node-metrics-cert\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-system-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-os-release\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-socket-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ecc9ecc-01bd-4859-af63-919fcfa92e04-host\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1ecfec0-14ab-476f-9282-88d45e4e4a29-iptables-alerter-script\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxwg\" (UniqueName: \"kubernetes.io/projected/8ecc9ecc-01bd-4859-af63-919fcfa92e04-kube-api-access-6lxwg\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8lq\" (UniqueName: \"kubernetes.io/projected/b1ecfec0-14ab-476f-9282-88d45e4e4a29-kube-api-access-cs8lq\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-systemd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-ovn\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.927304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-multus\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.926995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ecfec0-14ab-476f-9282-88d45e4e4a29-host-slash\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-run\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-hostroot\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927083 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-socket-dir-parent\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927120 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-sys\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-etc-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-script-lib\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927229 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfm6w\" (UniqueName: \"kubernetes.io/projected/890d57f8-f340-486d-8f77-9ceffc7549ef-kube-api-access-tfm6w\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-daemon-config\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgn8\" (UniqueName: \"kubernetes.io/projected/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-kube-api-access-gpgn8\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-registration-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-systemd\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-node-log\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.928005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.927356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-netd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:10:59.959846 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.959818 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:05:58 +0000 UTC" deadline="2028-03-06 16:25:06.539309548 +0000 UTC" May 21 16:10:59.959846 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:10:59.959845 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15720h14m6.57946857s" May 21 16:11:00.018938 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.018902 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 16:11:00.027675 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027643 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-device-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027684 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-var-lib-kubelet\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027734 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-k8s-cni-cncf-io\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027756 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-kubelet\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027777 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea42079d-6994-4f86-adbd-6ec471aa0228-agent-certs\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-device-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027797 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-os-release\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027848 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-lib-modules\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-os-release\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027874 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.027903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027896 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027909 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-var-lib-kubelet\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027914 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-var-lib-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027938 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-log-socket\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027953 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-config\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.027981 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cnibin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028012 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysconfig\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028035 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7xb\" (UniqueName: \"kubernetes.io/projected/488e5804-0e81-45e0-b444-af08d4f28819-kube-api-access-sl7xb\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028086 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-tmp\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028109 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/890d57f8-f340-486d-8f77-9ceffc7549ef-ovn-node-metrics-cert\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028136 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-system-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028158 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-os-release\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028197 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-socket-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028221 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ecc9ecc-01bd-4859-af63-919fcfa92e04-host\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028267 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1ecfec0-14ab-476f-9282-88d45e4e4a29-iptables-alerter-script\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.028715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028292 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxwg\" (UniqueName: \"kubernetes.io/projected/8ecc9ecc-01bd-4859-af63-919fcfa92e04-kube-api-access-6lxwg\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028317 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8lq\" (UniqueName: \"kubernetes.io/projected/b1ecfec0-14ab-476f-9282-88d45e4e4a29-kube-api-access-cs8lq\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028345 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028370 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-systemd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-config\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028394 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-ovn\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028420 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028457 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-multus\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028486 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-lib-modules\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028483 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ecfec0-14ab-476f-9282-88d45e4e4a29-host-slash\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028549 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-run\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028575 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-hostroot\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028619 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028647 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-socket-dir-parent\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-k8s-cni-cncf-io\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.029665 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-kubelet\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028755 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-sys\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-etc-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028833 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-script-lib\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfm6w\" (UniqueName: \"kubernetes.io/projected/890d57f8-f340-486d-8f77-9ceffc7549ef-kube-api-access-tfm6w\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028885 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.028921 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-daemon-config\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029085 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cnibin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029147 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysconfig\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029145 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029254 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029296 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgn8\" (UniqueName: \"kubernetes.io/projected/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-kube-api-access-gpgn8\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029374 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-registration-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029398 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-systemd\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029421 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-node-log\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029430 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1ecfec0-14ab-476f-9282-88d45e4e4a29-iptables-alerter-script\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-netd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.030465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-system-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029467 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cni-binary-copy\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029491 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-multus-certs\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029499 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-os-release\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-log-socket\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029522 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cnibin\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7wns\" (UniqueName: \"kubernetes.io/projected/a13c9f8c-3e4e-4f93-8257-0a221759ab83-kube-api-access-k7wns\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029574 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-conf\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029606 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-slash\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029622 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-conf-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029643 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-etc-kubernetes\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029653 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-multus-certs\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029669 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029688 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-registration-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029695 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-modprobe-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029712 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-hostroot\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029720 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-host\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029743 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-node-log\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.031337 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029743 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-etc-tuned\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-sys\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029782 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029808 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-system-cni-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-sys-fs\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrn4\" (UniqueName: \"kubernetes.io/projected/4518ce87-daea-496a-9271-7d153215a5fe-kube-api-access-2vrn4\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029885 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029909 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-bin\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029929 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-env-overrides\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029949 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029973 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-bin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029982 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029993 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ecc9ecc-01bd-4859-af63-919fcfa92e04-serviceca\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030025 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea42079d-6994-4f86-adbd-6ec471aa0228-konnectivity-ca\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030045 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-netns\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030062 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g76nb\" (UniqueName: \"kubernetes.io/projected/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-kube-api-access-g76nb\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030081 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-kubelet\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030102 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-systemd-units\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-netns\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030136 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-kubernetes\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-kubernetes\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030227 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-systemd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-ovn\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030295 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030324 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-multus\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ecfec0-14ab-476f-9282-88d45e4e4a29-host-slash\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030341 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-ovnkube-script-lib\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030397 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-run\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030460 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ecc9ecc-01bd-4859-af63-919fcfa92e04-serviceca\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030570 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-netd\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030901 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea42079d-6994-4f86-adbd-6ec471aa0228-konnectivity-ca\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.029493 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-var-lib-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-run-netns\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030968 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-conf-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031009 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ecc9ecc-01bd-4859-af63-919fcfa92e04-host\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.032982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-cni-binary-copy\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031093 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cnibin\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031151 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-socket-dir-parent\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031170 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-modprobe-d\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031199 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-slash\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031205 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-systemd\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031209 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-systemd-units\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-etc-kubernetes\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031245 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-kubelet\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031251 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-system-cni-dir\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031256 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-sys-fs\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.030895 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-socket-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/488e5804-0e81-45e0-b444-af08d4f28819-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-run-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-etc-openvswitch\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031358 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-cni-bin\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-etc-sysctl-conf\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.034044 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-cni-dir\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031529 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4518ce87-daea-496a-9271-7d153215a5fe-host\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-host-var-lib-cni-bin\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031653 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/890d57f8-f340-486d-8f77-9ceffc7549ef-host-run-netns\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/890d57f8-f340-486d-8f77-9ceffc7549ef-env-overrides\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.031801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.032034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-multus-daemon-config\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.033555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-etc-tuned\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.033694 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/890d57f8-f340-486d-8f77-9ceffc7549ef-ovn-node-metrics-cert\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.035004 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.033909 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea42079d-6994-4f86-adbd-6ec471aa0228-agent-certs\") pod \"konnectivity-agent-cjzwf\" (UID: \"ea42079d-6994-4f86-adbd-6ec471aa0228\") " pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:00.035525 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.035275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4518ce87-daea-496a-9271-7d153215a5fe-tmp\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.039089 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.039043 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:00.039089 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.039067 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:00.039089 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.039082 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:00.039545 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.039168 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:00.539131972 +0000 UTC m=+3.069038967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:00.042011 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.041974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vrn4\" (UniqueName: \"kubernetes.io/projected/4518ce87-daea-496a-9271-7d153215a5fe-kube-api-access-2vrn4\") pod \"tuned-jlwlm\" (UID: \"4518ce87-daea-496a-9271-7d153215a5fe\") " pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.044357 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.044331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7xb\" (UniqueName: \"kubernetes.io/projected/488e5804-0e81-45e0-b444-af08d4f28819-kube-api-access-sl7xb\") pod \"aws-ebs-csi-driver-node-cbt8m\" (UID: \"488e5804-0e81-45e0-b444-af08d4f28819\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.044566 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.044512 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxwg\" (UniqueName: \"kubernetes.io/projected/8ecc9ecc-01bd-4859-af63-919fcfa92e04-kube-api-access-6lxwg\") pod \"node-ca-jg8qw\" (UID: \"8ecc9ecc-01bd-4859-af63-919fcfa92e04\") " pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.044758 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.044736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76nb\" (UniqueName: \"kubernetes.io/projected/6a4d7a5d-bc2b-4acd-9e4b-18761add406f-kube-api-access-g76nb\") pod \"multus-additional-cni-plugins-g5t6s\" (UID: \"6a4d7a5d-bc2b-4acd-9e4b-18761add406f\") " pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.046025 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.045998 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8lq\" (UniqueName: \"kubernetes.io/projected/b1ecfec0-14ab-476f-9282-88d45e4e4a29-kube-api-access-cs8lq\") pod \"iptables-alerter-h5wxh\" (UID: \"b1ecfec0-14ab-476f-9282-88d45e4e4a29\") " pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.046397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.046377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgn8\" (UniqueName: \"kubernetes.io/projected/b5ada9b2-85c7-4b92-b428-0e5e86969b8d-kube-api-access-gpgn8\") pod \"multus-2r6bb\" (UID: \"b5ada9b2-85c7-4b92-b428-0e5e86969b8d\") " pod="openshift-multus/multus-2r6bb" May 21 16:11:00.046507 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.046487 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfm6w\" (UniqueName: \"kubernetes.io/projected/890d57f8-f340-486d-8f77-9ceffc7549ef-kube-api-access-tfm6w\") pod \"ovnkube-node-7qqz6\" (UID: \"890d57f8-f340-486d-8f77-9ceffc7549ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.130628 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.130569 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.130834 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.130655 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7wns\" (UniqueName: \"kubernetes.io/projected/a13c9f8c-3e4e-4f93-8257-0a221759ab83-kube-api-access-k7wns\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.130834 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.130777 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:00.131078 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.130837 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:00.630818996 +0000 UTC m=+3.160725968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:00.139740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.139716 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7wns\" (UniqueName: \"kubernetes.io/projected/a13c9f8c-3e4e-4f93-8257-0a221759ab83-kube-api-access-k7wns\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.222704 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.222671 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" May 21 16:11:00.230544 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.230508 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" May 21 16:11:00.239191 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.239161 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jg8qw" May 21 16:11:00.247874 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.247843 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5wxh" May 21 16:11:00.254694 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.254670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:00.262353 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.262332 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:00.272021 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.271992 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2r6bb" May 21 16:11:00.278614 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.278579 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" May 21 16:11:00.633071 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.633034 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:00.633246 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.633080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:00.633246 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633218 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:00.633246 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633219 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:00.633246 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633237 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:00.633417 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633253 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:00.633417 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:01.633299538 +0000 UTC m=+4.163206530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:00.633417 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:00.633342 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:01.633331446 +0000 UTC m=+4.163238421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:00.800422 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.800378 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ecfec0_14ab_476f_9282_88d45e4e4a29.slice/crio-e12d695dd98d1b2683c603b9b01ae3cb176869aeb9502c568f64e90fe2661eef WatchSource:0}: Error finding container e12d695dd98d1b2683c603b9b01ae3cb176869aeb9502c568f64e90fe2661eef: Status 404 returned error can't find the container with id e12d695dd98d1b2683c603b9b01ae3cb176869aeb9502c568f64e90fe2661eef May 21 16:11:00.804080 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.804025 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea42079d_6994_4f86_adbd_6ec471aa0228.slice/crio-0a47fb8e3adcec1b59f9e99f0b66f5926b43c6fe6a8c4fbc5ae404c8b432520b WatchSource:0}: Error finding container 0a47fb8e3adcec1b59f9e99f0b66f5926b43c6fe6a8c4fbc5ae404c8b432520b: Status 404 returned error can't find the container with id 0a47fb8e3adcec1b59f9e99f0b66f5926b43c6fe6a8c4fbc5ae404c8b432520b May 21 16:11:00.805946 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.805923 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecc9ecc_01bd_4859_af63_919fcfa92e04.slice/crio-1e75f17a10ba58c66abeeefdb5cd15e2cb7ab873352b533e28e29e50496f3856 WatchSource:0}: Error finding container 1e75f17a10ba58c66abeeefdb5cd15e2cb7ab873352b533e28e29e50496f3856: Status 404 returned error can't find the container with id 1e75f17a10ba58c66abeeefdb5cd15e2cb7ab873352b533e28e29e50496f3856 May 21 16:11:00.808317 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.807921 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890d57f8_f340_486d_8f77_9ceffc7549ef.slice/crio-d7760efd9619031549ff46b80e2bd6c00d5a562d0b191b522b563005fad8ce90 WatchSource:0}: Error finding container d7760efd9619031549ff46b80e2bd6c00d5a562d0b191b522b563005fad8ce90: Status 404 returned error can't find the container with id d7760efd9619031549ff46b80e2bd6c00d5a562d0b191b522b563005fad8ce90 May 21 16:11:00.809057 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.809038 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488e5804_0e81_45e0_b444_af08d4f28819.slice/crio-be8f58f59fe332af638b3b8518a50971da7383ff8be179a4b9c18cad0708ba1b WatchSource:0}: Error finding container be8f58f59fe332af638b3b8518a50971da7383ff8be179a4b9c18cad0708ba1b: Status 404 returned error can't find the container with id be8f58f59fe332af638b3b8518a50971da7383ff8be179a4b9c18cad0708ba1b May 21 16:11:00.809782 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.809762 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4d7a5d_bc2b_4acd_9e4b_18761add406f.slice/crio-4f0ecad6a114c0a53bd74466894755c5d9f05d2c28d0408e2afeac6575954ef8 WatchSource:0}: Error finding container 4f0ecad6a114c0a53bd74466894755c5d9f05d2c28d0408e2afeac6575954ef8: Status 404 returned error can't find the container with id 4f0ecad6a114c0a53bd74466894755c5d9f05d2c28d0408e2afeac6575954ef8 May 21 16:11:00.810660 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.810634 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4518ce87_daea_496a_9271_7d153215a5fe.slice/crio-c029588583e662232b83b378ebf3559bf1fbf2d3737175c0a75df84c4113e14f WatchSource:0}: Error finding container c029588583e662232b83b378ebf3559bf1fbf2d3737175c0a75df84c4113e14f: Status 404 returned error can't find the container with id c029588583e662232b83b378ebf3559bf1fbf2d3737175c0a75df84c4113e14f May 21 16:11:00.814442 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:00.814275 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ada9b2_85c7_4b92_b428_0e5e86969b8d.slice/crio-49f9493cc32697dca6cf00c7720ebe71f601352dae39f7e99bf8bd01fe69d03c WatchSource:0}: Error finding container 49f9493cc32697dca6cf00c7720ebe71f601352dae39f7e99bf8bd01fe69d03c: Status 404 returned error can't find the container with id 49f9493cc32697dca6cf00c7720ebe71f601352dae39f7e99bf8bd01fe69d03c May 21 16:11:00.960405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.960219 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:05:58 +0000 UTC" deadline="2027-12-20 22:37:40.440626731 +0000 UTC" May 21 16:11:00.960405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:00.960400 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13878h26m39.480229574s" May 21 16:11:01.036344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.036308 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" event={"ID":"0b4d7d85952786a43a7e0615acac9d95","Type":"ContainerStarted","Data":"d568302f69141768076953a3193de58e55c7b094a009e3dff00a9629e681fee3"} May 21 16:11:01.037254 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.037233 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2r6bb" event={"ID":"b5ada9b2-85c7-4b92-b428-0e5e86969b8d","Type":"ContainerStarted","Data":"49f9493cc32697dca6cf00c7720ebe71f601352dae39f7e99bf8bd01fe69d03c"} May 21 16:11:01.038124 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.038101 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" event={"ID":"4518ce87-daea-496a-9271-7d153215a5fe","Type":"ContainerStarted","Data":"c029588583e662232b83b378ebf3559bf1fbf2d3737175c0a75df84c4113e14f"} May 21 16:11:01.039033 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.039011 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerStarted","Data":"4f0ecad6a114c0a53bd74466894755c5d9f05d2c28d0408e2afeac6575954ef8"} May 21 16:11:01.039895 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.039872 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jg8qw" event={"ID":"8ecc9ecc-01bd-4859-af63-919fcfa92e04","Type":"ContainerStarted","Data":"1e75f17a10ba58c66abeeefdb5cd15e2cb7ab873352b533e28e29e50496f3856"} May 21 16:11:01.040777 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.040758 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" event={"ID":"488e5804-0e81-45e0-b444-af08d4f28819","Type":"ContainerStarted","Data":"be8f58f59fe332af638b3b8518a50971da7383ff8be179a4b9c18cad0708ba1b"} May 21 16:11:01.041735 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.041717 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"d7760efd9619031549ff46b80e2bd6c00d5a562d0b191b522b563005fad8ce90"} May 21 16:11:01.042570 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.042553 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjzwf" event={"ID":"ea42079d-6994-4f86-adbd-6ec471aa0228","Type":"ContainerStarted","Data":"0a47fb8e3adcec1b59f9e99f0b66f5926b43c6fe6a8c4fbc5ae404c8b432520b"} May 21 16:11:01.043419 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.043401 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5wxh" event={"ID":"b1ecfec0-14ab-476f-9282-88d45e4e4a29","Type":"ContainerStarted","Data":"e12d695dd98d1b2683c603b9b01ae3cb176869aeb9502c568f64e90fe2661eef"} May 21 16:11:01.641104 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.641064 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:01.641295 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:01.641118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:01.641295 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641264 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:01.641295 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641283 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:01.641295 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641296 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:01.641494 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641355 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:03.64133797 +0000 UTC m=+6.171244951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:01.641781 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641762 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:01.641865 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:01.641818 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:03.64180333 +0000 UTC m=+6.171710313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:02.032104 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:02.032022 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:02.032549 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:02.032149 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:02.032549 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:02.032257 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:02.032549 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:02.032344 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:02.054717 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:02.054682 2555 generic.go:358] "Generic (PLEG): container finished" podID="a5e6f309ba34e1c00a0316d5e7dc82cf" containerID="30cc8fc36ed803379b3d6df5386b9c3b039485b8c270207f9872bdd668eb9eb9" exitCode=0 May 21 16:11:02.055639 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:02.055583 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"a5e6f309ba34e1c00a0316d5e7dc82cf","Type":"ContainerDied","Data":"30cc8fc36ed803379b3d6df5386b9c3b039485b8c270207f9872bdd668eb9eb9"} May 21 16:11:02.070417 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:02.070368 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" podStartSLOduration=3.070350799 podStartE2EDuration="3.070350799s" podCreationTimestamp="2026-05-21 16:10:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:11:01.05000821 +0000 UTC m=+3.579915205" watchObservedRunningTime="2026-05-21 16:11:02.070350799 +0000 UTC m=+4.600257794" May 21 16:11:03.070427 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:03.070377 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"a5e6f309ba34e1c00a0316d5e7dc82cf","Type":"ContainerStarted","Data":"07b2c335cd3cbcb6805fd2cbb944fa31436a2ec3b9dea40cad044f380a40b75b"} May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:03.661816 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:03.661869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662026 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662045 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662057 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662103 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:07.662087089 +0000 UTC m=+10.191994074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662477 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:03.662563 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:03.662525 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:07.662513682 +0000 UTC m=+10.192420668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:04.028220 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.028111 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:04.028363 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:04.028258 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:04.028668 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.028650 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:04.028782 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:04.028756 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:04.411706 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.411586 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" podStartSLOduration=5.411561743 podStartE2EDuration="5.411561743s" podCreationTimestamp="2026-05-21 16:10:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:11:03.08417639 +0000 UTC m=+5.614083385" watchObservedRunningTime="2026-05-21 16:11:04.411561743 +0000 UTC m=+6.941468739" May 21 16:11:04.412641 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.412616 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5c6ms"] May 21 16:11:04.416945 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.416920 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.417048 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:04.417019 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:04.469841 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.469668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-kubelet-config\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.469841 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.469736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-dbus\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.469841 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.469760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.571002 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.570968 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-kubelet-config\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.571165 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.571031 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-dbus\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.571165 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.571058 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.571282 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:04.571167 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:04.571282 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:04.571223 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:05.07120546 +0000 UTC m=+7.601112464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:04.571543 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.571515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-kubelet-config\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:04.571543 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:04.571525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/277bb8be-fac0-4eec-b24e-48423f253d7c-dbus\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:05.074807 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:05.074777 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:05.075001 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:05.074925 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:05.075001 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:05.074983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:06.074970583 +0000 UTC m=+8.604877572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:06.028484 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:06.028370 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:06.028484 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:06.028411 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:06.028484 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:06.028422 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:06.029081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:06.028504 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:06.029081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:06.028643 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:06.029081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:06.028758 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:06.084189 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:06.084130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:06.084398 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:06.084379 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:06.084474 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:06.084454 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:08.084432764 +0000 UTC m=+10.614339754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:07.702893 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:07.702843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:07.703351 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:07.702925 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:07.703351 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703031 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:07.703351 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703092 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:15.703075298 +0000 UTC m=+18.232982289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:07.703520 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703444 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:07.703520 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703462 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:07.703520 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703474 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:07.703520 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:07.703516 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:15.703500625 +0000 UTC m=+18.233407600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:08.029405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:08.029332 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:08.029570 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:08.029467 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:08.029570 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:08.029551 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:08.029570 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:08.029463 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:08.029769 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:08.029613 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:08.029769 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:08.029673 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:08.106186 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:08.106148 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:08.106404 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:08.106301 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:08.106404 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:08.106366 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:12.106346089 +0000 UTC m=+14.636253082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:10.028468 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:10.028431 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:10.028468 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:10.028462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:10.028921 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:10.028462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:10.028921 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:10.028559 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:10.028921 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:10.028661 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:10.028921 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:10.028745 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:11.088216 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.088181 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" event={"ID":"488e5804-0e81-45e0-b444-af08d4f28819","Type":"ContainerStarted","Data":"625cb0ecab9d2093918c29174d130579d711cfd783058673f1859c0c2e617dc3"} May 21 16:11:11.090394 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.090354 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjzwf" event={"ID":"ea42079d-6994-4f86-adbd-6ec471aa0228","Type":"ContainerStarted","Data":"64fa60d786e73e7660412d801a1068cc57272d0adb716922b89bd84fc7394cbe"} May 21 16:11:11.092067 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.092040 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" event={"ID":"4518ce87-daea-496a-9271-7d153215a5fe","Type":"ContainerStarted","Data":"9998dcf8372e8e75f40d30680cd9097a6870592f0269b9a0a19484fb152adafd"} May 21 16:11:11.094866 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.094415 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerStarted","Data":"3c8ca8e302d578531667e20f7a96b7eaf312761dc43d412fb4fb33a18615c470"} May 21 16:11:11.096206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.096177 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jg8qw" event={"ID":"8ecc9ecc-01bd-4859-af63-919fcfa92e04","Type":"ContainerStarted","Data":"a1b08d343813fdd2d9f21e12b2dbe0cb0277130779b0c30bc6af23b5265d801d"} May 21 16:11:11.103123 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.103075 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjzwf" podStartSLOduration=3.1963492430000002 podStartE2EDuration="13.103060228s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.806754292 +0000 UTC m=+3.336661265" lastFinishedPulling="2026-05-21 16:11:10.713465265 +0000 UTC m=+13.243372250" observedRunningTime="2026-05-21 16:11:11.10271662 +0000 UTC m=+13.632623614" watchObservedRunningTime="2026-05-21 16:11:11.103060228 +0000 UTC m=+13.632967222" May 21 16:11:11.114442 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.114395 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jg8qw" podStartSLOduration=3.215103858 podStartE2EDuration="13.114377683s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.808193102 +0000 UTC m=+3.338100073" lastFinishedPulling="2026-05-21 16:11:10.707466926 +0000 UTC m=+13.237373898" observedRunningTime="2026-05-21 16:11:11.113973794 +0000 UTC m=+13.643880789" watchObservedRunningTime="2026-05-21 16:11:11.114377683 +0000 UTC m=+13.644284678" May 21 16:11:11.145880 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.145813 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jlwlm" podStartSLOduration=3.177078746 podStartE2EDuration="13.1457965s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.814064299 +0000 UTC m=+3.343971274" lastFinishedPulling="2026-05-21 16:11:10.782782043 +0000 UTC m=+13.312689028" observedRunningTime="2026-05-21 16:11:11.145766625 +0000 UTC m=+13.675673611" watchObservedRunningTime="2026-05-21 16:11:11.1457965 +0000 UTC m=+13.675703493" May 21 16:11:11.947906 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.947640 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:11.948321 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:11.948295 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:12.028428 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.028401 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:12.028613 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:12.028502 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:12.028739 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.028718 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:12.028826 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.028721 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:12.028874 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:12.028824 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:12.028947 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:12.028922 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:12.099158 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.099129 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:12.099570 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.099528 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjzwf" May 21 16:11:12.141888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:12.141835 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:12.142081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:12.141995 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:12.142081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:12.142072 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:20.142051761 +0000 UTC m=+22.671958737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:13.101524 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:13.101482 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5wxh" event={"ID":"b1ecfec0-14ab-476f-9282-88d45e4e4a29","Type":"ContainerStarted","Data":"629e1e2e3fa6e947b858ac3d3d4ae9434b116f6ad4de129cfa2da29c058397d8"} May 21 16:11:13.117738 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:13.117693 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5wxh" podStartSLOduration=5.203544265 podStartE2EDuration="15.117678324s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.802543008 +0000 UTC m=+3.332449980" lastFinishedPulling="2026-05-21 16:11:10.716677052 +0000 UTC m=+13.246584039" observedRunningTime="2026-05-21 16:11:13.117396254 +0000 UTC m=+15.647303249" watchObservedRunningTime="2026-05-21 16:11:13.117678324 +0000 UTC m=+15.647585317" May 21 16:11:14.028226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:14.028183 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:14.028226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:14.028224 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:14.028474 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:14.028185 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:14.028474 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:14.028342 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:14.028474 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:14.028404 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:14.028634 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:14.028479 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:15.768785 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:15.768697 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:15.768785 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:15.768733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768845 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768852 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768872 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768881 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768912 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:31.768891664 +0000 UTC m=+34.298798642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:15.769381 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:15.768932 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:31.768923535 +0000 UTC m=+34.298830507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:16.028659 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:16.028562 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:16.028819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:16.028562 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:16.028819 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:16.028714 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:16.028950 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:16.028819 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:16.028950 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:16.028871 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:16.028950 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:16.028941 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:16.108444 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:16.108401 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="3c8ca8e302d578531667e20f7a96b7eaf312761dc43d412fb4fb33a18615c470" exitCode=0 May 21 16:11:16.108444 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:16.108440 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"3c8ca8e302d578531667e20f7a96b7eaf312761dc43d412fb4fb33a18615c470"} May 21 16:11:18.029040 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:18.029004 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:18.029693 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:18.029108 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:18.029693 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:18.029139 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:18.029693 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:18.029175 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:18.029693 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:18.029214 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:18.029693 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:18.029268 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:19.764127 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:19.763910 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 16:11:19.988900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:19.988818 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T16:11:19.764124318Z","UUID":"6471534e-9bc7-4d3f-bca5-d64a0652befe","Handler":null,"Name":"","Endpoint":""} May 21 16:11:19.990443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:19.990422 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 16:11:19.990528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:19.990451 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 16:11:20.028431 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.028408 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:20.028431 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.028419 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:20.028633 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.028423 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:20.028633 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:20.028502 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:20.028633 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:20.028585 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:20.028749 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:20.028661 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:20.116105 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.116070 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2r6bb" event={"ID":"b5ada9b2-85c7-4b92-b428-0e5e86969b8d","Type":"ContainerStarted","Data":"5e3a839e24438391acb837b832761fbd4dbb4813f18109c44149bcb1f506b749"} May 21 16:11:20.118390 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.118358 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" event={"ID":"488e5804-0e81-45e0-b444-af08d4f28819","Type":"ContainerStarted","Data":"623328ffc0e9e15256d14193df6746f43c98d73201f268213cf650c479551f69"} May 21 16:11:20.126195 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126153 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"c9e2866711d2b6d247989f43357bc18252906bbb699cde9e742151153490b2cd"} May 21 16:11:20.126352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126199 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"6c018f4085a9009d7656226266787ce6e75c21fff28aa096f62dac30c57cadb6"} May 21 16:11:20.126352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126212 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"25953b442845875eb22397e554b16145d3cf1bd2155fab2ccab798f5512727d8"} May 21 16:11:20.126352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126223 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"bbbd9087948edaf0a998aa4eb867f0a6c8330a87b69ffc0a41f0fdfa954c7936"} May 21 16:11:20.126352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126234 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"1ff09fff80748f62adb77eb6c737c8caeebafaf8a7225bd402012e6ccf2a54dc"} May 21 16:11:20.126352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.126246 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"c306a7e965a8e633975cfbb2d73897e74524a27f2817a3a7ffa25c39845b2b7f"} May 21 16:11:20.147828 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.147777 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2r6bb" podStartSLOduration=3.579779855 podStartE2EDuration="22.147762041s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.816991115 +0000 UTC m=+3.346898090" lastFinishedPulling="2026-05-21 16:11:19.3849733 +0000 UTC m=+21.914880276" observedRunningTime="2026-05-21 16:11:20.147709782 +0000 UTC m=+22.677616776" watchObservedRunningTime="2026-05-21 16:11:20.147762041 +0000 UTC m=+22.677669036" May 21 16:11:20.201008 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.200975 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:20.201142 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:20.201083 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 16:11:20.201181 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:20.201143 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret podName:277bb8be-fac0-4eec-b24e-48423f253d7c nodeName:}" failed. No retries permitted until 2026-05-21 16:11:36.201125421 +0000 UTC m=+38.731032413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret") pod "global-pull-secret-syncer-5c6ms" (UID: "277bb8be-fac0-4eec-b24e-48423f253d7c") : object "kube-system"/"original-pull-secret" not registered May 21 16:11:20.254488 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.254422 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-bj28k"] May 21 16:11:20.256630 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.256588 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.259389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.259370 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 16:11:20.259523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.259505 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hl654\"" May 21 16:11:20.259829 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.259814 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 16:11:20.402752 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.402538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-tmp-dir\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.402927 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.402772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n9tk\" (UniqueName: \"kubernetes.io/projected/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-kube-api-access-7n9tk\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.402927 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.402800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-hosts-file\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.503981 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.503948 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-hosts-file\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.504173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.504035 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-tmp-dir\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.504173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.504056 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7n9tk\" (UniqueName: \"kubernetes.io/projected/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-kube-api-access-7n9tk\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.504173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.504094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-hosts-file\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.504728 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.504675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-tmp-dir\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.513922 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.513898 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n9tk\" (UniqueName: \"kubernetes.io/projected/d1bb26ff-8204-420e-a8b9-ef4f1df4351c-kube-api-access-7n9tk\") pod \"node-resolver-bj28k\" (UID: \"d1bb26ff-8204-420e-a8b9-ef4f1df4351c\") " pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.565943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:20.565909 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bj28k" May 21 16:11:20.573785 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:20.573747 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bb26ff_8204_420e_a8b9_ef4f1df4351c.slice/crio-b5bde2f09856e06d3084bbb7bc5c2c3fc98fc3e86bb7167117328ff928f23303 WatchSource:0}: Error finding container b5bde2f09856e06d3084bbb7bc5c2c3fc98fc3e86bb7167117328ff928f23303: Status 404 returned error can't find the container with id b5bde2f09856e06d3084bbb7bc5c2c3fc98fc3e86bb7167117328ff928f23303 May 21 16:11:21.129975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:21.129886 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bj28k" event={"ID":"d1bb26ff-8204-420e-a8b9-ef4f1df4351c","Type":"ContainerStarted","Data":"76a51e56cc122d19c2799dde1cc810a9e36a5b289fe3ed91edd3a5f04d52de34"} May 21 16:11:21.129975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:21.129946 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bj28k" event={"ID":"d1bb26ff-8204-420e-a8b9-ef4f1df4351c","Type":"ContainerStarted","Data":"b5bde2f09856e06d3084bbb7bc5c2c3fc98fc3e86bb7167117328ff928f23303"} May 21 16:11:21.144843 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:21.144799 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-bj28k" podStartSLOduration=1.144781792 podStartE2EDuration="1.144781792s" podCreationTimestamp="2026-05-21 16:11:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:11:21.144615676 +0000 UTC m=+23.674522667" watchObservedRunningTime="2026-05-21 16:11:21.144781792 +0000 UTC m=+23.674688786" May 21 16:11:22.028509 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:22.028468 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:22.028719 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:22.028487 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:22.028719 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:22.028625 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:22.028719 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:22.028623 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:22.028897 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:22.028729 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:22.028897 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:22.028819 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:22.133724 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:22.133685 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" event={"ID":"488e5804-0e81-45e0-b444-af08d4f28819","Type":"ContainerStarted","Data":"4b5de9b6f890769bf58f3d5deb87fff0b358918eae6fadeba0d158e0428c02cc"} May 21 16:11:22.149610 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:22.149537 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbt8m" podStartSLOduration=3.883101361 podStartE2EDuration="24.149522256s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.812166586 +0000 UTC m=+3.342073571" lastFinishedPulling="2026-05-21 16:11:21.078587488 +0000 UTC m=+23.608494466" observedRunningTime="2026-05-21 16:11:22.149422085 +0000 UTC m=+24.679329079" watchObservedRunningTime="2026-05-21 16:11:22.149522256 +0000 UTC m=+24.679429250" May 21 16:11:23.139104 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:23.139069 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"7fc6900e021473909fa2a2b956af75077e67a862d7f3414a8533111b13e9244a"} May 21 16:11:24.028236 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:24.028202 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:24.028398 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:24.028209 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:24.028398 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:24.028334 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:24.028468 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:24.028394 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:24.028468 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:24.028413 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:24.028533 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:24.028467 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:25.146101 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.145883 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" event={"ID":"890d57f8-f340-486d-8f77-9ceffc7549ef","Type":"ContainerStarted","Data":"710e010a2f7b6714ded54dc1492fcc8414ef9ff076f4149c57f82df9a95cb8db"} May 21 16:11:25.146680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.146140 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:25.146680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.146254 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:25.146680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.146354 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:25.163082 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.163055 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:25.163969 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.163944 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:11:25.174825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:25.174782 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" podStartSLOduration=8.598776522 podStartE2EDuration="27.174765645s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.809539739 +0000 UTC m=+3.339446725" lastFinishedPulling="2026-05-21 16:11:19.38552886 +0000 UTC m=+21.915435848" observedRunningTime="2026-05-21 16:11:25.174739728 +0000 UTC m=+27.704646734" watchObservedRunningTime="2026-05-21 16:11:25.174765645 +0000 UTC m=+27.704672638" May 21 16:11:26.029825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.029787 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:26.029825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.029825 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:26.030037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.029925 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:26.030037 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.029941 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:26.030037 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.030027 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:26.030177 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.030093 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:26.149477 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.149446 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerStarted","Data":"2e7393b12c64218721c13a6c650bff0b58c5bbbfbc4b8609aeb8ef751fb1f875"} May 21 16:11:26.194220 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.194188 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5c6ms"] May 21 16:11:26.194356 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.194289 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:26.194394 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.194370 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:26.197184 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.197144 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4hpp"] May 21 16:11:26.197314 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.197260 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:26.197390 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.197369 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:26.197745 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.197722 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tphnz"] May 21 16:11:26.197825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:26.197805 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:26.197905 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:26.197887 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:27.152206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:27.152171 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="2e7393b12c64218721c13a6c650bff0b58c5bbbfbc4b8609aeb8ef751fb1f875" exitCode=0 May 21 16:11:27.152702 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:27.152250 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"2e7393b12c64218721c13a6c650bff0b58c5bbbfbc4b8609aeb8ef751fb1f875"} May 21 16:11:28.029173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:28.029129 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:28.029362 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:28.029251 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:28.029362 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:28.029270 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:28.029362 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:28.029294 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:28.029499 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:28.029361 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:28.029499 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:28.029432 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:29.157713 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:29.157509 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="6864b5995e7b9b1f346b9ec26223499df489c48509274f6c847c04664b586078" exitCode=0 May 21 16:11:29.158110 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:29.157575 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"6864b5995e7b9b1f346b9ec26223499df489c48509274f6c847c04664b586078"} May 21 16:11:30.028491 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:30.028461 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:30.028669 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:30.028461 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:30.028669 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:30.028462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:30.028669 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:30.028549 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:30.028780 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:30.028681 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:30.028780 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:30.028753 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:30.162276 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:30.162185 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="e6af55b60b5ce9435fc9a1d59186f20c738f5ad43cf5f6158a97dd5ccf2b4f63" exitCode=0 May 21 16:11:30.162276 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:30.162237 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"e6af55b60b5ce9435fc9a1d59186f20c738f5ad43cf5f6158a97dd5ccf2b4f63"} May 21 16:11:31.795213 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:31.795182 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:31.795220 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795328 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795340 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795349 2555 projected.go:194] Error preparing data for projected volume kube-api-access-hq6kw for pod openshift-network-diagnostics/network-check-target-m4hpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795347 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795407 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw podName:3ff63bd6-71ac-444f-a99e-1a085671a6d9 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:03.795389792 +0000 UTC m=+66.325296764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hq6kw" (UniqueName: "kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw") pod "network-check-target-m4hpp" (UID: "3ff63bd6-71ac-444f-a99e-1a085671a6d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:31.795784 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:31.795426 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:03.795416952 +0000 UTC m=+66.325323924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:32.028180 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.028105 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:32.028180 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.028136 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:32.028392 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.028218 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4hpp" podUID="3ff63bd6-71ac-444f-a99e-1a085671a6d9" May 21 16:11:32.028392 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.028254 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:32.028392 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.028372 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:11:32.028552 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.028426 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c6ms" podUID="277bb8be-fac0-4eec-b24e-48423f253d7c" May 21 16:11:32.251635 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.251587 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeReady" May 21 16:11:32.251774 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.251747 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 16:11:32.289792 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.289715 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75995db8d7-6sp22"] May 21 16:11:32.291613 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.291573 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.292727 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.292694 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl"] May 21 16:11:32.294194 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.294176 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx"] May 21 16:11:32.294354 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.294334 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.294457 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.294445 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 16:11:32.294513 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.294460 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 16:11:32.294793 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.294775 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jpwrx\"" May 21 16:11:32.295463 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.295446 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 16:11:32.295710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.295698 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" May 21 16:11:32.297323 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.297305 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 16:11:32.297639 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.297619 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 16:11:32.297740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.297685 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ltjmm\"" May 21 16:11:32.298105 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.298087 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 16:11:32.298366 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.298349 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gk9k2\"" May 21 16:11:32.298859 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.298844 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 16:11:32.299839 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.299820 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 16:11:32.304117 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.304090 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vnsx"] May 21 16:11:32.306556 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.306532 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.311029 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.311007 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 16:11:32.311326 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.311309 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 16:11:32.311481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.311467 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl8jw\"" May 21 16:11:32.316059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.316038 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75995db8d7-6sp22"] May 21 16:11:32.316707 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.316682 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl"] May 21 16:11:32.317327 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.317301 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5d9mz"] May 21 16:11:32.321261 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.321240 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vnsx"] May 21 16:11:32.321359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.321266 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx"] May 21 16:11:32.321420 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.321366 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.326145 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.325497 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94pnq\"" May 21 16:11:32.326145 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.325788 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 16:11:32.326145 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.325808 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 16:11:32.326145 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.325998 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 16:11:32.326145 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.326079 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5d9mz"] May 21 16:11:32.399610 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.399750 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-config-volume\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.399750 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kqf\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399812 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399963 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.399963 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrgdq\" (UniqueName: \"kubernetes.io/projected/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-kube-api-access-nrgdq\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.399963 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dq9\" (UniqueName: \"kubernetes.io/projected/d2a5d505-134e-4548-9f98-6656f93460ab-kube-api-access-j2dq9\") pod \"network-check-source-7f44b6dd87-kbtzx\" (UID: \"d2a5d505-134e-4548-9f98-6656f93460ab\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" May 21 16:11:32.399963 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-tmp-dir\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.400122 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.399971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ae48aae-817a-4fb9-b908-e328a11faa14-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.400122 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.400021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.400122 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.400041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.400122 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.400060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.500953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.500916 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.500953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.500953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.500970 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.500998 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-config-volume\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501033 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501052 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501070 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kqf\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501098 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:32.501176 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501171 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:33.001151408 +0000 UTC m=+35.531058384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501102 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501240 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501295 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501309 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501324 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501327 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrgdq\" (UniqueName: \"kubernetes.io/projected/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-kube-api-access-nrgdq\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6s82\" (UniqueName: \"kubernetes.io/projected/ac1e190e-4d93-43fb-8ebc-394619d741e1-kube-api-access-l6s82\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501381 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:33.001363902 +0000 UTC m=+35.531270888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501458 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dq9\" (UniqueName: \"kubernetes.io/projected/d2a5d505-134e-4548-9f98-6656f93460ab-kube-api-access-j2dq9\") pod \"network-check-source-7f44b6dd87-kbtzx\" (UID: \"d2a5d505-134e-4548-9f98-6656f93460ab\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501489 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-tmp-dir\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.501523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ae48aae-817a-4fb9-b908-e328a11faa14-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501574 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501624 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501740 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.501780 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:33.001766152 +0000 UTC m=+35.531673126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501776 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-config-volume\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.502052 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.501941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-tmp-dir\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.502358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.502050 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.502358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.502054 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.502358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.502182 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.502358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.502226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8ae48aae-817a-4fb9-b908-e328a11faa14-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:32.505756 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.505736 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.505756 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.505748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.509786 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.509751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.510106 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.510090 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrgdq\" (UniqueName: \"kubernetes.io/projected/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-kube-api-access-nrgdq\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:32.510824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.510799 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kqf\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:32.511078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.511062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dq9\" (UniqueName: \"kubernetes.io/projected/d2a5d505-134e-4548-9f98-6656f93460ab-kube-api-access-j2dq9\") pod \"network-check-source-7f44b6dd87-kbtzx\" (UID: \"d2a5d505-134e-4548-9f98-6656f93460ab\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" May 21 16:11:32.602625 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.602576 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6s82\" (UniqueName: \"kubernetes.io/projected/ac1e190e-4d93-43fb-8ebc-394619d741e1-kube-api-access-l6s82\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.602820 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.602686 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.602820 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.602798 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:32.602933 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:32.602873 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:33.10285308 +0000 UTC m=+35.632760072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:32.611772 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.611747 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6s82\" (UniqueName: \"kubernetes.io/projected/ac1e190e-4d93-43fb-8ebc-394619d741e1-kube-api-access-l6s82\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:32.626762 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.626737 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" May 21 16:11:32.770999 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:32.770797 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx"] May 21 16:11:32.774637 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:32.774584 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a5d505_134e_4548_9f98_6656f93460ab.slice/crio-d0b9482bcfcdb06db0d2f5c3e9b8fa6a38beadf39c73c78916a11990c359dc09 WatchSource:0}: Error finding container d0b9482bcfcdb06db0d2f5c3e9b8fa6a38beadf39c73c78916a11990c359dc09: Status 404 returned error can't find the container with id d0b9482bcfcdb06db0d2f5c3e9b8fa6a38beadf39c73c78916a11990c359dc09 May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:33.006754 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:33.006818 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:33.006859 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.006887 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.006955 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:34.006936464 +0000 UTC m=+36.536843437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.006969 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.006984 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.006998 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:33.007029 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.007025 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:34.007008469 +0000 UTC m=+36.536915448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:33.007947 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.007052 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:34.00704112 +0000 UTC m=+36.536948095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:33.107472 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:33.107433 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:33.107654 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.107580 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:33.107712 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:33.107669 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:34.107651496 +0000 UTC m=+36.637558473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:33.169351 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:33.169313 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" event={"ID":"d2a5d505-134e-4548-9f98-6656f93460ab","Type":"ContainerStarted","Data":"d0b9482bcfcdb06db0d2f5c3e9b8fa6a38beadf39c73c78916a11990c359dc09"} May 21 16:11:34.015799 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.015758 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.015824 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.015880 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.015908 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.015973 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:36.015957108 +0000 UTC m=+38.545864079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.015986 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.016057 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:36.016038712 +0000 UTC m=+38.545945691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.015998 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.016080 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:34.016271 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.016111 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:36.01610436 +0000 UTC m=+38.546011333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:34.027850 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.027827 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:34.027975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.027869 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:11:34.027975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.027875 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:11:34.031422 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.031399 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlj8\"" May 21 16:11:34.031528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.031443 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 16:11:34.031528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.031402 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 16:11:34.031528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.031399 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zt6m\"" May 21 16:11:34.117089 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:34.117045 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:34.117260 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.117237 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:34.117317 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:34.117309 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:36.117291843 +0000 UTC m=+38.647198833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:36.035999 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.035915 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:36.035999 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.035981 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.036048 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036056 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036118 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.036099602 +0000 UTC m=+42.566006577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036150 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036163 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036174 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036206 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.036195722 +0000 UTC m=+42.566102708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:36.036412 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.036231 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.036211489 +0000 UTC m=+42.566118480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:36.137530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.137480 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:36.137728 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.137687 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:36.137790 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:36.137770 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.137754399 +0000 UTC m=+42.667661372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:36.238625 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.238565 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:36.242806 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.242777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/277bb8be-fac0-4eec-b24e-48423f253d7c-original-pull-secret\") pod \"global-pull-secret-syncer-5c6ms\" (UID: \"277bb8be-fac0-4eec-b24e-48423f253d7c\") " pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:36.444304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:36.444269 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c6ms" May 21 16:11:38.710059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:38.709839 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5c6ms"] May 21 16:11:38.713117 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:11:38.713096 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277bb8be_fac0_4eec_b24e_48423f253d7c.slice/crio-2ca98799639f59ca0d0747e4810d0e8b9b493f10dbedad2a7ac6a87c2c35768a WatchSource:0}: Error finding container 2ca98799639f59ca0d0747e4810d0e8b9b493f10dbedad2a7ac6a87c2c35768a: Status 404 returned error can't find the container with id 2ca98799639f59ca0d0747e4810d0e8b9b493f10dbedad2a7ac6a87c2c35768a May 21 16:11:39.183460 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:39.183418 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" event={"ID":"d2a5d505-134e-4548-9f98-6656f93460ab","Type":"ContainerStarted","Data":"f2f0ae0645543e38514ebebf7db648b78226c838ed9a59bbee3128068e75b50f"} May 21 16:11:39.184558 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:39.184521 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5c6ms" event={"ID":"277bb8be-fac0-4eec-b24e-48423f253d7c","Type":"ContainerStarted","Data":"2ca98799639f59ca0d0747e4810d0e8b9b493f10dbedad2a7ac6a87c2c35768a"} May 21 16:11:39.187020 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:39.186999 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="26b36bff6b647521f591a67c1522528d559cac6d21c3ecc5f708580db043af65" exitCode=0 May 21 16:11:39.187112 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:39.187029 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"26b36bff6b647521f591a67c1522528d559cac6d21c3ecc5f708580db043af65"} May 21 16:11:39.201673 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:39.201628 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kbtzx" podStartSLOduration=33.422086621 podStartE2EDuration="39.20161521s" podCreationTimestamp="2026-05-21 16:11:00 +0000 UTC" firstStartedPulling="2026-05-21 16:11:32.776921991 +0000 UTC m=+35.306828976" lastFinishedPulling="2026-05-21 16:11:38.556450588 +0000 UTC m=+41.086357565" observedRunningTime="2026-05-21 16:11:39.200877358 +0000 UTC m=+41.730784362" watchObservedRunningTime="2026-05-21 16:11:39.20161521 +0000 UTC m=+41.731522200" May 21 16:11:40.081560 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.081517 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.081615 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.081647 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081697 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081719 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081725 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081742 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081774 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:48.081760488 +0000 UTC m=+50.611667460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081792 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:48.081785723 +0000 UTC m=+50.611692694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:40.082292 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.081801 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:48.081796081 +0000 UTC m=+50.611703053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:40.182822 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.182775 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:40.182981 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.182907 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:40.183021 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:40.182985 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:48.182965983 +0000 UTC m=+50.712872962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:40.192193 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.192150 2555 generic.go:358] "Generic (PLEG): container finished" podID="6a4d7a5d-bc2b-4acd-9e4b-18761add406f" containerID="ba95fcd0ba4fa2842fa406bf121c33171e5103cfae845e75637e2f66c88e5c39" exitCode=0 May 21 16:11:40.192361 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:40.192230 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerDied","Data":"ba95fcd0ba4fa2842fa406bf121c33171e5103cfae845e75637e2f66c88e5c39"} May 21 16:11:41.201423 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:41.201386 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" event={"ID":"6a4d7a5d-bc2b-4acd-9e4b-18761add406f","Type":"ContainerStarted","Data":"5e90f9955fa5c0558ab2415f46e55ee71d1c14829b06d3f65be12c9b334f65a5"} May 21 16:11:45.210282 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:45.210095 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5c6ms" event={"ID":"277bb8be-fac0-4eec-b24e-48423f253d7c","Type":"ContainerStarted","Data":"d6a3810f69d23d18affd83fa9457a195d30642d2ae38e0dd07e3834a5c369d77"} May 21 16:11:45.225849 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:45.225803 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5c6ms" podStartSLOduration=35.540728942 podStartE2EDuration="41.225790188s" podCreationTimestamp="2026-05-21 16:11:04 +0000 UTC" firstStartedPulling="2026-05-21 16:11:38.715140588 +0000 UTC m=+41.245047560" lastFinishedPulling="2026-05-21 16:11:44.400201835 +0000 UTC m=+46.930108806" observedRunningTime="2026-05-21 16:11:45.225187228 +0000 UTC m=+47.755094246" watchObservedRunningTime="2026-05-21 16:11:45.225790188 +0000 UTC m=+47.755697179" May 21 16:11:45.226121 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:45.226098 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g5t6s" podStartSLOduration=9.459788493 podStartE2EDuration="47.226092483s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:11:00.813574448 +0000 UTC m=+3.343481433" lastFinishedPulling="2026-05-21 16:11:38.579878438 +0000 UTC m=+41.109785423" observedRunningTime="2026-05-21 16:11:41.224835225 +0000 UTC m=+43.754742219" watchObservedRunningTime="2026-05-21 16:11:45.226092483 +0000 UTC m=+47.755999480" May 21 16:11:48.145297 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:48.145254 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:48.145355 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:48.145397 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145402 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145422 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145471 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:04.145455842 +0000 UTC m=+66.675362814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145493 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145507 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145546 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:04.145533083 +0000 UTC m=+66.675440065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:11:48.145902 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.145565 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:04.145551889 +0000 UTC m=+66.675458877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:11:48.246222 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:48.246194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:11:48.246375 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.246332 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:11:48.246420 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:11:48.246384 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:04.246370525 +0000 UTC m=+66.776277497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:11:57.164653 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:11:57.164622 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7qqz6" May 21 16:12:01.284441 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.284400 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd"] May 21 16:12:01.287268 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.287246 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.289825 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.289793 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 16:12:01.289952 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.289793 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 16:12:01.289952 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.289793 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 16:12:01.290831 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.290811 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 16:12:01.290974 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.290811 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 16:12:01.290974 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.290811 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 16:12:01.290974 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.290862 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 16:12:01.295767 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.295748 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd"] May 21 16:12:01.347619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.347619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.347842 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.347842 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk7z9\" (UniqueName: \"kubernetes.io/projected/b8db46bb-cdf0-4e5c-9319-4efc178c3559-kube-api-access-pk7z9\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.347842 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.347842 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.347779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448827 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448777 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448856 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448905 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448925 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448943 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.448968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.448959 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pk7z9\" (UniqueName: \"kubernetes.io/projected/b8db46bb-cdf0-4e5c-9319-4efc178c3559-kube-api-access-pk7z9\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.449620 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.449572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.453543 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.453514 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.453661 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.453646 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-ca\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.453800 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.453784 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.453851 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.453832 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8db46bb-cdf0-4e5c-9319-4efc178c3559-hub\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.459693 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.459659 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk7z9\" (UniqueName: \"kubernetes.io/projected/b8db46bb-cdf0-4e5c-9319-4efc178c3559-kube-api-access-pk7z9\") pod \"cluster-proxy-proxy-agent-7787d8567f-trwvd\" (UID: \"b8db46bb-cdf0-4e5c-9319-4efc178c3559\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.603711 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.603674 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:12:01.728288 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:01.728257 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd"] May 21 16:12:01.731623 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:12:01.731576 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8db46bb_cdf0_4e5c_9319_4efc178c3559.slice/crio-f093dc1eed440bbb5568924d146177a44e7e2e53a76c813f0ebca53416f96909 WatchSource:0}: Error finding container f093dc1eed440bbb5568924d146177a44e7e2e53a76c813f0ebca53416f96909: Status 404 returned error can't find the container with id f093dc1eed440bbb5568924d146177a44e7e2e53a76c813f0ebca53416f96909 May 21 16:12:02.243249 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:02.243211 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerStarted","Data":"f093dc1eed440bbb5568924d146177a44e7e2e53a76c813f0ebca53416f96909"} May 21 16:12:03.868818 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:03.868781 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:12:03.868818 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:03.868824 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:12:03.871449 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:03.871421 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 16:12:03.871705 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:03.871686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq6kw\" (UniqueName: \"kubernetes.io/projected/3ff63bd6-71ac-444f-a99e-1a085671a6d9-kube-api-access-hq6kw\") pod \"network-check-target-m4hpp\" (UID: \"3ff63bd6-71ac-444f-a99e-1a085671a6d9\") " pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:12:03.879641 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:03.879608 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 16:12:03.879766 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:03.879700 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:07.879680949 +0000 UTC m=+130.409587921 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : secret "metrics-daemon-secret" not found May 21 16:12:04.041028 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.040981 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zt6m\"" May 21 16:12:04.049203 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.049163 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:12:04.171851 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.171747 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:12:04.171851 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.171827 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.171881 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.171909 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.171972 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.172000 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.172013 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.171980 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:36.171959217 +0000 UTC m=+98.701866193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.172055 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:36.172037705 +0000 UTC m=+98.701944681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:12:04.172079 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.172077 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:36.172066827 +0000 UTC m=+98.701973799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:12:04.272793 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.272761 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:12:04.272982 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.272888 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:04.272982 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:04.272951 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:36.272934767 +0000 UTC m=+98.802841745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:12:04.834096 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:04.834035 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4hpp"] May 21 16:12:04.838742 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:12:04.838702 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff63bd6_71ac_444f_a99e_1a085671a6d9.slice/crio-69aa7f3b61684ad3ee6c577760d1fd506ac8d8d01fa18636d3fe128f515755d5 WatchSource:0}: Error finding container 69aa7f3b61684ad3ee6c577760d1fd506ac8d8d01fa18636d3fe128f515755d5: Status 404 returned error can't find the container with id 69aa7f3b61684ad3ee6c577760d1fd506ac8d8d01fa18636d3fe128f515755d5 May 21 16:12:05.251350 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:05.251317 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4hpp" event={"ID":"3ff63bd6-71ac-444f-a99e-1a085671a6d9","Type":"ContainerStarted","Data":"0b384e227973031f52c6f02019a1ffd2d2a35078002ae9223bc24a35933c41e5"} May 21 16:12:05.251350 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:05.251356 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4hpp" event={"ID":"3ff63bd6-71ac-444f-a99e-1a085671a6d9","Type":"ContainerStarted","Data":"69aa7f3b61684ad3ee6c577760d1fd506ac8d8d01fa18636d3fe128f515755d5"} May 21 16:12:05.251858 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:05.251396 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:12:05.252675 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:05.252652 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerStarted","Data":"2e2167a6dbb0673d023cb01021989104ce542273d32d97339ced33c2f2199dd6"} May 21 16:12:05.271085 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:05.271044 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m4hpp" podStartSLOduration=67.271032355 podStartE2EDuration="1m7.271032355s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:12:05.270420518 +0000 UTC m=+67.800327513" watchObservedRunningTime="2026-05-21 16:12:05.271032355 +0000 UTC m=+67.800939350" May 21 16:12:08.260721 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:08.260682 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerStarted","Data":"4af181b76531afe4c533ca04fdb5f25a6219f3d9e771e85f0f90e1a8cd873611"} May 21 16:12:08.260721 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:08.260724 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerStarted","Data":"eed07e545b72d9426cf8db83bddb026dea08104199a7b5d75ec14da0f77b2ca3"} May 21 16:12:36.220659 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.220617 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.220687 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.220733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220788 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220817 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220789 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220869 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220872 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:40.220854949 +0000 UTC m=+162.750761924 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220886 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:40.220880602 +0000 UTC m=+162.750787573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:12:36.221081 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.220896 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:40.220891468 +0000 UTC m=+162.750798440 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:12:36.257074 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.257048 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m4hpp" May 21 16:12:36.274348 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.274298 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" podStartSLOduration=29.530338119 podStartE2EDuration="35.274282209s" podCreationTimestamp="2026-05-21 16:12:01 +0000 UTC" firstStartedPulling="2026-05-21 16:12:01.73327539 +0000 UTC m=+64.263182362" lastFinishedPulling="2026-05-21 16:12:07.47721948 +0000 UTC m=+70.007126452" observedRunningTime="2026-05-21 16:12:08.30300343 +0000 UTC m=+70.832910424" watchObservedRunningTime="2026-05-21 16:12:36.274282209 +0000 UTC m=+98.804189263" May 21 16:12:36.321299 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:12:36.321261 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:12:36.321461 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.321385 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:36.321461 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:12:36.321434 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:40.321421556 +0000 UTC m=+162.851328530 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:13:07.953375 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:07.953314 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:13:07.953893 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:07.953437 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 16:13:07.953893 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:07.953499 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs podName:a13c9f8c-3e4e-4f93-8257-0a221759ab83 nodeName:}" failed. No retries permitted until 2026-05-21 16:15:09.953484604 +0000 UTC m=+252.483391578 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs") pod "network-metrics-daemon-tphnz" (UID: "a13c9f8c-3e4e-4f93-8257-0a221759ab83") : secret "metrics-daemon-secret" not found May 21 16:13:35.307059 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:35.306998 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" podUID="036c9c1c-0f3b-47bd-973e-22a0867b1e08" May 21 16:13:35.316201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:35.316175 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" podUID="8ae48aae-817a-4fb9-b908-e328a11faa14" May 21 16:13:35.335396 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:35.335361 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7vnsx" podUID="ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4" May 21 16:13:35.341505 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:35.341479 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-5d9mz" podUID="ac1e190e-4d93-43fb-8ebc-394619d741e1" May 21 16:13:35.464954 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:35.464922 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:13:35.464954 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:35.464950 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vnsx" May 21 16:13:35.465142 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:35.464925 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:13:35.465142 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:35.464925 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:13:37.049560 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:37.049504 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tphnz" podUID="a13c9f8c-3e4e-4f93-8257-0a221759ab83" May 21 16:13:40.311797 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:40.311752 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:40.311808 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:40.311841 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") pod \"image-registry-75995db8d7-6sp22\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311897 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311943 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311953 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75995db8d7-6sp22: secret "image-registry-tls" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311954 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311970 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls podName:ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4 nodeName:}" failed. No retries permitted until 2026-05-21 16:15:42.311953983 +0000 UTC m=+284.841860956 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls") pod "dns-default-7vnsx" (UID: "ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4") : secret "dns-default-metrics-tls" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.311989 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls podName:036c9c1c-0f3b-47bd-973e-22a0867b1e08 nodeName:}" failed. No retries permitted until 2026-05-21 16:15:42.311977781 +0000 UTC m=+284.841884754 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls") pod "image-registry-75995db8d7-6sp22" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08") : secret "image-registry-tls" not found May 21 16:13:40.312201 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.312010 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert podName:8ae48aae-817a-4fb9-b908-e328a11faa14 nodeName:}" failed. No retries permitted until 2026-05-21 16:15:42.311994991 +0000 UTC m=+284.841901962 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-jp8bl" (UID: "8ae48aae-817a-4fb9-b908-e328a11faa14") : secret "networking-console-plugin-cert" not found May 21 16:13:40.413072 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:40.413036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:13:40.413243 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.413198 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:13:40.413283 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:13:40.413272 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert podName:ac1e190e-4d93-43fb-8ebc-394619d741e1 nodeName:}" failed. No retries permitted until 2026-05-21 16:15:42.413255384 +0000 UTC m=+284.943162357 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert") pod "ingress-canary-5d9mz" (UID: "ac1e190e-4d93-43fb-8ebc-394619d741e1") : secret "canary-serving-cert" not found May 21 16:13:47.243359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:47.243285 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bj28k_d1bb26ff-8204-420e-a8b9-ef4f1df4351c/dns-node-resolver/0.log" May 21 16:13:48.643691 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:48.643661 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jg8qw_8ecc9ecc-01bd-4859-af63-919fcfa92e04/node-ca/0.log" May 21 16:13:52.027928 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:13:52.027892 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:14:08.735733 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.735699 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lq9qz"] May 21 16:14:08.738879 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.738855 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.742319 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.742285 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 16:14:08.742319 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.742305 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6nsm\"" May 21 16:14:08.742541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.742318 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 16:14:08.742541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.742319 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 16:14:08.742541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.742368 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 16:14:08.749740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.749713 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lq9qz"] May 21 16:14:08.820165 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.820132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04996518-d372-4f78-bbb0-4d035c206961-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.820165 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.820178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04996518-d372-4f78-bbb0-4d035c206961-crio-socket\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.820380 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.820201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04996518-d372-4f78-bbb0-4d035c206961-data-volume\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.820380 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.820238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mncjm\" (UniqueName: \"kubernetes.io/projected/04996518-d372-4f78-bbb0-4d035c206961-kube-api-access-mncjm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.820380 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.820258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04996518-d372-4f78-bbb0-4d035c206961-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921432 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921394 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04996518-d372-4f78-bbb0-4d035c206961-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921432 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921435 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04996518-d372-4f78-bbb0-4d035c206961-crio-socket\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921455 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04996518-d372-4f78-bbb0-4d035c206961-data-volume\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921494 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mncjm\" (UniqueName: \"kubernetes.io/projected/04996518-d372-4f78-bbb0-4d035c206961-kube-api-access-mncjm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04996518-d372-4f78-bbb0-4d035c206961-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04996518-d372-4f78-bbb0-4d035c206961-crio-socket\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.921870 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04996518-d372-4f78-bbb0-4d035c206961-data-volume\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.922006 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.921987 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04996518-d372-4f78-bbb0-4d035c206961-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.923977 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.923961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04996518-d372-4f78-bbb0-4d035c206961-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:08.929126 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:08.929105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mncjm\" (UniqueName: \"kubernetes.io/projected/04996518-d372-4f78-bbb0-4d035c206961-kube-api-access-mncjm\") pod \"insights-runtime-extractor-lq9qz\" (UID: \"04996518-d372-4f78-bbb0-4d035c206961\") " pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:09.047574 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:09.047496 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lq9qz" May 21 16:14:09.172056 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:09.172023 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lq9qz"] May 21 16:14:09.176517 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:09.176491 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04996518_d372_4f78_bbb0_4d035c206961.slice/crio-2e00db0de5c1c392bc6dbbee2947bf5ce2e37a1427348e4712084641f1670f07 WatchSource:0}: Error finding container 2e00db0de5c1c392bc6dbbee2947bf5ce2e37a1427348e4712084641f1670f07: Status 404 returned error can't find the container with id 2e00db0de5c1c392bc6dbbee2947bf5ce2e37a1427348e4712084641f1670f07 May 21 16:14:09.544883 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:09.544849 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq9qz" event={"ID":"04996518-d372-4f78-bbb0-4d035c206961","Type":"ContainerStarted","Data":"7108cd1ca924e532732eeacb68a38b30ae1f21d03bbef916e33eb35047e6f8e1"} May 21 16:14:09.544883 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:09.544884 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq9qz" event={"ID":"04996518-d372-4f78-bbb0-4d035c206961","Type":"ContainerStarted","Data":"2e00db0de5c1c392bc6dbbee2947bf5ce2e37a1427348e4712084641f1670f07"} May 21 16:14:10.549682 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:10.549639 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq9qz" event={"ID":"04996518-d372-4f78-bbb0-4d035c206961","Type":"ContainerStarted","Data":"b764a0b3bad53e7d7cff4bde88d78ec2868d6a475ec7d2c4fb88e5a5d5ba15be"} May 21 16:14:12.557932 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:12.557893 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lq9qz" event={"ID":"04996518-d372-4f78-bbb0-4d035c206961","Type":"ContainerStarted","Data":"2acfef48586b5ea5f5b3389420dd5c98f39130265a22ca7ef5165f4d32e546a5"} May 21 16:14:12.575382 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:12.575333 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lq9qz" podStartSLOduration=2.135323596 podStartE2EDuration="4.575320377s" podCreationTimestamp="2026-05-21 16:14:08 +0000 UTC" firstStartedPulling="2026-05-21 16:14:09.232249282 +0000 UTC m=+191.762156253" lastFinishedPulling="2026-05-21 16:14:11.672246046 +0000 UTC m=+194.202153034" observedRunningTime="2026-05-21 16:14:12.574079907 +0000 UTC m=+195.103986901" watchObservedRunningTime="2026-05-21 16:14:12.575320377 +0000 UTC m=+195.105227371" May 21 16:14:23.360917 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.360881 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zgpmv"] May 21 16:14:23.364130 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.364115 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.367267 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.367243 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 16:14:23.367402 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.367383 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 16:14:23.367564 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.367546 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 16:14:23.367865 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.367845 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 16:14:23.367975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.367851 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 16:14:23.368407 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.368389 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gsm8b\"" May 21 16:14:23.368476 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.368396 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 16:14:23.432553 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-root\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-textfile\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-metrics-client-ca\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432676 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-wtmp\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-tls\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432776 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqvd\" (UniqueName: \"kubernetes.io/projected/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-kube-api-access-tzqvd\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-sys\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.432903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.432846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533532 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533491 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-textfile\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533532 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533532 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-metrics-client-ca\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533803 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533563 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-wtmp\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533803 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-wtmp\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533803 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533741 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-tls\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533805 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqvd\" (UniqueName: \"kubernetes.io/projected/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-kube-api-access-tzqvd\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533851 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-sys\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533876 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533904 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-root\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-textfile\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.533960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-sys\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.534271 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-root\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.534271 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.533987 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.534271 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.534165 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-metrics-client-ca\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.534392 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.534305 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.536209 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.536184 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-tls\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.536311 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.536292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.541915 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.541889 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqvd\" (UniqueName: \"kubernetes.io/projected/5a5dbfb4-1138-41a3-a233-eea7c79ecdf1-kube-api-access-tzqvd\") pod \"node-exporter-zgpmv\" (UID: \"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1\") " pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.673186 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:23.673083 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zgpmv" May 21 16:14:23.681387 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:23.681359 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5dbfb4_1138_41a3_a233_eea7c79ecdf1.slice/crio-9480a876b5940a674abeaf4191a4b6d8fe29f3fe7c2cb816526e567e0f884828 WatchSource:0}: Error finding container 9480a876b5940a674abeaf4191a4b6d8fe29f3fe7c2cb816526e567e0f884828: Status 404 returned error can't find the container with id 9480a876b5940a674abeaf4191a4b6d8fe29f3fe7c2cb816526e567e0f884828 May 21 16:14:24.587422 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:24.587381 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgpmv" event={"ID":"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1","Type":"ContainerStarted","Data":"9480a876b5940a674abeaf4191a4b6d8fe29f3fe7c2cb816526e567e0f884828"} May 21 16:14:25.591452 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:25.591414 2555 generic.go:358] "Generic (PLEG): container finished" podID="5a5dbfb4-1138-41a3-a233-eea7c79ecdf1" containerID="e618583bd2f3b8fbe2886de2462a2bc6c83e0f896f06e338eb2d490d8a177d4c" exitCode=0 May 21 16:14:25.591834 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:25.591493 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgpmv" event={"ID":"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1","Type":"ContainerDied","Data":"e618583bd2f3b8fbe2886de2462a2bc6c83e0f896f06e338eb2d490d8a177d4c"} May 21 16:14:26.595866 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:26.595832 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgpmv" event={"ID":"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1","Type":"ContainerStarted","Data":"d27e22882c1aef66fe4231df0f6e35ee972e6e602bd5e7940bfd639539826e04"} May 21 16:14:26.595866 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:26.595865 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zgpmv" event={"ID":"5a5dbfb4-1138-41a3-a233-eea7c79ecdf1","Type":"ContainerStarted","Data":"09d3a202cd3c18cc38d75f9b6d6ec348e9e7adcd4246848a16cbf99e98d51ad1"} May 21 16:14:26.616921 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:26.616868 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zgpmv" podStartSLOduration=2.756797987 podStartE2EDuration="3.616852823s" podCreationTimestamp="2026-05-21 16:14:23 +0000 UTC" firstStartedPulling="2026-05-21 16:14:23.6832791 +0000 UTC m=+206.213186076" lastFinishedPulling="2026-05-21 16:14:24.543333926 +0000 UTC m=+207.073240912" observedRunningTime="2026-05-21 16:14:26.615344727 +0000 UTC m=+209.145251721" watchObservedRunningTime="2026-05-21 16:14:26.616852823 +0000 UTC m=+209.146759817" May 21 16:14:28.066341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.066308 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4"] May 21 16:14:28.069341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.069324 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:28.071585 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.071566 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 16:14:28.071700 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.071643 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-6c9f2\"" May 21 16:14:28.076439 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.076415 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4"] May 21 16:14:28.174297 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.174258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vzsg4\" (UID: \"cf9643a4-53b1-4cbf-a662-ec25358e18a6\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:28.275133 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.275102 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vzsg4\" (UID: \"cf9643a4-53b1-4cbf-a662-ec25358e18a6\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:28.275252 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:14:28.275237 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 16:14:28.275306 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:14:28.275292 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert podName:cf9643a4-53b1-4cbf-a662-ec25358e18a6 nodeName:}" failed. No retries permitted until 2026-05-21 16:14:28.775277565 +0000 UTC m=+211.305184540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-vzsg4" (UID: "cf9643a4-53b1-4cbf-a662-ec25358e18a6") : secret "monitoring-plugin-cert" not found May 21 16:14:28.778952 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.778913 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vzsg4\" (UID: \"cf9643a4-53b1-4cbf-a662-ec25358e18a6\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:28.781448 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.781430 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf9643a4-53b1-4cbf-a662-ec25358e18a6-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vzsg4\" (UID: \"cf9643a4-53b1-4cbf-a662-ec25358e18a6\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:28.977989 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:28.977941 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:29.102877 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:29.102817 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4"] May 21 16:14:29.108265 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:29.108238 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9643a4_53b1_4cbf_a662_ec25358e18a6.slice/crio-afc42032b2e6f578a3cccb6407834a4ca8fda213fa38fc2f06991920772eeb4f WatchSource:0}: Error finding container afc42032b2e6f578a3cccb6407834a4ca8fda213fa38fc2f06991920772eeb4f: Status 404 returned error can't find the container with id afc42032b2e6f578a3cccb6407834a4ca8fda213fa38fc2f06991920772eeb4f May 21 16:14:29.604559 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:29.604522 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" event={"ID":"cf9643a4-53b1-4cbf-a662-ec25358e18a6","Type":"ContainerStarted","Data":"afc42032b2e6f578a3cccb6407834a4ca8fda213fa38fc2f06991920772eeb4f"} May 21 16:14:31.605274 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:31.605230 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" podUID="b8db46bb-cdf0-4e5c-9319-4efc178c3559" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 16:14:31.610445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:31.610363 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" event={"ID":"cf9643a4-53b1-4cbf-a662-ec25358e18a6","Type":"ContainerStarted","Data":"15101296634b5e95b68f47490392419512ac618d3d355a0b78647d17b91c8cef"} May 21 16:14:31.610615 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:31.610574 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:31.615071 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:31.615053 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" May 21 16:14:31.625078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:31.625041 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vzsg4" podStartSLOduration=2.07807165 podStartE2EDuration="3.62503015s" podCreationTimestamp="2026-05-21 16:14:28 +0000 UTC" firstStartedPulling="2026-05-21 16:14:29.110148526 +0000 UTC m=+211.640055512" lastFinishedPulling="2026-05-21 16:14:30.657107024 +0000 UTC m=+213.187014012" observedRunningTime="2026-05-21 16:14:31.623928573 +0000 UTC m=+214.153835570" watchObservedRunningTime="2026-05-21 16:14:31.62503015 +0000 UTC m=+214.154937144" May 21 16:14:38.255165 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.255126 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-k6qqw"] May 21 16:14:38.258217 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.258199 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:38.260852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.260827 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 16:14:38.260852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.260838 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jhjxv\"" May 21 16:14:38.261024 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.260830 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 16:14:38.266515 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.266488 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k6qqw"] May 21 16:14:38.361932 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.361898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn5sd\" (UniqueName: \"kubernetes.io/projected/2c5d015c-082a-4d78-9d7b-709e12ec7f37-kube-api-access-hn5sd\") pod \"downloads-57bd96b888-k6qqw\" (UID: \"2c5d015c-082a-4d78-9d7b-709e12ec7f37\") " pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:38.462740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.462708 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn5sd\" (UniqueName: \"kubernetes.io/projected/2c5d015c-082a-4d78-9d7b-709e12ec7f37-kube-api-access-hn5sd\") pod \"downloads-57bd96b888-k6qqw\" (UID: \"2c5d015c-082a-4d78-9d7b-709e12ec7f37\") " pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:38.471579 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.471545 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn5sd\" (UniqueName: \"kubernetes.io/projected/2c5d015c-082a-4d78-9d7b-709e12ec7f37-kube-api-access-hn5sd\") pod \"downloads-57bd96b888-k6qqw\" (UID: \"2c5d015c-082a-4d78-9d7b-709e12ec7f37\") " pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:38.566923 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.566835 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:38.691763 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:38.691735 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-k6qqw"] May 21 16:14:38.695024 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:38.694997 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5d015c_082a_4d78_9d7b_709e12ec7f37.slice/crio-37c5389bcd8aaf1d4c44967c2c9f67bd1cdcc12fbe6fdac29355d19c09fae61e WatchSource:0}: Error finding container 37c5389bcd8aaf1d4c44967c2c9f67bd1cdcc12fbe6fdac29355d19c09fae61e: Status 404 returned error can't find the container with id 37c5389bcd8aaf1d4c44967c2c9f67bd1cdcc12fbe6fdac29355d19c09fae61e May 21 16:14:39.632342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:39.632296 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k6qqw" event={"ID":"2c5d015c-082a-4d78-9d7b-709e12ec7f37","Type":"ContainerStarted","Data":"37c5389bcd8aaf1d4c44967c2c9f67bd1cdcc12fbe6fdac29355d19c09fae61e"} May 21 16:14:40.908875 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:40.908833 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75995db8d7-6sp22"] May 21 16:14:40.909291 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:14:40.909077 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" podUID="036c9c1c-0f3b-47bd-973e-22a0867b1e08" May 21 16:14:41.604925 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.604888 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" podUID="b8db46bb-cdf0-4e5c-9319-4efc178c3559" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 16:14:41.637988 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.637958 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:14:41.643651 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.643625 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:14:41.790199 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790156 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8kqf\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790213 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790237 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790260 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790294 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790389 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790376 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790677 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790463 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca\") pod \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\" (UID: \"036c9c1c-0f3b-47bd-973e-22a0867b1e08\") " May 21 16:14:41.790730 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790672 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:14:41.790785 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790740 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:14:41.790843 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.790789 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/036c9c1c-0f3b-47bd-973e-22a0867b1e08-ca-trust-extracted\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.791352 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.791321 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:14:41.792754 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.792728 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:14:41.792856 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.792759 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf" (OuterVolumeSpecName: "kube-api-access-s8kqf") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "kube-api-access-s8kqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:14:41.792856 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.792824 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:14:41.792856 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.792829 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "036c9c1c-0f3b-47bd-973e-22a0867b1e08" (UID: "036c9c1c-0f3b-47bd-973e-22a0867b1e08"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891176 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-image-registry-private-configuration\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891210 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-trusted-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891223 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8kqf\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-kube-api-access-s8kqf\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891236 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/036c9c1c-0f3b-47bd-973e-22a0867b1e08-installation-pull-secrets\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891249 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-certificates\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:41.891262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:41.891261 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-bound-sa-token\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:42.640032 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:42.639998 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75995db8d7-6sp22" May 21 16:14:42.669541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:42.669502 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75995db8d7-6sp22"] May 21 16:14:42.672244 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:42.672220 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75995db8d7-6sp22"] May 21 16:14:42.798836 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:42.798802 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/036c9c1c-0f3b-47bd-973e-22a0867b1e08-registry-tls\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:14:44.031998 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:44.031966 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="036c9c1c-0f3b-47bd-973e-22a0867b1e08" path="/var/lib/kubelet/pods/036c9c1c-0f3b-47bd-973e-22a0867b1e08/volumes" May 21 16:14:47.161130 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.161100 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:14:47.163140 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.163111 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.166623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166504 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 16:14:47.166623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166524 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 16:14:47.166623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166504 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 16:14:47.166623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166555 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sbbxl\"" May 21 16:14:47.166623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166534 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 16:14:47.166964 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.166669 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 16:14:47.174991 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.174965 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:14:47.239353 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.239502 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscnt\" (UniqueName: \"kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.239502 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.239658 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.239658 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.239658 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.239608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.340688 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.340649 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.340874 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.340735 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.340874 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.340765 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.340973 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.340930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.341017 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.340979 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.341017 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.341005 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sscnt\" (UniqueName: \"kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.341509 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.341462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.341696 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.341672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.341888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.341867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.343568 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.343541 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.343727 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.343706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.352929 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.352907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscnt\" (UniqueName: \"kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt\") pod \"console-567dd9dc5b-6tzbm\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.475204 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.475113 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:14:47.599331 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.599298 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:14:47.602795 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:47.602744 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba8bbd2_6b2d_4d01_83a8_0a84c0fc10a9.slice/crio-69baddbdaa1de602a7283a928f7d86c0cbdb179610935b993e54943f6538a802 WatchSource:0}: Error finding container 69baddbdaa1de602a7283a928f7d86c0cbdb179610935b993e54943f6538a802: Status 404 returned error can't find the container with id 69baddbdaa1de602a7283a928f7d86c0cbdb179610935b993e54943f6538a802 May 21 16:14:47.654313 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:47.654281 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567dd9dc5b-6tzbm" event={"ID":"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9","Type":"ContainerStarted","Data":"69baddbdaa1de602a7283a928f7d86c0cbdb179610935b993e54943f6538a802"} May 21 16:14:51.605875 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:51.605780 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" podUID="b8db46bb-cdf0-4e5c-9319-4efc178c3559" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 16:14:51.606355 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:51.605898 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" May 21 16:14:51.606612 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:51.606537 2555 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4af181b76531afe4c533ca04fdb5f25a6219f3d9e771e85f0f90e1a8cd873611"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 16:14:51.606711 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:51.606638 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" podUID="b8db46bb-cdf0-4e5c-9319-4efc178c3559" containerName="service-proxy" containerID="cri-o://4af181b76531afe4c533ca04fdb5f25a6219f3d9e771e85f0f90e1a8cd873611" gracePeriod=30 May 21 16:14:52.671005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:52.670969 2555 generic.go:358] "Generic (PLEG): container finished" podID="b8db46bb-cdf0-4e5c-9319-4efc178c3559" containerID="4af181b76531afe4c533ca04fdb5f25a6219f3d9e771e85f0f90e1a8cd873611" exitCode=2 May 21 16:14:52.671414 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:52.671031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerDied","Data":"4af181b76531afe4c533ca04fdb5f25a6219f3d9e771e85f0f90e1a8cd873611"} May 21 16:14:56.944456 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:56.944418 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:14:56.947579 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:56.947554 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:56.955790 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:56.955768 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 16:14:56.958433 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:56.958400 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:14:57.126819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.126773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.126819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.126815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.127059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.126899 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.127059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.126975 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsl6\" (UniqueName: \"kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.127059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.127016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.127059 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.127050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.127211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.127095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227721 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227634 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227721 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227675 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227738 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227795 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsl6\" (UniqueName: \"kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227838 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227870 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.227960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.227910 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.228574 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.228525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.228700 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.228677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.228783 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.228764 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.229062 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.229036 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.230816 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.230794 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.230930 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.230794 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.236060 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.236032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsl6\" (UniqueName: \"kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6\") pod \"console-6cdc7fc4f4-gcd5v\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:57.258925 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:57.258889 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:14:59.402158 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.401840 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:14:59.409757 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:14:59.409728 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c13c94_6bed_47a5_876b_b2cf21246301.slice/crio-1c0b3d75fa5f9693ff4280b4c0e850eec1bb5225b6dbaba3911a4fdad210f536 WatchSource:0}: Error finding container 1c0b3d75fa5f9693ff4280b4c0e850eec1bb5225b6dbaba3911a4fdad210f536: Status 404 returned error can't find the container with id 1c0b3d75fa5f9693ff4280b4c0e850eec1bb5225b6dbaba3911a4fdad210f536 May 21 16:14:59.692120 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.692075 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567dd9dc5b-6tzbm" event={"ID":"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9","Type":"ContainerStarted","Data":"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7"} May 21 16:14:59.694796 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.694762 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7787d8567f-trwvd" event={"ID":"b8db46bb-cdf0-4e5c-9319-4efc178c3559","Type":"ContainerStarted","Data":"6a08cd12048362a74dab3cdf7ef2abdb428b1b0dbefb5f0faab6e07cc104f113"} May 21 16:14:59.696331 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.696304 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-k6qqw" event={"ID":"2c5d015c-082a-4d78-9d7b-709e12ec7f37","Type":"ContainerStarted","Data":"ac6a2df888671032e6e1e919c6db3fd83161cd7daf79ca434f6e4253e1fcb9f4"} May 21 16:14:59.696558 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.696533 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:59.697920 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.697895 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdc7fc4f4-gcd5v" event={"ID":"82c13c94-6bed-47a5-876b-b2cf21246301","Type":"ContainerStarted","Data":"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201"} May 21 16:14:59.698025 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.697928 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdc7fc4f4-gcd5v" event={"ID":"82c13c94-6bed-47a5-876b-b2cf21246301","Type":"ContainerStarted","Data":"1c0b3d75fa5f9693ff4280b4c0e850eec1bb5225b6dbaba3911a4fdad210f536"} May 21 16:14:59.709903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.709813 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-567dd9dc5b-6tzbm" podStartSLOduration=1.051952235 podStartE2EDuration="12.709798771s" podCreationTimestamp="2026-05-21 16:14:47 +0000 UTC" firstStartedPulling="2026-05-21 16:14:47.605655756 +0000 UTC m=+230.135562750" lastFinishedPulling="2026-05-21 16:14:59.263502312 +0000 UTC m=+241.793409286" observedRunningTime="2026-05-21 16:14:59.708820962 +0000 UTC m=+242.238727956" watchObservedRunningTime="2026-05-21 16:14:59.709798771 +0000 UTC m=+242.239705765" May 21 16:14:59.715704 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.715671 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-k6qqw" May 21 16:14:59.725282 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.725229 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-k6qqw" podStartSLOduration=1.100148282 podStartE2EDuration="21.725214434s" podCreationTimestamp="2026-05-21 16:14:38 +0000 UTC" firstStartedPulling="2026-05-21 16:14:38.696760038 +0000 UTC m=+221.226667013" lastFinishedPulling="2026-05-21 16:14:59.32182618 +0000 UTC m=+241.851733165" observedRunningTime="2026-05-21 16:14:59.724467176 +0000 UTC m=+242.254374170" watchObservedRunningTime="2026-05-21 16:14:59.725214434 +0000 UTC m=+242.255121428" May 21 16:14:59.757152 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:14:59.757097 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cdc7fc4f4-gcd5v" podStartSLOduration=3.757080891 podStartE2EDuration="3.757080891s" podCreationTimestamp="2026-05-21 16:14:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:14:59.756415699 +0000 UTC m=+242.286322694" watchObservedRunningTime="2026-05-21 16:14:59.757080891 +0000 UTC m=+242.286987902" May 21 16:15:01.918895 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:01.918852 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bj28k_d1bb26ff-8204-420e-a8b9-ef4f1df4351c/dns-node-resolver/0.log" May 21 16:15:07.259900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.259859 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:15:07.260516 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.259915 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:15:07.265623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.265578 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:15:07.475411 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.475370 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:07.475411 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.475417 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:07.480776 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.480749 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:07.729986 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.729952 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:07.730540 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.730512 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:15:07.804663 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:07.804626 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:15:10.043729 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.043692 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:15:10.046104 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.046084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a13c9f8c-3e4e-4f93-8257-0a221759ab83-metrics-certs\") pod \"network-metrics-daemon-tphnz\" (UID: \"a13c9f8c-3e4e-4f93-8257-0a221759ab83\") " pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:15:10.331891 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.331803 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlj8\"" May 21 16:15:10.339992 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.339959 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tphnz" May 21 16:15:10.466295 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.466272 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tphnz"] May 21 16:15:10.468865 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:15:10.468838 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13c9f8c_3e4e_4f93_8257_0a221759ab83.slice/crio-fea3f2eab6e59785582a6f1ade086076a0b53e5cb7ac35bd20e23801ef43257d WatchSource:0}: Error finding container fea3f2eab6e59785582a6f1ade086076a0b53e5cb7ac35bd20e23801ef43257d: Status 404 returned error can't find the container with id fea3f2eab6e59785582a6f1ade086076a0b53e5cb7ac35bd20e23801ef43257d May 21 16:15:10.734198 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:10.734165 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tphnz" event={"ID":"a13c9f8c-3e4e-4f93-8257-0a221759ab83","Type":"ContainerStarted","Data":"fea3f2eab6e59785582a6f1ade086076a0b53e5cb7ac35bd20e23801ef43257d"} May 21 16:15:12.743413 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:12.743003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tphnz" event={"ID":"a13c9f8c-3e4e-4f93-8257-0a221759ab83","Type":"ContainerStarted","Data":"5cca42b092e0f39d622f1756dfb6857d3be796f4bd7370ec39daaee43d436329"} May 21 16:15:12.743413 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:12.743055 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tphnz" event={"ID":"a13c9f8c-3e4e-4f93-8257-0a221759ab83","Type":"ContainerStarted","Data":"ecdd5cf6f50d402e4962c9dfda1fbc738edc5533edad9e9a2281f9d3f0cafe9d"} May 21 16:15:12.760850 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:12.760127 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tphnz" podStartSLOduration=253.04593545 podStartE2EDuration="4m14.760105025s" podCreationTimestamp="2026-05-21 16:10:58 +0000 UTC" firstStartedPulling="2026-05-21 16:15:10.470637809 +0000 UTC m=+253.000544786" lastFinishedPulling="2026-05-21 16:15:12.184807387 +0000 UTC m=+254.714714361" observedRunningTime="2026-05-21 16:15:12.758919827 +0000 UTC m=+255.288826821" watchObservedRunningTime="2026-05-21 16:15:12.760105025 +0000 UTC m=+255.290012021" May 21 16:15:34.749375 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:34.749309 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-567dd9dc5b-6tzbm" podUID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" containerName="console" containerID="cri-o://8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7" gracePeriod=15 May 21 16:15:35.018772 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.018748 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567dd9dc5b-6tzbm_9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9/console/0.log" May 21 16:15:35.018881 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.018810 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:35.154827 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.154795 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.154850 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.154894 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sscnt\" (UniqueName: \"kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.154944 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155156 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155010 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155156 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155040 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config\") pod \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\" (UID: \"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9\") " May 21 16:15:35.155832 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155248 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:15:35.155832 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155251 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:15:35.155832 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155344 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.155832 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.155646 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config" (OuterVolumeSpecName: "console-config") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:15:35.157509 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.157480 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt" (OuterVolumeSpecName: "kube-api-access-sscnt") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "kube-api-access-sscnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:15:35.157643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.157527 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:35.157835 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.157817 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" (UID: "9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:35.256787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.256686 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sscnt\" (UniqueName: \"kubernetes.io/projected/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-kube-api-access-sscnt\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.256787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.256724 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.256787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.256737 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.256787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.256749 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.256787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.256762 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:15:35.802620 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802569 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567dd9dc5b-6tzbm_9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9/console/0.log" May 21 16:15:35.803064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802631 2555 generic.go:358] "Generic (PLEG): container finished" podID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" containerID="8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7" exitCode=2 May 21 16:15:35.803064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802669 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567dd9dc5b-6tzbm" event={"ID":"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9","Type":"ContainerDied","Data":"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7"} May 21 16:15:35.803064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802694 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567dd9dc5b-6tzbm" May 21 16:15:35.803064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802710 2555 scope.go:117] "RemoveContainer" containerID="8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7" May 21 16:15:35.803064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.802697 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567dd9dc5b-6tzbm" event={"ID":"9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9","Type":"ContainerDied","Data":"69baddbdaa1de602a7283a928f7d86c0cbdb179610935b993e54943f6538a802"} May 21 16:15:35.810876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.810861 2555 scope.go:117] "RemoveContainer" containerID="8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7" May 21 16:15:35.811145 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:15:35.811123 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7\": container with ID starting with 8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7 not found: ID does not exist" containerID="8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7" May 21 16:15:35.811221 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.811152 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7"} err="failed to get container status \"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7\": rpc error: code = NotFound desc = could not find container \"8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7\": container with ID starting with 8ae315461c9fb4c8a26654a59bf34496056208141e7931a98f7c6e80d488f3e7 not found: ID does not exist" May 21 16:15:35.821339 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.821317 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:15:35.825213 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:35.825190 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567dd9dc5b-6tzbm"] May 21 16:15:36.032445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:36.032365 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" path="/var/lib/kubelet/pods/9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9/volumes" May 21 16:15:38.465397 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:15:38.465354 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-5d9mz" podUID="ac1e190e-4d93-43fb-8ebc-394619d741e1" May 21 16:15:38.465796 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:15:38.465515 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" podUID="8ae48aae-817a-4fb9-b908-e328a11faa14" May 21 16:15:38.465796 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:15:38.465515 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7vnsx" podUID="ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4" May 21 16:15:38.811726 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:38.811640 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:15:38.811726 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:38.811666 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:15:38.811726 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:38.811649 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vnsx" May 21 16:15:42.316365 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.316325 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:15:42.316365 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.316371 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:15:42.318839 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.318812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4-metrics-tls\") pod \"dns-default-7vnsx\" (UID: \"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4\") " pod="openshift-dns/dns-default-7vnsx" May 21 16:15:42.319009 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.318986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ae48aae-817a-4fb9-b908-e328a11faa14-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-jp8bl\" (UID: \"8ae48aae-817a-4fb9-b908-e328a11faa14\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:15:42.415120 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.415092 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ltjmm\"" May 21 16:15:42.415285 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.415093 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl8jw\"" May 21 16:15:42.417053 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.417030 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:15:42.419427 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.419408 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac1e190e-4d93-43fb-8ebc-394619d741e1-cert\") pod \"ingress-canary-5d9mz\" (UID: \"ac1e190e-4d93-43fb-8ebc-394619d741e1\") " pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:15:42.422251 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.422236 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" May 21 16:15:42.422317 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.422259 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vnsx" May 21 16:15:42.552175 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.552141 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl"] May 21 16:15:42.556851 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:15:42.556825 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae48aae_817a_4fb9_b908_e328a11faa14.slice/crio-74248b5300840a35e137a7fa04915e345f6cf4c1076e78e2902c9cb248a6d7d8 WatchSource:0}: Error finding container 74248b5300840a35e137a7fa04915e345f6cf4c1076e78e2902c9cb248a6d7d8: Status 404 returned error can't find the container with id 74248b5300840a35e137a7fa04915e345f6cf4c1076e78e2902c9cb248a6d7d8 May 21 16:15:42.572643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.572566 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vnsx"] May 21 16:15:42.576734 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:15:42.576708 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0ac0e1_6c14_4dc9_b644_8136ce97a9b4.slice/crio-7320acf9e76b129f9bfc3edb9d5431083fdb3ad19e3f6c8da89d2467b8150027 WatchSource:0}: Error finding container 7320acf9e76b129f9bfc3edb9d5431083fdb3ad19e3f6c8da89d2467b8150027: Status 404 returned error can't find the container with id 7320acf9e76b129f9bfc3edb9d5431083fdb3ad19e3f6c8da89d2467b8150027 May 21 16:15:42.714872 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.714842 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94pnq\"" May 21 16:15:42.723174 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.723154 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5d9mz" May 21 16:15:42.822235 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.822202 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vnsx" event={"ID":"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4","Type":"ContainerStarted","Data":"7320acf9e76b129f9bfc3edb9d5431083fdb3ad19e3f6c8da89d2467b8150027"} May 21 16:15:42.823300 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.823233 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" event={"ID":"8ae48aae-817a-4fb9-b908-e328a11faa14","Type":"ContainerStarted","Data":"74248b5300840a35e137a7fa04915e345f6cf4c1076e78e2902c9cb248a6d7d8"} May 21 16:15:42.844722 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:42.844688 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5d9mz"] May 21 16:15:42.847660 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:15:42.847637 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1e190e_4d93_43fb_8ebc_394619d741e1.slice/crio-c3ded822e16a91822480a1d320f8fb525f6fbd5b30c18282152214085fcb42ef WatchSource:0}: Error finding container c3ded822e16a91822480a1d320f8fb525f6fbd5b30c18282152214085fcb42ef: Status 404 returned error can't find the container with id c3ded822e16a91822480a1d320f8fb525f6fbd5b30c18282152214085fcb42ef May 21 16:15:43.828191 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:43.828137 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5d9mz" event={"ID":"ac1e190e-4d93-43fb-8ebc-394619d741e1","Type":"ContainerStarted","Data":"c3ded822e16a91822480a1d320f8fb525f6fbd5b30c18282152214085fcb42ef"} May 21 16:15:45.835335 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.835290 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5d9mz" event={"ID":"ac1e190e-4d93-43fb-8ebc-394619d741e1","Type":"ContainerStarted","Data":"ef7f82a9858a2ae3c72920c026d49d71049bb8fe81a457e8a47a621b217c46b2"} May 21 16:15:45.837017 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.836988 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vnsx" event={"ID":"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4","Type":"ContainerStarted","Data":"1ff0340d906c5cd910495334aecd2b18f064858d9f647f268ddc540258b9f312"} May 21 16:15:45.837154 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.837025 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vnsx" event={"ID":"ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4","Type":"ContainerStarted","Data":"405c1b41d13fe50d04f8a60ae2a1c51bb19459aceef135019880651d63c4d88a"} May 21 16:15:45.837154 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.837116 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vnsx" May 21 16:15:45.838319 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.838294 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" event={"ID":"8ae48aae-817a-4fb9-b908-e328a11faa14","Type":"ContainerStarted","Data":"da72a66408af1f982fd0248b69901d5341bfa80b861b47832494277d523821c8"} May 21 16:15:45.851412 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.851355 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5d9mz" podStartSLOduration=251.863295285 podStartE2EDuration="4m13.851341469s" podCreationTimestamp="2026-05-21 16:11:32 +0000 UTC" firstStartedPulling="2026-05-21 16:15:42.849573803 +0000 UTC m=+285.379480775" lastFinishedPulling="2026-05-21 16:15:44.837619977 +0000 UTC m=+287.367526959" observedRunningTime="2026-05-21 16:15:45.849875234 +0000 UTC m=+288.379782229" watchObservedRunningTime="2026-05-21 16:15:45.851341469 +0000 UTC m=+288.381248539" May 21 16:15:45.865281 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.865215 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7vnsx" podStartSLOduration=251.608588132 podStartE2EDuration="4m13.865196342s" podCreationTimestamp="2026-05-21 16:11:32 +0000 UTC" firstStartedPulling="2026-05-21 16:15:42.578415556 +0000 UTC m=+285.108322531" lastFinishedPulling="2026-05-21 16:15:44.835023768 +0000 UTC m=+287.364930741" observedRunningTime="2026-05-21 16:15:45.864675778 +0000 UTC m=+288.394582775" watchObservedRunningTime="2026-05-21 16:15:45.865196342 +0000 UTC m=+288.395103337" May 21 16:15:45.880644 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:45.880574 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-jp8bl" podStartSLOduration=255.607126971 podStartE2EDuration="4m17.880555296s" podCreationTimestamp="2026-05-21 16:11:28 +0000 UTC" firstStartedPulling="2026-05-21 16:15:42.558573417 +0000 UTC m=+285.088480388" lastFinishedPulling="2026-05-21 16:15:44.83200174 +0000 UTC m=+287.361908713" observedRunningTime="2026-05-21 16:15:45.879809089 +0000 UTC m=+288.409716082" watchObservedRunningTime="2026-05-21 16:15:45.880555296 +0000 UTC m=+288.410462315" May 21 16:15:51.896257 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.896218 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:15:51.896668 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.896463 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" containerName="console" May 21 16:15:51.896668 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.896475 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" containerName="console" May 21 16:15:51.896668 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.896537 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ba8bbd2-6b2d-4d01-83a8-0a84c0fc10a9" containerName="console" May 21 16:15:51.898350 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.898332 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.908431 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.908405 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:15:51.984517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7r7\" (UniqueName: \"kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:51.984718 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:51.984688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085525 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085488 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085525 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085547 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085771 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085894 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085837 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.085949 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085897 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7r7\" (UniqueName: \"kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.086005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.085957 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.086517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.086292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.086517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.086299 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.086517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.086416 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.086997 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.086966 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.088315 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.088292 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.088513 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.088496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.098625 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.098580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7r7\" (UniqueName: \"kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7\") pod \"console-67bf698557-xlgm6\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.206968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.206890 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:15:52.329350 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.329318 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:15:52.332355 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:15:52.332321 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c21e321_62c7_4b1d_bc21_25590eae5ac9.slice/crio-e29eb2532bc3d3376cac0d2ceb10d4b7c43eb5561c0dd3fd1ea0cfdd1c203905 WatchSource:0}: Error finding container e29eb2532bc3d3376cac0d2ceb10d4b7c43eb5561c0dd3fd1ea0cfdd1c203905: Status 404 returned error can't find the container with id e29eb2532bc3d3376cac0d2ceb10d4b7c43eb5561c0dd3fd1ea0cfdd1c203905 May 21 16:15:52.858000 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.857966 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bf698557-xlgm6" event={"ID":"6c21e321-62c7-4b1d-bc21-25590eae5ac9","Type":"ContainerStarted","Data":"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb"} May 21 16:15:52.858000 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.858002 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bf698557-xlgm6" event={"ID":"6c21e321-62c7-4b1d-bc21-25590eae5ac9","Type":"ContainerStarted","Data":"e29eb2532bc3d3376cac0d2ceb10d4b7c43eb5561c0dd3fd1ea0cfdd1c203905"} May 21 16:15:52.873644 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:52.873565 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67bf698557-xlgm6" podStartSLOduration=1.873552589 podStartE2EDuration="1.873552589s" podCreationTimestamp="2026-05-21 16:15:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:15:52.873118895 +0000 UTC m=+295.403025899" watchObservedRunningTime="2026-05-21 16:15:52.873552589 +0000 UTC m=+295.403459583" May 21 16:15:55.844972 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:55.844942 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vnsx" May 21 16:15:57.942555 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:15:57.942529 2555 kubelet.go:1628] "Image garbage collection succeeded" May 21 16:16:02.207378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:02.207338 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:16:02.207378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:02.207388 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:16:02.212026 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:02.212003 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:16:02.890888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:02.890858 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:16:02.938173 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:02.938134 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:16:27.957717 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:27.957655 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cdc7fc4f4-gcd5v" podUID="82c13c94-6bed-47a5-876b-b2cf21246301" containerName="console" containerID="cri-o://c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201" gracePeriod=15 May 21 16:16:28.193910 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.193887 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cdc7fc4f4-gcd5v_82c13c94-6bed-47a5-876b-b2cf21246301/console/0.log" May 21 16:16:28.194022 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.193951 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:16:28.245888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245801 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.245888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245843 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdsl6\" (UniqueName: \"kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.245888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245868 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.245888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245888 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.246208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245920 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.246208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.245956 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.246208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.246029 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert\") pod \"82c13c94-6bed-47a5-876b-b2cf21246301\" (UID: \"82c13c94-6bed-47a5-876b-b2cf21246301\") " May 21 16:16:28.246347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.246240 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:16:28.246401 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.246366 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config" (OuterVolumeSpecName: "console-config") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:16:28.246444 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.246406 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca" (OuterVolumeSpecName: "service-ca") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:16:28.246541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.246513 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:16:28.248197 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.248165 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:16:28.248197 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.248181 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6" (OuterVolumeSpecName: "kube-api-access-kdsl6") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "kube-api-access-kdsl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:16:28.248321 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.248201 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82c13c94-6bed-47a5-876b-b2cf21246301" (UID: "82c13c94-6bed-47a5-876b-b2cf21246301"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:16:28.346900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346857 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.346900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346895 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdsl6\" (UniqueName: \"kubernetes.io/projected/82c13c94-6bed-47a5-876b-b2cf21246301-kube-api-access-kdsl6\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.346900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346905 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.346900 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346914 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.347148 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346924 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.347148 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346932 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82c13c94-6bed-47a5-876b-b2cf21246301-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.347148 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.346942 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82c13c94-6bed-47a5-876b-b2cf21246301-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:16:28.956256 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956229 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cdc7fc4f4-gcd5v_82c13c94-6bed-47a5-876b-b2cf21246301/console/0.log" May 21 16:16:28.956406 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956269 2555 generic.go:358] "Generic (PLEG): container finished" podID="82c13c94-6bed-47a5-876b-b2cf21246301" containerID="c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201" exitCode=2 May 21 16:16:28.956406 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956302 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdc7fc4f4-gcd5v" event={"ID":"82c13c94-6bed-47a5-876b-b2cf21246301","Type":"ContainerDied","Data":"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201"} May 21 16:16:28.956406 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956323 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdc7fc4f4-gcd5v" event={"ID":"82c13c94-6bed-47a5-876b-b2cf21246301","Type":"ContainerDied","Data":"1c0b3d75fa5f9693ff4280b4c0e850eec1bb5225b6dbaba3911a4fdad210f536"} May 21 16:16:28.956406 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956341 2555 scope.go:117] "RemoveContainer" containerID="c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201" May 21 16:16:28.956406 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.956344 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdc7fc4f4-gcd5v" May 21 16:16:28.964656 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.964498 2555 scope.go:117] "RemoveContainer" containerID="c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201" May 21 16:16:28.964911 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:16:28.964824 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201\": container with ID starting with c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201 not found: ID does not exist" containerID="c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201" May 21 16:16:28.964911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.964850 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201"} err="failed to get container status \"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201\": rpc error: code = NotFound desc = could not find container \"c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201\": container with ID starting with c8c439d4a26b4d50c0915b0f4d5b197da28b19ba39b904586e8fac50fefd7201 not found: ID does not exist" May 21 16:16:28.977025 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.977000 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:16:28.978766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:28.978747 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cdc7fc4f4-gcd5v"] May 21 16:16:30.032155 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:16:30.032116 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c13c94-6bed-47a5-876b-b2cf21246301" path="/var/lib/kubelet/pods/82c13c94-6bed-47a5-876b-b2cf21246301/volumes" May 21 16:17:01.242563 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.242518 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:17:01.243161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.243043 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c13c94-6bed-47a5-876b-b2cf21246301" containerName="console" May 21 16:17:01.243161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.243063 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c13c94-6bed-47a5-876b-b2cf21246301" containerName="console" May 21 16:17:01.243161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.243157 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="82c13c94-6bed-47a5-876b-b2cf21246301" containerName="console" May 21 16:17:01.247920 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.247895 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.254318 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.254290 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:17:01.379521 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5cnp\" (UniqueName: \"kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379521 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379768 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.379915 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.379784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480349 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480372 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480399 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480434 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5cnp\" (UniqueName: \"kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480451 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.480529 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.480466 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.481241 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.481218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.481347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.481260 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.481347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.481307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.481455 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.481431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.482854 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.482832 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.482988 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.482970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.489512 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.489487 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5cnp\" (UniqueName: \"kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp\") pod \"console-c94fcc67f-zrmx8\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.559206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.559120 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:01.686338 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.686300 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:17:01.689253 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:17:01.689227 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7168bb9_7e9e_4cf9_ab3b_0ee83900b1d9.slice/crio-d29f07f4ad35e8ae50226596f0ff256fe5f4e5f2e42e5076f4676ed587a4869d WatchSource:0}: Error finding container d29f07f4ad35e8ae50226596f0ff256fe5f4e5f2e42e5076f4676ed587a4869d: Status 404 returned error can't find the container with id d29f07f4ad35e8ae50226596f0ff256fe5f4e5f2e42e5076f4676ed587a4869d May 21 16:17:01.690898 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:01.690883 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:17:02.042481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:02.042450 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c94fcc67f-zrmx8" event={"ID":"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9","Type":"ContainerStarted","Data":"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d"} May 21 16:17:02.042481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:02.042485 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c94fcc67f-zrmx8" event={"ID":"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9","Type":"ContainerStarted","Data":"d29f07f4ad35e8ae50226596f0ff256fe5f4e5f2e42e5076f4676ed587a4869d"} May 21 16:17:02.059978 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:02.059926 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c94fcc67f-zrmx8" podStartSLOduration=1.059912903 podStartE2EDuration="1.059912903s" podCreationTimestamp="2026-05-21 16:17:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:17:02.057710156 +0000 UTC m=+364.587617174" watchObservedRunningTime="2026-05-21 16:17:02.059912903 +0000 UTC m=+364.589819897" May 21 16:17:11.559918 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:11.559877 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:11.560370 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:11.559927 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:11.564769 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:11.564750 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:12.079748 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:12.079722 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:17:12.122377 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:12.122342 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:17:37.141723 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.141666 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67bf698557-xlgm6" podUID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" containerName="console" containerID="cri-o://fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb" gracePeriod=15 May 21 16:17:37.379731 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.379710 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bf698557-xlgm6_6c21e321-62c7-4b1d-bc21-25590eae5ac9/console/0.log" May 21 16:17:37.379836 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.379770 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:17:37.532824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532738 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h7r7\" (UniqueName: \"kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.532824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532797 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.532824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532819 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.533077 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532838 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.533077 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532891 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.533077 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532914 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.533077 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.532944 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config\") pod \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\" (UID: \"6c21e321-62c7-4b1d-bc21-25590eae5ac9\") " May 21 16:17:37.533386 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.533338 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:17:37.533386 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.533371 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:17:37.533571 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.533389 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:17:37.533571 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.533480 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config" (OuterVolumeSpecName: "console-config") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:17:37.535041 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.535020 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7" (OuterVolumeSpecName: "kube-api-access-4h7r7") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "kube-api-access-4h7r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:17:37.535226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.535203 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:17:37.535226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.535217 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c21e321-62c7-4b1d-bc21-25590eae5ac9" (UID: "6c21e321-62c7-4b1d-bc21-25590eae5ac9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:17:37.634397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634361 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h7r7\" (UniqueName: \"kubernetes.io/projected/6c21e321-62c7-4b1d-bc21-25590eae5ac9-kube-api-access-4h7r7\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634389 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634400 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634409 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634420 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634429 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:37.634670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:37.634437 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c21e321-62c7-4b1d-bc21-25590eae5ac9-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:17:38.141974 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.141947 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67bf698557-xlgm6_6c21e321-62c7-4b1d-bc21-25590eae5ac9/console/0.log" May 21 16:17:38.142440 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.141987 2555 generic.go:358] "Generic (PLEG): container finished" podID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" containerID="fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb" exitCode=2 May 21 16:17:38.142440 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.142021 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bf698557-xlgm6" event={"ID":"6c21e321-62c7-4b1d-bc21-25590eae5ac9","Type":"ContainerDied","Data":"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb"} May 21 16:17:38.142440 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.142058 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bf698557-xlgm6" event={"ID":"6c21e321-62c7-4b1d-bc21-25590eae5ac9","Type":"ContainerDied","Data":"e29eb2532bc3d3376cac0d2ceb10d4b7c43eb5561c0dd3fd1ea0cfdd1c203905"} May 21 16:17:38.142440 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.142073 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bf698557-xlgm6" May 21 16:17:38.142440 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.142080 2555 scope.go:117] "RemoveContainer" containerID="fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb" May 21 16:17:38.152074 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.152047 2555 scope.go:117] "RemoveContainer" containerID="fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb" May 21 16:17:38.152374 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:17:38.152353 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb\": container with ID starting with fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb not found: ID does not exist" containerID="fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb" May 21 16:17:38.152445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.152385 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb"} err="failed to get container status \"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb\": rpc error: code = NotFound desc = could not find container \"fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb\": container with ID starting with fb1bc77081fab8643a78028ee32c37e050949b9d30672e2443537d12d68c17eb not found: ID does not exist" May 21 16:17:38.158844 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.158809 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:17:38.161722 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:38.161696 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bf698557-xlgm6"] May 21 16:17:40.031654 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:17:40.031586 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" path="/var/lib/kubelet/pods/6c21e321-62c7-4b1d-bc21-25590eae5ac9/volumes" May 21 16:18:35.622453 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.622416 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9"] May 21 16:18:35.622923 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.622670 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" containerName="console" May 21 16:18:35.622923 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.622682 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" containerName="console" May 21 16:18:35.622923 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.622728 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c21e321-62c7-4b1d-bc21-25590eae5ac9" containerName="console" May 21 16:18:35.625443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.625427 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.627811 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.627783 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kz2g7\"" May 21 16:18:35.627923 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.627873 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 16:18:35.628003 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.627990 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 16:18:35.642294 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.642266 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9"] May 21 16:18:35.747138 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.747102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkhq\" (UniqueName: \"kubernetes.io/projected/82e19171-26bb-48e6-babf-cbcee47579ae-kube-api-access-mrkhq\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.747246 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.747145 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e19171-26bb-48e6-babf-cbcee47579ae-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.848342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.848296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkhq\" (UniqueName: \"kubernetes.io/projected/82e19171-26bb-48e6-babf-cbcee47579ae-kube-api-access-mrkhq\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.848342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.848349 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e19171-26bb-48e6-babf-cbcee47579ae-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.848803 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.848785 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82e19171-26bb-48e6-babf-cbcee47579ae-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.856549 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.856528 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkhq\" (UniqueName: \"kubernetes.io/projected/82e19171-26bb-48e6-babf-cbcee47579ae-kube-api-access-mrkhq\") pod \"cert-manager-operator-controller-manager-54b9655956-4r5h9\" (UID: \"82e19171-26bb-48e6-babf-cbcee47579ae\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:35.934708 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:35.934631 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" May 21 16:18:36.071748 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:36.071714 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9"] May 21 16:18:36.075868 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:18:36.075837 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e19171_26bb_48e6_babf_cbcee47579ae.slice/crio-404fc09fc63204f856f506e79615a651a05955d809e6ba1e037639cac5e8841f WatchSource:0}: Error finding container 404fc09fc63204f856f506e79615a651a05955d809e6ba1e037639cac5e8841f: Status 404 returned error can't find the container with id 404fc09fc63204f856f506e79615a651a05955d809e6ba1e037639cac5e8841f May 21 16:18:36.295895 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:36.295805 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" event={"ID":"82e19171-26bb-48e6-babf-cbcee47579ae","Type":"ContainerStarted","Data":"404fc09fc63204f856f506e79615a651a05955d809e6ba1e037639cac5e8841f"} May 21 16:18:39.306412 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:39.306369 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" event={"ID":"82e19171-26bb-48e6-babf-cbcee47579ae","Type":"ContainerStarted","Data":"12bbe31ff365fa61c0ac23094aa9aa3015c5f357848c9e9ae3e04995f08ff485"} May 21 16:18:39.337756 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:39.337691 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4r5h9" podStartSLOduration=1.625185037 podStartE2EDuration="4.337672265s" podCreationTimestamp="2026-05-21 16:18:35 +0000 UTC" firstStartedPulling="2026-05-21 16:18:36.078341412 +0000 UTC m=+458.608248384" lastFinishedPulling="2026-05-21 16:18:38.790828623 +0000 UTC m=+461.320735612" observedRunningTime="2026-05-21 16:18:39.335945841 +0000 UTC m=+461.865852834" watchObservedRunningTime="2026-05-21 16:18:39.337672265 +0000 UTC m=+461.867579258" May 21 16:18:41.185986 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.185952 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gxhns"] May 21 16:18:41.188952 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.188936 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.192009 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.191985 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 16:18:41.192960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.192941 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5bzkl\"" May 21 16:18:41.193035 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.192983 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 16:18:41.205367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.205337 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gxhns"] May 21 16:18:41.290236 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.290188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9bf5\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-kube-api-access-w9bf5\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.290411 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.290282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.391632 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.391575 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.391632 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.391639 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9bf5\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-kube-api-access-w9bf5\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.400920 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.400890 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.401296 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.401279 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9bf5\" (UniqueName: \"kubernetes.io/projected/828b23b1-b665-407a-91de-1415c542f150-kube-api-access-w9bf5\") pod \"cert-manager-webhook-587ccfb98-gxhns\" (UID: \"828b23b1-b665-407a-91de-1415c542f150\") " pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.497540 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.497442 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:41.619164 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:41.619076 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-gxhns"] May 21 16:18:41.621134 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:18:41.621106 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod828b23b1_b665_407a_91de_1415c542f150.slice/crio-3faab76d7f6c53e2171666dfc0b8f0917d21dae2baf98e7272c16818f84283c6 WatchSource:0}: Error finding container 3faab76d7f6c53e2171666dfc0b8f0917d21dae2baf98e7272c16818f84283c6: Status 404 returned error can't find the container with id 3faab76d7f6c53e2171666dfc0b8f0917d21dae2baf98e7272c16818f84283c6 May 21 16:18:42.315135 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:42.315096 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" event={"ID":"828b23b1-b665-407a-91de-1415c542f150","Type":"ContainerStarted","Data":"3faab76d7f6c53e2171666dfc0b8f0917d21dae2baf98e7272c16818f84283c6"} May 21 16:18:45.329086 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:45.329049 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" event={"ID":"828b23b1-b665-407a-91de-1415c542f150","Type":"ContainerStarted","Data":"39c61f0e362aa515acc0df8026d70bf023bd81857100d71727282a37773a6afc"} May 21 16:18:45.329487 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:45.329185 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:45.346731 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:45.346685 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" podStartSLOduration=1.368848925 podStartE2EDuration="4.346672025s" podCreationTimestamp="2026-05-21 16:18:41 +0000 UTC" firstStartedPulling="2026-05-21 16:18:41.62304962 +0000 UTC m=+464.152956591" lastFinishedPulling="2026-05-21 16:18:44.600872706 +0000 UTC m=+467.130779691" observedRunningTime="2026-05-21 16:18:45.345022775 +0000 UTC m=+467.874929769" watchObservedRunningTime="2026-05-21 16:18:45.346672025 +0000 UTC m=+467.876579018" May 21 16:18:51.334430 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:51.334384 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-gxhns" May 21 16:18:54.122714 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.122679 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zfzjv"] May 21 16:18:54.125853 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.125835 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.129336 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.129311 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nw765\"" May 21 16:18:54.133274 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.133250 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zfzjv"] May 21 16:18:54.299331 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.299296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-bound-sa-token\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.299331 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.299330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsxd\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-kube-api-access-rvsxd\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.400278 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.400182 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-bound-sa-token\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.400278 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.400224 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsxd\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-kube-api-access-rvsxd\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.408072 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.408044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-bound-sa-token\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.408208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.408137 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsxd\" (UniqueName: \"kubernetes.io/projected/6afbf66c-fd12-4ea6-88f2-b7895e58d10c-kube-api-access-rvsxd\") pod \"cert-manager-79c8d999ff-zfzjv\" (UID: \"6afbf66c-fd12-4ea6-88f2-b7895e58d10c\") " pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.436120 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.436075 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-zfzjv" May 21 16:18:54.564453 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:54.564430 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zfzjv"] May 21 16:18:54.566813 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:18:54.566775 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6afbf66c_fd12_4ea6_88f2_b7895e58d10c.slice/crio-a79b369c73f6fb2a98b1fb0726c7669a91400280e7e0a06ecb7899251e0e08f9 WatchSource:0}: Error finding container a79b369c73f6fb2a98b1fb0726c7669a91400280e7e0a06ecb7899251e0e08f9: Status 404 returned error can't find the container with id a79b369c73f6fb2a98b1fb0726c7669a91400280e7e0a06ecb7899251e0e08f9 May 21 16:18:55.360235 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:55.360201 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-zfzjv" event={"ID":"6afbf66c-fd12-4ea6-88f2-b7895e58d10c","Type":"ContainerStarted","Data":"e114324e49faf383d412d0015914a76804e96a5ff93caa1355ff1abaf3aa3a0e"} May 21 16:18:55.360235 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:55.360236 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-zfzjv" event={"ID":"6afbf66c-fd12-4ea6-88f2-b7895e58d10c","Type":"ContainerStarted","Data":"a79b369c73f6fb2a98b1fb0726c7669a91400280e7e0a06ecb7899251e0e08f9"} May 21 16:18:55.376009 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:18:55.375956 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-zfzjv" podStartSLOduration=1.3759396289999999 podStartE2EDuration="1.375939629s" podCreationTimestamp="2026-05-21 16:18:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:18:55.374861903 +0000 UTC m=+477.904768908" watchObservedRunningTime="2026-05-21 16:18:55.375939629 +0000 UTC m=+477.905846624" May 21 16:19:28.117641 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.117606 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx"] May 21 16:19:28.121454 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.121435 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.125514 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.125492 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 16:19:28.125634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.125521 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 16:19:28.125634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.125541 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 16:19:28.125721 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.125636 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2574d\"" May 21 16:19:28.126175 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.126159 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 16:19:28.137703 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.137679 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx"] May 21 16:19:28.140338 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.140320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksj88\" (UniqueName: \"kubernetes.io/projected/c41b1416-fead-44bb-aa67-7599156566fa-kube-api-access-ksj88\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.140415 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.140355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.140415 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.140378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.240708 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.240676 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.240708 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.240711 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.240953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.240757 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksj88\" (UniqueName: \"kubernetes.io/projected/c41b1416-fead-44bb-aa67-7599156566fa-kube-api-access-ksj88\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.243419 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.243392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.243509 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.243392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c41b1416-fead-44bb-aa67-7599156566fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.286505 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.286473 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksj88\" (UniqueName: \"kubernetes.io/projected/c41b1416-fead-44bb-aa67-7599156566fa-kube-api-access-ksj88\") pod \"opendatahub-operator-controller-manager-77666b9699-kxfgx\" (UID: \"c41b1416-fead-44bb-aa67-7599156566fa\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.431515 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.431421 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:28.570557 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:28.570534 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx"] May 21 16:19:28.573204 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:19:28.573177 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41b1416_fead_44bb_aa67_7599156566fa.slice/crio-4a9a24800653f0c72f119236729344543dd2ddc5c5f9064a744b53a515f6fdc3 WatchSource:0}: Error finding container 4a9a24800653f0c72f119236729344543dd2ddc5c5f9064a744b53a515f6fdc3: Status 404 returned error can't find the container with id 4a9a24800653f0c72f119236729344543dd2ddc5c5f9064a744b53a515f6fdc3 May 21 16:19:29.468090 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:29.468042 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" event={"ID":"c41b1416-fead-44bb-aa67-7599156566fa","Type":"ContainerStarted","Data":"4a9a24800653f0c72f119236729344543dd2ddc5c5f9064a744b53a515f6fdc3"} May 21 16:19:31.475685 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:31.475646 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" event={"ID":"c41b1416-fead-44bb-aa67-7599156566fa","Type":"ContainerStarted","Data":"4f9ea5527b6785bc90f6c98a82699dc67c59385e57318a3c5d9d9c1500edc680"} May 21 16:19:31.476172 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:31.475784 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:31.503782 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:31.503732 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" podStartSLOduration=1.23482836 podStartE2EDuration="3.503718897s" podCreationTimestamp="2026-05-21 16:19:28 +0000 UTC" firstStartedPulling="2026-05-21 16:19:28.574881431 +0000 UTC m=+511.104788403" lastFinishedPulling="2026-05-21 16:19:30.843771952 +0000 UTC m=+513.373678940" observedRunningTime="2026-05-21 16:19:31.502847444 +0000 UTC m=+514.032754437" watchObservedRunningTime="2026-05-21 16:19:31.503718897 +0000 UTC m=+514.033625891" May 21 16:19:42.480975 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:42.480945 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-kxfgx" May 21 16:19:49.171342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.171258 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xzgvn"] May 21 16:19:49.174384 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.174367 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.179940 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.179909 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-222p5\"" May 21 16:19:49.180074 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.180000 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 16:19:49.199251 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.199220 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xzgvn"] May 21 16:19:49.311538 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.311501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgv2h\" (UniqueName: \"kubernetes.io/projected/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-kube-api-access-wgv2h\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.311723 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.311554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.412839 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.412798 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgv2h\" (UniqueName: \"kubernetes.io/projected/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-kube-api-access-wgv2h\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.412839 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.412843 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.413055 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:49.412963 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 16:19:49.413055 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:49.413032 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert podName:93e02e59-cdad-420c-b5a1-9c2e75ada5c7 nodeName:}" failed. No retries permitted until 2026-05-21 16:19:49.913012192 +0000 UTC m=+532.442919179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert") pod "odh-model-controller-858dbf95b8-xzgvn" (UID: "93e02e59-cdad-420c-b5a1-9c2e75ada5c7") : secret "odh-model-controller-webhook-cert" not found May 21 16:19:49.424027 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.423953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgv2h\" (UniqueName: \"kubernetes.io/projected/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-kube-api-access-wgv2h\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.917468 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.917423 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:49.920068 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:49.920035 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e02e59-cdad-420c-b5a1-9c2e75ada5c7-cert\") pod \"odh-model-controller-858dbf95b8-xzgvn\" (UID: \"93e02e59-cdad-420c-b5a1-9c2e75ada5c7\") " pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:50.084099 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:50.084065 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:19:50.219211 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:50.219145 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xzgvn"] May 21 16:19:50.221437 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:19:50.221406 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e02e59_cdad_420c_b5a1_9c2e75ada5c7.slice/crio-dd007171d850dfa70547752c6919a26970b51aa4cffea8b001bfff2c53a387bb WatchSource:0}: Error finding container dd007171d850dfa70547752c6919a26970b51aa4cffea8b001bfff2c53a387bb: Status 404 returned error can't find the container with id dd007171d850dfa70547752c6919a26970b51aa4cffea8b001bfff2c53a387bb May 21 16:19:50.531354 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:50.531270 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" event={"ID":"93e02e59-cdad-420c-b5a1-9c2e75ada5c7","Type":"ContainerStarted","Data":"dd007171d850dfa70547752c6919a26970b51aa4cffea8b001bfff2c53a387bb"} May 21 16:19:53.545314 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:53.545217 2555 generic.go:358] "Generic (PLEG): container finished" podID="93e02e59-cdad-420c-b5a1-9c2e75ada5c7" containerID="42679c3958273f4f7bfd15e138070718ab2538a36f6268e5d234e51d97a2d03a" exitCode=1 May 21 16:19:53.545314 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:53.545264 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" event={"ID":"93e02e59-cdad-420c-b5a1-9c2e75ada5c7","Type":"ContainerDied","Data":"42679c3958273f4f7bfd15e138070718ab2538a36f6268e5d234e51d97a2d03a"} May 21 16:19:53.545724 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:53.545490 2555 scope.go:117] "RemoveContainer" containerID="42679c3958273f4f7bfd15e138070718ab2538a36f6268e5d234e51d97a2d03a" May 21 16:19:54.421263 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.421222 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-66wkg"] May 21 16:19:54.424318 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.424300 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:54.427090 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.427067 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 16:19:54.427213 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.427124 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5965q\"" May 21 16:19:54.433773 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.433742 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-66wkg"] May 21 16:19:54.550225 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.550189 2555 generic.go:358] "Generic (PLEG): container finished" podID="93e02e59-cdad-420c-b5a1-9c2e75ada5c7" containerID="fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101" exitCode=1 May 21 16:19:54.550634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.550251 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" event={"ID":"93e02e59-cdad-420c-b5a1-9c2e75ada5c7","Type":"ContainerDied","Data":"fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101"} May 21 16:19:54.550634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.550290 2555 scope.go:117] "RemoveContainer" containerID="42679c3958273f4f7bfd15e138070718ab2538a36f6268e5d234e51d97a2d03a" May 21 16:19:54.550634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.550514 2555 scope.go:117] "RemoveContainer" containerID="fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101" May 21 16:19:54.550794 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:54.550745 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xzgvn_opendatahub(93e02e59-cdad-420c-b5a1-9c2e75ada5c7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" podUID="93e02e59-cdad-420c-b5a1-9c2e75ada5c7" May 21 16:19:54.560309 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.560268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:54.560444 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.560314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592c5\" (UniqueName: \"kubernetes.io/projected/c3753fba-e1d1-430c-8715-21951d807d23-kube-api-access-592c5\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:54.661368 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.661329 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:54.661586 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.661393 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-592c5\" (UniqueName: \"kubernetes.io/projected/c3753fba-e1d1-430c-8715-21951d807d23-kube-api-access-592c5\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:54.661586 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:54.661477 2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 16:19:54.661586 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:54.661558 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert podName:c3753fba-e1d1-430c-8715-21951d807d23 nodeName:}" failed. No retries permitted until 2026-05-21 16:19:55.161536704 +0000 UTC m=+537.691443680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert") pod "kserve-controller-manager-856948b99f-66wkg" (UID: "c3753fba-e1d1-430c-8715-21951d807d23") : secret "kserve-webhook-server-cert" not found May 21 16:19:54.672934 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:54.672865 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592c5\" (UniqueName: \"kubernetes.io/projected/c3753fba-e1d1-430c-8715-21951d807d23-kube-api-access-592c5\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:55.165218 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.165186 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:55.167582 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.167555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3753fba-e1d1-430c-8715-21951d807d23-cert\") pod \"kserve-controller-manager-856948b99f-66wkg\" (UID: \"c3753fba-e1d1-430c-8715-21951d807d23\") " pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:55.336740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.336703 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:55.484729 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.484698 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-66wkg"] May 21 16:19:55.486995 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:19:55.486967 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3753fba_e1d1_430c_8715_21951d807d23.slice/crio-2ade677b77e603a9ca2ee7f70677ea6f9ebf2bac821ab8b1efe838a531310d17 WatchSource:0}: Error finding container 2ade677b77e603a9ca2ee7f70677ea6f9ebf2bac821ab8b1efe838a531310d17: Status 404 returned error can't find the container with id 2ade677b77e603a9ca2ee7f70677ea6f9ebf2bac821ab8b1efe838a531310d17 May 21 16:19:55.553901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.553862 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" event={"ID":"c3753fba-e1d1-430c-8715-21951d807d23","Type":"ContainerStarted","Data":"2ade677b77e603a9ca2ee7f70677ea6f9ebf2bac821ab8b1efe838a531310d17"} May 21 16:19:55.555549 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:55.555529 2555 scope.go:117] "RemoveContainer" containerID="fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101" May 21 16:19:55.555748 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:19:55.555731 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xzgvn_opendatahub(93e02e59-cdad-420c-b5a1-9c2e75ada5c7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" podUID="93e02e59-cdad-420c-b5a1-9c2e75ada5c7" May 21 16:19:58.567076 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:58.567037 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" event={"ID":"c3753fba-e1d1-430c-8715-21951d807d23","Type":"ContainerStarted","Data":"9ac777bd7cc58b08524e5e7d357521cbc0efbfb28632539444616f946c4ea5cb"} May 21 16:19:58.567501 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:58.567245 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:19:58.583942 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:19:58.583888 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" podStartSLOduration=2.283299333 podStartE2EDuration="4.583873135s" podCreationTimestamp="2026-05-21 16:19:54 +0000 UTC" firstStartedPulling="2026-05-21 16:19:55.488750991 +0000 UTC m=+538.018657963" lastFinishedPulling="2026-05-21 16:19:57.78932478 +0000 UTC m=+540.319231765" observedRunningTime="2026-05-21 16:19:58.583092933 +0000 UTC m=+541.112999927" watchObservedRunningTime="2026-05-21 16:19:58.583873135 +0000 UTC m=+541.113780129" May 21 16:20:00.084530 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:00.084496 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:20:00.085005 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:00.084984 2555 scope.go:117] "RemoveContainer" containerID="fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101" May 21 16:20:00.085222 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:20:00.085201 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-xzgvn_opendatahub(93e02e59-cdad-420c-b5a1-9c2e75ada5c7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" podUID="93e02e59-cdad-420c-b5a1-9c2e75ada5c7" May 21 16:20:06.993208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:06.993173 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t"] May 21 16:20:07.001351 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.001324 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.003710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.003675 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 16:20:07.003852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.003823 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 16:20:07.004038 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.004024 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 16:20:07.004083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.004056 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 16:20:07.007438 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.007413 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t"] May 21 16:20:07.166495 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.166461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002a0daa-c832-4d84-be41-87a8e28be568-tls-certs\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.166713 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.166510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hps8\" (UniqueName: \"kubernetes.io/projected/002a0daa-c832-4d84-be41-87a8e28be568-kube-api-access-4hps8\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.166713 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.166570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/002a0daa-c832-4d84-be41-87a8e28be568-tmp\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.267579 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.267484 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hps8\" (UniqueName: \"kubernetes.io/projected/002a0daa-c832-4d84-be41-87a8e28be568-kube-api-access-4hps8\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.267579 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.267525 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/002a0daa-c832-4d84-be41-87a8e28be568-tmp\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.267803 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.267604 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002a0daa-c832-4d84-be41-87a8e28be568-tls-certs\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.270034 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.270011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/002a0daa-c832-4d84-be41-87a8e28be568-tmp\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.270161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.270143 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/002a0daa-c832-4d84-be41-87a8e28be568-tls-certs\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.277306 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.277280 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hps8\" (UniqueName: \"kubernetes.io/projected/002a0daa-c832-4d84-be41-87a8e28be568-kube-api-access-4hps8\") pod \"kube-auth-proxy-6f6d59cc87-h2w2t\" (UID: \"002a0daa-c832-4d84-be41-87a8e28be568\") " pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.311343 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.311297 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" May 21 16:20:07.456903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.456868 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t"] May 21 16:20:07.461130 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:20:07.461094 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002a0daa_c832_4d84_be41_87a8e28be568.slice/crio-1b4337413019b69b5e08fefeb027068dec5f9bc0c378b12b72186d280bc5efe7 WatchSource:0}: Error finding container 1b4337413019b69b5e08fefeb027068dec5f9bc0c378b12b72186d280bc5efe7: Status 404 returned error can't find the container with id 1b4337413019b69b5e08fefeb027068dec5f9bc0c378b12b72186d280bc5efe7 May 21 16:20:07.594638 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:07.594581 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" event={"ID":"002a0daa-c832-4d84-be41-87a8e28be568","Type":"ContainerStarted","Data":"1b4337413019b69b5e08fefeb027068dec5f9bc0c378b12b72186d280bc5efe7"} May 21 16:20:10.084561 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.084516 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:20:10.085048 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.085032 2555 scope.go:117] "RemoveContainer" containerID="fda51941dd115840503f754d9c3d3ea17a87bd46c8707b300c5ee1a8dc9a5101" May 21 16:20:10.607218 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.607176 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" event={"ID":"002a0daa-c832-4d84-be41-87a8e28be568","Type":"ContainerStarted","Data":"9309d087934a9dd83e50880afefddfcbe10e61a3709febc3e2d4f3074386a8aa"} May 21 16:20:10.608657 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.608635 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" event={"ID":"93e02e59-cdad-420c-b5a1-9c2e75ada5c7","Type":"ContainerStarted","Data":"9bd40264bd78b0630f66596c01da4dbe3a487a47418705d394f60c8b5148abf9"} May 21 16:20:10.608819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.608806 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:20:10.624739 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.624694 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f6d59cc87-h2w2t" podStartSLOduration=1.757219533 podStartE2EDuration="4.624682668s" podCreationTimestamp="2026-05-21 16:20:06 +0000 UTC" firstStartedPulling="2026-05-21 16:20:07.462755244 +0000 UTC m=+549.992662217" lastFinishedPulling="2026-05-21 16:20:10.330218377 +0000 UTC m=+552.860125352" observedRunningTime="2026-05-21 16:20:10.623092649 +0000 UTC m=+553.152999641" watchObservedRunningTime="2026-05-21 16:20:10.624682668 +0000 UTC m=+553.154589661" May 21 16:20:10.638155 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:10.638104 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" podStartSLOduration=1.484398997 podStartE2EDuration="21.638087656s" podCreationTimestamp="2026-05-21 16:19:49 +0000 UTC" firstStartedPulling="2026-05-21 16:19:50.222664432 +0000 UTC m=+532.752571404" lastFinishedPulling="2026-05-21 16:20:10.376353076 +0000 UTC m=+552.906260063" observedRunningTime="2026-05-21 16:20:10.637051807 +0000 UTC m=+553.166958792" watchObservedRunningTime="2026-05-21 16:20:10.638087656 +0000 UTC m=+553.167994649" May 21 16:20:21.612996 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:21.612960 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-xzgvn" May 21 16:20:22.376364 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.376334 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc"] May 21 16:20:22.378934 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.378918 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.381402 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.381379 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 16:20:22.381540 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.381420 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-9p2ld\"" May 21 16:20:22.381773 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.381758 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 16:20:22.387519 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.387490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2q75\" (UniqueName: \"kubernetes.io/projected/f39f6355-899e-4b63-8cf6-3167d09a7425-kube-api-access-p2q75\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.387709 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.387534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f39f6355-899e-4b63-8cf6-3167d09a7425-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.390305 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.390269 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc"] May 21 16:20:22.488091 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.488053 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2q75\" (UniqueName: \"kubernetes.io/projected/f39f6355-899e-4b63-8cf6-3167d09a7425-kube-api-access-p2q75\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.488091 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.488089 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f39f6355-899e-4b63-8cf6-3167d09a7425-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.490716 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.490695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f39f6355-899e-4b63-8cf6-3167d09a7425-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.496508 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.496481 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2q75\" (UniqueName: \"kubernetes.io/projected/f39f6355-899e-4b63-8cf6-3167d09a7425-kube-api-access-p2q75\") pod \"servicemesh-operator3-55f49c5f94-vzrlc\" (UID: \"f39f6355-899e-4b63-8cf6-3167d09a7425\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.688781 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.688688 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:22.824483 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:22.824453 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc"] May 21 16:20:22.826896 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:20:22.826863 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39f6355_899e_4b63_8cf6_3167d09a7425.slice/crio-2b5f3bf938e08edf6f8a99267b7d0117d9c84faa3dbff3e081d96dfa4a1ec988 WatchSource:0}: Error finding container 2b5f3bf938e08edf6f8a99267b7d0117d9c84faa3dbff3e081d96dfa4a1ec988: Status 404 returned error can't find the container with id 2b5f3bf938e08edf6f8a99267b7d0117d9c84faa3dbff3e081d96dfa4a1ec988 May 21 16:20:23.651053 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:23.651010 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" event={"ID":"f39f6355-899e-4b63-8cf6-3167d09a7425","Type":"ContainerStarted","Data":"2b5f3bf938e08edf6f8a99267b7d0117d9c84faa3dbff3e081d96dfa4a1ec988"} May 21 16:20:25.660711 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:25.660655 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" event={"ID":"f39f6355-899e-4b63-8cf6-3167d09a7425","Type":"ContainerStarted","Data":"a76dd3793afdd3e0e22a2514e5ba1c1747cfca0f1759e25d53e6fa8722d7280f"} May 21 16:20:25.661164 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:25.660829 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:20:25.684616 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:25.684542 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" podStartSLOduration=1.181534584 podStartE2EDuration="3.684516569s" podCreationTimestamp="2026-05-21 16:20:22 +0000 UTC" firstStartedPulling="2026-05-21 16:20:22.829697838 +0000 UTC m=+565.359604810" lastFinishedPulling="2026-05-21 16:20:25.332679824 +0000 UTC m=+567.862586795" observedRunningTime="2026-05-21 16:20:25.681865299 +0000 UTC m=+568.211772294" watchObservedRunningTime="2026-05-21 16:20:25.684516569 +0000 UTC m=+568.214423563" May 21 16:20:28.181605 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.181559 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-476m9"] May 21 16:20:28.186528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.186502 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.189759 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.189733 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 16:20:28.189880 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.189761 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 16:20:28.190142 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.190122 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6m4n7\"" May 21 16:20:28.190219 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.190177 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 16:20:28.190219 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.190210 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 16:20:28.198670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.198644 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-476m9"] May 21 16:20:28.228319 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chb88\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-kube-api-access-chb88\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/927cc303-d6fc-459a-8ec8-4f98eb590f06-local-certs\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228350 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-token\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228615 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228615 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.228723 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.228640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-cacerts\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329480 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329444 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329480 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329484 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329505 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-cacerts\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chb88\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-kube-api-access-chb88\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329642 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/927cc303-d6fc-459a-8ec8-4f98eb590f06-local-certs\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329675 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.329903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.329716 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-token\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.330279 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.330187 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.331960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.331940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/927cc303-d6fc-459a-8ec8-4f98eb590f06-local-certs\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.332083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.332067 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-cacerts\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.332194 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.332175 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.332242 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.332225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.344798 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.344774 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-istio-token\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.345241 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.345224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chb88\" (UniqueName: \"kubernetes.io/projected/927cc303-d6fc-459a-8ec8-4f98eb590f06-kube-api-access-chb88\") pod \"istiod-openshift-gateway-798958bb55-476m9\" (UID: \"927cc303-d6fc-459a-8ec8-4f98eb590f06\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.495481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.495392 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:28.641779 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.641753 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-476m9"] May 21 16:20:28.644057 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:20:28.644032 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927cc303_d6fc_459a_8ec8_4f98eb590f06.slice/crio-cf3ae210c3be78047af74465cceb44ec78cae4ab4965cff1b4a026c29bb977a7 WatchSource:0}: Error finding container cf3ae210c3be78047af74465cceb44ec78cae4ab4965cff1b4a026c29bb977a7: Status 404 returned error can't find the container with id cf3ae210c3be78047af74465cceb44ec78cae4ab4965cff1b4a026c29bb977a7 May 21 16:20:28.671405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:28.671369 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" event={"ID":"927cc303-d6fc-459a-8ec8-4f98eb590f06","Type":"ContainerStarted","Data":"cf3ae210c3be78047af74465cceb44ec78cae4ab4965cff1b4a026c29bb977a7"} May 21 16:20:29.576511 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:29.576484 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-66wkg" May 21 16:20:32.007420 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:32.007378 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 21 16:20:32.007737 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:32.007452 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 21 16:20:32.686024 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:32.685984 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" event={"ID":"927cc303-d6fc-459a-8ec8-4f98eb590f06","Type":"ContainerStarted","Data":"470838aac8295f653cd3c66ef4cd30e1715925ff539d66a13e3a40ed0d14a5fd"} May 21 16:20:32.686199 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:32.686109 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:32.710297 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:32.710235 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" podStartSLOduration=1.349647377 podStartE2EDuration="4.710218382s" podCreationTimestamp="2026-05-21 16:20:28 +0000 UTC" firstStartedPulling="2026-05-21 16:20:28.646577823 +0000 UTC m=+571.176484816" lastFinishedPulling="2026-05-21 16:20:32.007148834 +0000 UTC m=+574.537055821" observedRunningTime="2026-05-21 16:20:32.708076733 +0000 UTC m=+575.237983729" watchObservedRunningTime="2026-05-21 16:20:32.710218382 +0000 UTC m=+575.240125375" May 21 16:20:33.691498 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:33.691470 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-476m9" May 21 16:20:36.666454 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:20:36.666420 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vzrlc" May 21 16:21:01.665515 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.665479 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4ccf7bb9-gm28f"] May 21 16:21:01.677859 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.677830 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.680583 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.680554 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4ccf7bb9-gm28f"] May 21 16:21:01.817375 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-service-ca\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817375 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pjh\" (UniqueName: \"kubernetes.io/projected/6b3cd35a-1add-4039-9125-74a0148e3f86-kube-api-access-h9pjh\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-console-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-oauth-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-trusted-ca-bundle\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.817774 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.817648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-oauth-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918717 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918628 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-oauth-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918717 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918690 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-service-ca\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918716 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pjh\" (UniqueName: \"kubernetes.io/projected/6b3cd35a-1add-4039-9125-74a0148e3f86-kube-api-access-h9pjh\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918791 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918830 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-console-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918869 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-oauth-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.918901 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.918895 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-trusted-ca-bundle\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.919675 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.919585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-service-ca\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.919813 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.919708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-console-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.919813 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.919801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-oauth-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.920082 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.920063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3cd35a-1add-4039-9125-74a0148e3f86-trusted-ca-bundle\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.921253 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.921231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-oauth-config\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.921366 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.921346 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b3cd35a-1add-4039-9125-74a0148e3f86-console-serving-cert\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.928414 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.928378 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pjh\" (UniqueName: \"kubernetes.io/projected/6b3cd35a-1add-4039-9125-74a0148e3f86-kube-api-access-h9pjh\") pod \"console-5b4ccf7bb9-gm28f\" (UID: \"6b3cd35a-1add-4039-9125-74a0148e3f86\") " pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:01.988528 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:01.988486 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:02.123098 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:02.123072 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4ccf7bb9-gm28f"] May 21 16:21:02.125262 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:02.125230 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3cd35a_1add_4039_9125_74a0148e3f86.slice/crio-b1def0f764efcccdc4bf98f90acc658db05132628413ab4d35f72a26804f007f WatchSource:0}: Error finding container b1def0f764efcccdc4bf98f90acc658db05132628413ab4d35f72a26804f007f: Status 404 returned error can't find the container with id b1def0f764efcccdc4bf98f90acc658db05132628413ab4d35f72a26804f007f May 21 16:21:02.785458 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:02.785417 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4ccf7bb9-gm28f" event={"ID":"6b3cd35a-1add-4039-9125-74a0148e3f86","Type":"ContainerStarted","Data":"59f926dd25652e7cee7f4a6dbff216e0195e55cb50d56ead729ee702a369e909"} May 21 16:21:02.785458 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:02.785453 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4ccf7bb9-gm28f" event={"ID":"6b3cd35a-1add-4039-9125-74a0148e3f86","Type":"ContainerStarted","Data":"b1def0f764efcccdc4bf98f90acc658db05132628413ab4d35f72a26804f007f"} May 21 16:21:02.803672 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:02.803588 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b4ccf7bb9-gm28f" podStartSLOduration=1.803572035 podStartE2EDuration="1.803572035s" podCreationTimestamp="2026-05-21 16:21:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:21:02.802392911 +0000 UTC m=+605.332299900" watchObservedRunningTime="2026-05-21 16:21:02.803572035 +0000 UTC m=+605.333479030" May 21 16:21:11.989370 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:11.989331 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:11.989776 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:11.989482 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:11.994242 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:11.994222 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:12.822896 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:12.822870 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4ccf7bb9-gm28f" May 21 16:21:12.891869 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:12.891829 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:21:28.682284 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.682247 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb"] May 21 16:21:28.685487 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.685471 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.688105 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.688083 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 16:21:28.689710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.689691 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsxsc\"" May 21 16:21:28.689819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.689694 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 16:21:28.698460 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.698431 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb"] May 21 16:21:28.731491 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.731456 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.731663 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.731535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkwx\" (UniqueName: \"kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.832662 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.832625 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkwx\" (UniqueName: \"kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.832804 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.832698 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.833061 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.833043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.844305 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.844275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkwx\" (UniqueName: \"kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:28.996400 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:28.996312 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:29.138090 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:29.138063 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb"] May 21 16:21:29.140079 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:29.140044 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b299a7_4399_4f20_a1cc_631c13b33126.slice/crio-4c651543f571b4217709920267cf0ab4143c9c5d85e915d570b9c3710c9cf121 WatchSource:0}: Error finding container 4c651543f571b4217709920267cf0ab4143c9c5d85e915d570b9c3710c9cf121: Status 404 returned error can't find the container with id 4c651543f571b4217709920267cf0ab4143c9c5d85e915d570b9c3710c9cf121 May 21 16:21:29.877511 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:29.877468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" event={"ID":"b2b299a7-4399-4f20-a1cc-631c13b33126","Type":"ContainerStarted","Data":"4c651543f571b4217709920267cf0ab4143c9c5d85e915d570b9c3710c9cf121"} May 21 16:21:33.892662 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:33.892626 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" event={"ID":"b2b299a7-4399-4f20-a1cc-631c13b33126","Type":"ContainerStarted","Data":"61df0f9f4b712e958033f74c63946b2bc4296cf7b26faa0931ae406de03b3569"} May 21 16:21:33.893056 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:33.892704 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:33.915821 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:33.915761 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" podStartSLOduration=1.772602705 podStartE2EDuration="5.915743638s" podCreationTimestamp="2026-05-21 16:21:28 +0000 UTC" firstStartedPulling="2026-05-21 16:21:29.142390397 +0000 UTC m=+631.672297382" lastFinishedPulling="2026-05-21 16:21:33.28553133 +0000 UTC m=+635.815438315" observedRunningTime="2026-05-21 16:21:33.913563665 +0000 UTC m=+636.443470655" watchObservedRunningTime="2026-05-21 16:21:33.915743638 +0000 UTC m=+636.445650633" May 21 16:21:37.911861 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:37.911824 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c94fcc67f-zrmx8" podUID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" containerName="console" containerID="cri-o://a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d" gracePeriod=15 May 21 16:21:38.160906 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.160875 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c94fcc67f-zrmx8_d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9/console/0.log" May 21 16:21:38.161040 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.160938 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:21:38.219815 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219731 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.219815 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219778 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.219815 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219805 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.220078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219830 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5cnp\" (UniqueName: \"kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.220078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219893 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.220078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219929 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.220078 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.219952 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert\") pod \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\" (UID: \"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9\") " May 21 16:21:38.220328 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.220238 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:21:38.220388 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.220354 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:21:38.220433 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.220382 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config" (OuterVolumeSpecName: "console-config") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:21:38.220433 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.220409 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:21:38.222299 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.222273 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:21:38.222681 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.222661 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:21:38.222681 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.222669 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp" (OuterVolumeSpecName: "kube-api-access-f5cnp") pod "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" (UID: "d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9"). InnerVolumeSpecName "kube-api-access-f5cnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:38.321240 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321200 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321240 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321234 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321240 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321244 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321240 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321253 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321498 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321262 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321498 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321272 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.321498 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.321281 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5cnp\" (UniqueName: \"kubernetes.io/projected/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9-kube-api-access-f5cnp\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:38.911331 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911306 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c94fcc67f-zrmx8_d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9/console/0.log" May 21 16:21:38.911552 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911347 2555 generic.go:358] "Generic (PLEG): container finished" podID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" containerID="a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d" exitCode=2 May 21 16:21:38.911552 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911387 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c94fcc67f-zrmx8" event={"ID":"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9","Type":"ContainerDied","Data":"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d"} May 21 16:21:38.911552 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911426 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c94fcc67f-zrmx8" May 21 16:21:38.911552 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911435 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c94fcc67f-zrmx8" event={"ID":"d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9","Type":"ContainerDied","Data":"d29f07f4ad35e8ae50226596f0ff256fe5f4e5f2e42e5076f4676ed587a4869d"} May 21 16:21:38.911552 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.911455 2555 scope.go:117] "RemoveContainer" containerID="a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d" May 21 16:21:38.920388 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.920371 2555 scope.go:117] "RemoveContainer" containerID="a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d" May 21 16:21:38.920689 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:21:38.920671 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d\": container with ID starting with a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d not found: ID does not exist" containerID="a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d" May 21 16:21:38.920735 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.920699 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d"} err="failed to get container status \"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d\": rpc error: code = NotFound desc = could not find container \"a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d\": container with ID starting with a3f7467aec5c482ce71a3a8383a5b04758dc964cd276f1342f038b827ee58d9d not found: ID does not exist" May 21 16:21:38.935634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.935612 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:21:38.942631 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:38.942604 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c94fcc67f-zrmx8"] May 21 16:21:40.032725 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:40.032692 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" path="/var/lib/kubelet/pods/d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9/volumes" May 21 16:21:44.898736 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:44.898707 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:46.416359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.412450 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv"] May 21 16:21:46.416359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.413757 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" containerName="console" May 21 16:21:46.416359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.413780 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" containerName="console" May 21 16:21:46.416359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.414006 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7168bb9-7e9e-4cf9-ab3b-0ee83900b1d9" containerName="console" May 21 16:21:46.420065 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.420038 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.435115 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.435091 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv"] May 21 16:21:46.491225 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.491183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4hdb\" (UniqueName: \"kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.491225 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.491230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.592191 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.592143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4hdb\" (UniqueName: \"kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.592191 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.592199 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.592569 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.592553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.600523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.600495 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4hdb\" (UniqueName: \"kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb\") pod \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.684647 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.684509 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb"] May 21 16:21:46.684909 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.684873 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" containerName="manager" containerID="cri-o://61df0f9f4b712e958033f74c63946b2bc4296cf7b26faa0931ae406de03b3569" gracePeriod=2 May 21 16:21:46.687236 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.687199 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:46.687737 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.687714 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb"] May 21 16:21:46.704268 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.704228 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv"] May 21 16:21:46.704793 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.704770 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:46.708929 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.708881 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:21:46.709344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.709324 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" containerName="manager" May 21 16:21:46.709438 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.709348 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" containerName="manager" May 21 16:21:46.709438 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.709422 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" containerName="manager" May 21 16:21:46.712445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.712424 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.714712 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.714679 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:46.717483 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.717424 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv"] May 21 16:21:46.732857 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.732781 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:21:46.734349 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.734318 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:21:46.737968 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.737937 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:46.754899 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.754852 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:46.755651 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.755627 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:21:46.794455 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.794425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp6dz\" (UniqueName: \"kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.794636 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.794481 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.895893 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.895856 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.896082 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.895904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dwtl\" (UniqueName: \"kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:46.896082 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.895952 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:46.896082 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.896012 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp6dz\" (UniqueName: \"kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.896279 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.896252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.906258 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.906230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp6dz\" (UniqueName: \"kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jk8wt\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:46.942992 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.942949 2555 generic.go:358] "Generic (PLEG): container finished" podID="b2b299a7-4399-4f20-a1cc-631c13b33126" containerID="61df0f9f4b712e958033f74c63946b2bc4296cf7b26faa0931ae406de03b3569" exitCode=0 May 21 16:21:46.943119 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.943011 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c651543f571b4217709920267cf0ab4143c9c5d85e915d570b9c3710c9cf121" May 21 16:21:46.944367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.944348 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:46.946548 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.946524 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:46.997187 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.997156 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dwtl\" (UniqueName: \"kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:46.997187 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.997203 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:46.997536 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:46.997517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:47.024810 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.024774 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dwtl\" (UniqueName: \"kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl\") pod \"kuadrant-operator-controller-manager-84b657d985-qd5jv\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:47.065445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.065407 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:47.072323 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.072300 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:47.098235 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.098194 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lkwx\" (UniqueName: \"kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx\") pod \"b2b299a7-4399-4f20-a1cc-631c13b33126\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " May 21 16:21:47.098443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.098274 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume\") pod \"b2b299a7-4399-4f20-a1cc-631c13b33126\" (UID: \"b2b299a7-4399-4f20-a1cc-631c13b33126\") " May 21 16:21:47.098815 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.098791 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2b299a7-4399-4f20-a1cc-631c13b33126" (UID: "b2b299a7-4399-4f20-a1cc-631c13b33126"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:47.100520 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.100494 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx" (OuterVolumeSpecName: "kube-api-access-8lkwx") pod "b2b299a7-4399-4f20-a1cc-631c13b33126" (UID: "b2b299a7-4399-4f20-a1cc-631c13b33126"). InnerVolumeSpecName "kube-api-access-8lkwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:47.199699 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.199615 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lkwx\" (UniqueName: \"kubernetes.io/projected/b2b299a7-4399-4f20-a1cc-631c13b33126-kube-api-access-8lkwx\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:47.199699 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.199659 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b299a7-4399-4f20-a1cc-631c13b33126-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:47.215228 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.215198 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:21:47.218024 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:47.217995 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16976b31_a5f3_4af9_99b4_95ae56c869df.slice/crio-f632190d944e030821dbd705a7d55c6ac06da91102b4cc9755d960195d1303a0 WatchSource:0}: Error finding container f632190d944e030821dbd705a7d55c6ac06da91102b4cc9755d960195d1303a0: Status 404 returned error can't find the container with id f632190d944e030821dbd705a7d55c6ac06da91102b4cc9755d960195d1303a0 May 21 16:21:47.246095 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.246073 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:21:47.254654 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:47.254624 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89c139a_8b6d_4629_83bd_4951cf128e41.slice/crio-45c813c8a86bdc9548aa9f7daba049709e93e5f30bd9affb8184653ab472f9fb WatchSource:0}: Error finding container 45c813c8a86bdc9548aa9f7daba049709e93e5f30bd9affb8184653ab472f9fb: Status 404 returned error can't find the container with id 45c813c8a86bdc9548aa9f7daba049709e93e5f30bd9affb8184653ab472f9fb May 21 16:21:47.947387 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.947287 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" event={"ID":"16976b31-a5f3-4af9-99b4-95ae56c869df","Type":"ContainerStarted","Data":"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c"} May 21 16:21:47.947387 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.947335 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" event={"ID":"16976b31-a5f3-4af9-99b4-95ae56c869df","Type":"ContainerStarted","Data":"f632190d944e030821dbd705a7d55c6ac06da91102b4cc9755d960195d1303a0"} May 21 16:21:47.947888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.947415 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:47.948777 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.948754 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" event={"ID":"d89c139a-8b6d-4629-83bd-4951cf128e41","Type":"ContainerStarted","Data":"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1"} May 21 16:21:47.948876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.948785 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" event={"ID":"d89c139a-8b6d-4629-83bd-4951cf128e41","Type":"ContainerStarted","Data":"45c813c8a86bdc9548aa9f7daba049709e93e5f30bd9affb8184653ab472f9fb"} May 21 16:21:47.948876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.948805 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:47.948876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.948827 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" May 21 16:21:47.981246 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.981195 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" podStartSLOduration=1.98118177 podStartE2EDuration="1.98118177s" podCreationTimestamp="2026-05-21 16:21:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:21:47.979409159 +0000 UTC m=+650.509316154" watchObservedRunningTime="2026-05-21 16:21:47.98118177 +0000 UTC m=+650.511088811" May 21 16:21:47.981481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.981453 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:47.983495 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:47.983465 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:48.024430 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:48.024383 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" podStartSLOduration=2.024367104 podStartE2EDuration="2.024367104s" podCreationTimestamp="2026-05-21 16:21:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:21:48.023229497 +0000 UTC m=+650.553136490" watchObservedRunningTime="2026-05-21 16:21:48.024367104 +0000 UTC m=+650.554274098" May 21 16:21:48.032348 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:48.032315 2555 status_manager.go:895] "Failed to get status for pod" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-r9mtb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-r9mtb\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:48.033321 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:48.033302 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b299a7-4399-4f20-a1cc-631c13b33126" path="/var/lib/kubelet/pods/b2b299a7-4399-4f20-a1cc-631c13b33126/volumes" May 21 16:21:49.239531 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:49.239500 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d820e25_8dcf_4875_9fe3_3aa45861e18b.slice/crio-d1bfa582ab5cf62557327527aa1960d60c70e1aa14d37aa8d2b99c067736263b WatchSource:0}: Error finding container d1bfa582ab5cf62557327527aa1960d60c70e1aa14d37aa8d2b99c067736263b: Status 404 returned error can't find the container with id d1bfa582ab5cf62557327527aa1960d60c70e1aa14d37aa8d2b99c067736263b May 21 16:21:49.956772 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:49.956731 2555 generic.go:358] "Generic (PLEG): container finished" podID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" containerID="dde2d149f7e77bb431ceb2659aa0b2d1bac6b0f40b4d6ec218c0b6871dc86cac" exitCode=1 May 21 16:21:49.987817 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:49.987793 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:49.990119 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:49.990096 2555 status_manager.go:895] "Failed to get status for pod" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" err="pods \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:50.126319 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.126287 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume\") pod \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " May 21 16:21:50.126470 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.126354 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4hdb\" (UniqueName: \"kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb\") pod \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\" (UID: \"3d820e25-8dcf-4875-9fe3-3aa45861e18b\") " May 21 16:21:50.126643 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.126615 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3d820e25-8dcf-4875-9fe3-3aa45861e18b" (UID: "3d820e25-8dcf-4875-9fe3-3aa45861e18b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:50.128526 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.128506 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb" (OuterVolumeSpecName: "kube-api-access-n4hdb") pod "3d820e25-8dcf-4875-9fe3-3aa45861e18b" (UID: "3d820e25-8dcf-4875-9fe3-3aa45861e18b"). InnerVolumeSpecName "kube-api-access-n4hdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:50.227218 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.227115 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4hdb\" (UniqueName: \"kubernetes.io/projected/3d820e25-8dcf-4875-9fe3-3aa45861e18b-kube-api-access-n4hdb\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:50.227218 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.227160 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d820e25-8dcf-4875-9fe3-3aa45861e18b-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:50.961535 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.961508 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" May 21 16:21:50.961993 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.961514 2555 scope.go:117] "RemoveContainer" containerID="dde2d149f7e77bb431ceb2659aa0b2d1bac6b0f40b4d6ec218c0b6871dc86cac" May 21 16:21:50.972007 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:50.971979 2555 status_manager.go:895] "Failed to get status for pod" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h5tgv" err="pods \"kuadrant-operator-controller-manager-84b657d985-h5tgv\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" May 21 16:21:52.032890 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:52.032856 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" path="/var/lib/kubelet/pods/3d820e25-8dcf-4875-9fe3-3aa45861e18b/volumes" May 21 16:21:58.954420 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:58.954388 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:58.954879 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:58.954440 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:21:59.025759 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.025722 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:21:59.026001 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.025975 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" podUID="16976b31-a5f3-4af9-99b4-95ae56c869df" containerName="manager" containerID="cri-o://3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c" gracePeriod=10 May 21 16:21:59.270225 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.270201 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:59.323332 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323298 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:21:59.323652 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323639 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16976b31-a5f3-4af9-99b4-95ae56c869df" containerName="manager" May 21 16:21:59.323710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323653 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="16976b31-a5f3-4af9-99b4-95ae56c869df" containerName="manager" May 21 16:21:59.323710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323662 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" containerName="manager" May 21 16:21:59.323710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323668 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" containerName="manager" May 21 16:21:59.323813 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323727 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="16976b31-a5f3-4af9-99b4-95ae56c869df" containerName="manager" May 21 16:21:59.323813 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.323736 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d820e25-8dcf-4875-9fe3-3aa45861e18b" containerName="manager" May 21 16:21:59.327220 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.327205 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.339904 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.339877 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:21:59.406827 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.406791 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp6dz\" (UniqueName: \"kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz\") pod \"16976b31-a5f3-4af9-99b4-95ae56c869df\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " May 21 16:21:59.407002 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.406873 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume\") pod \"16976b31-a5f3-4af9-99b4-95ae56c869df\" (UID: \"16976b31-a5f3-4af9-99b4-95ae56c869df\") " May 21 16:21:59.407198 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.407175 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16976b31-a5f3-4af9-99b4-95ae56c869df" (UID: "16976b31-a5f3-4af9-99b4-95ae56c869df"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:59.409049 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.409022 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz" (OuterVolumeSpecName: "kube-api-access-fp6dz") pod "16976b31-a5f3-4af9-99b4-95ae56c869df" (UID: "16976b31-a5f3-4af9-99b4-95ae56c869df"). InnerVolumeSpecName "kube-api-access-fp6dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:59.507619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.507508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.507619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.507548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xm2d\" (UniqueName: \"kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.507619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.507586 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp6dz\" (UniqueName: \"kubernetes.io/projected/16976b31-a5f3-4af9-99b4-95ae56c869df-kube-api-access-fp6dz\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:59.507847 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.507622 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16976b31-a5f3-4af9-99b4-95ae56c869df-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:21:59.608979 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.608937 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.608979 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.608980 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xm2d\" (UniqueName: \"kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.609325 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.609303 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.621196 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.621172 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xm2d\" (UniqueName: \"kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-crlfj\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.638113 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.638095 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.768542 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.768515 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:21:59.771276 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:21:59.771249 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c24c70_4751_41ad_b621_a2cfd77d1dcd.slice/crio-361e8e3537658b876d99c4a041b3d1a28ed1f7ef293b9c31e514306dfb96b3e9 WatchSource:0}: Error finding container 361e8e3537658b876d99c4a041b3d1a28ed1f7ef293b9c31e514306dfb96b3e9: Status 404 returned error can't find the container with id 361e8e3537658b876d99c4a041b3d1a28ed1f7ef293b9c31e514306dfb96b3e9 May 21 16:21:59.997242 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.997199 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" event={"ID":"b0c24c70-4751-41ad-b621-a2cfd77d1dcd","Type":"ContainerStarted","Data":"a92ad240f0837b450e8b338d511fdbd6e1f5bbadb941ccc1c2e0d4a49f5ebfe0"} May 21 16:21:59.997242 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.997244 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" event={"ID":"b0c24c70-4751-41ad-b621-a2cfd77d1dcd","Type":"ContainerStarted","Data":"361e8e3537658b876d99c4a041b3d1a28ed1f7ef293b9c31e514306dfb96b3e9"} May 21 16:21:59.997754 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.997333 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:21:59.998409 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.998389 2555 generic.go:358] "Generic (PLEG): container finished" podID="16976b31-a5f3-4af9-99b4-95ae56c869df" containerID="3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c" exitCode=0 May 21 16:21:59.998497 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.998422 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" event={"ID":"16976b31-a5f3-4af9-99b4-95ae56c869df","Type":"ContainerDied","Data":"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c"} May 21 16:21:59.998497 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.998438 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" May 21 16:21:59.998497 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.998450 2555 scope.go:117] "RemoveContainer" containerID="3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c" May 21 16:21:59.998630 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:21:59.998439 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt" event={"ID":"16976b31-a5f3-4af9-99b4-95ae56c869df","Type":"ContainerDied","Data":"f632190d944e030821dbd705a7d55c6ac06da91102b4cc9755d960195d1303a0"} May 21 16:22:00.007001 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:00.006977 2555 scope.go:117] "RemoveContainer" containerID="3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c" May 21 16:22:00.007293 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:22:00.007273 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c\": container with ID starting with 3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c not found: ID does not exist" containerID="3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c" May 21 16:22:00.007356 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:00.007301 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c"} err="failed to get container status \"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c\": rpc error: code = NotFound desc = could not find container \"3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c\": container with ID starting with 3e70afdbe62e814c4e4c3522db4cd4196b95ccaecbfc072d077ea77a05ad602c not found: ID does not exist" May 21 16:22:00.016312 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:00.016274 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" podStartSLOduration=1.016262589 podStartE2EDuration="1.016262589s" podCreationTimestamp="2026-05-21 16:21:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:22:00.014893459 +0000 UTC m=+662.544800453" watchObservedRunningTime="2026-05-21 16:22:00.016262589 +0000 UTC m=+662.546169635" May 21 16:22:00.033520 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:00.033446 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:22:00.033520 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:00.033479 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jk8wt"] May 21 16:22:02.032373 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:02.032339 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16976b31-a5f3-4af9-99b4-95ae56c869df" path="/var/lib/kubelet/pods/16976b31-a5f3-4af9-99b4-95ae56c869df/volumes" May 21 16:22:11.005750 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.005721 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:22:11.061311 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.061272 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:22:11.061632 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.061585 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" podUID="d89c139a-8b6d-4629-83bd-4951cf128e41" containerName="manager" containerID="cri-o://e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1" gracePeriod=10 May 21 16:22:11.310531 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.310496 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:22:11.408574 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.408537 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume\") pod \"d89c139a-8b6d-4629-83bd-4951cf128e41\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " May 21 16:22:11.408772 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.408621 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dwtl\" (UniqueName: \"kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl\") pod \"d89c139a-8b6d-4629-83bd-4951cf128e41\" (UID: \"d89c139a-8b6d-4629-83bd-4951cf128e41\") " May 21 16:22:11.408972 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.408951 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d89c139a-8b6d-4629-83bd-4951cf128e41" (UID: "d89c139a-8b6d-4629-83bd-4951cf128e41"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:22:11.410807 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.410788 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl" (OuterVolumeSpecName: "kube-api-access-4dwtl") pod "d89c139a-8b6d-4629-83bd-4951cf128e41" (UID: "d89c139a-8b6d-4629-83bd-4951cf128e41"). InnerVolumeSpecName "kube-api-access-4dwtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:22:11.509714 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.509679 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d89c139a-8b6d-4629-83bd-4951cf128e41-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:22:11.509714 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:11.509706 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dwtl\" (UniqueName: \"kubernetes.io/projected/d89c139a-8b6d-4629-83bd-4951cf128e41-kube-api-access-4dwtl\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:22:12.056322 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.056289 2555 generic.go:358] "Generic (PLEG): container finished" podID="d89c139a-8b6d-4629-83bd-4951cf128e41" containerID="e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1" exitCode=0 May 21 16:22:12.056775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.056353 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" May 21 16:22:12.056775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.056359 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" event={"ID":"d89c139a-8b6d-4629-83bd-4951cf128e41","Type":"ContainerDied","Data":"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1"} May 21 16:22:12.056775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.056400 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv" event={"ID":"d89c139a-8b6d-4629-83bd-4951cf128e41","Type":"ContainerDied","Data":"45c813c8a86bdc9548aa9f7daba049709e93e5f30bd9affb8184653ab472f9fb"} May 21 16:22:12.056775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.056421 2555 scope.go:117] "RemoveContainer" containerID="e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1" May 21 16:22:12.064583 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.064432 2555 scope.go:117] "RemoveContainer" containerID="e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1" May 21 16:22:12.064723 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:22:12.064703 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1\": container with ID starting with e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1 not found: ID does not exist" containerID="e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1" May 21 16:22:12.064763 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.064733 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1"} err="failed to get container status \"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1\": rpc error: code = NotFound desc = could not find container \"e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1\": container with ID starting with e3cf5e3938e18c55ad28de5d1abd642e70f0791917530614f6da61ca5aac49a1 not found: ID does not exist" May 21 16:22:12.079701 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.079675 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:22:12.084279 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:12.084256 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-qd5jv"] May 21 16:22:14.032899 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:14.032866 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d89c139a-8b6d-4629-83bd-4951cf128e41" path="/var/lib/kubelet/pods/d89c139a-8b6d-4629-83bd-4951cf128e41/volumes" May 21 16:22:27.964993 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.964958 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:27.965429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.965260 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d89c139a-8b6d-4629-83bd-4951cf128e41" containerName="manager" May 21 16:22:27.965429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.965272 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89c139a-8b6d-4629-83bd-4951cf128e41" containerName="manager" May 21 16:22:27.965429 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.965331 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d89c139a-8b6d-4629-83bd-4951cf128e41" containerName="manager" May 21 16:22:27.968206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.968188 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:27.970677 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.970657 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 16:22:27.970785 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.970660 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7rvr8\"" May 21 16:22:27.976276 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:27.976251 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:28.052246 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.052211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fct2\" (UniqueName: \"kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.052246 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.052254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.066147 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.066117 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:28.153285 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.153251 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fct2\" (UniqueName: \"kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.153285 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.153292 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.154016 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.153998 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.162458 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.162428 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fct2\" (UniqueName: \"kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2\") pod \"limitador-limitador-7d549b5b-ndbrs\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.279865 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.279758 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:28.414272 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.414245 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:28.416468 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:22:28.416437 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode909c369_b932_4443_9000_4e6981218045.slice/crio-362233f2c3b59759a100c55e843c61ba2ec10cae034d2f00d186a5a58e6ecad1 WatchSource:0}: Error finding container 362233f2c3b59759a100c55e843c61ba2ec10cae034d2f00d186a5a58e6ecad1: Status 404 returned error can't find the container with id 362233f2c3b59759a100c55e843c61ba2ec10cae034d2f00d186a5a58e6ecad1 May 21 16:22:28.418236 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:28.418216 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:22:29.121614 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:29.121546 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" event={"ID":"e909c369-b932-4443-9000-4e6981218045","Type":"ContainerStarted","Data":"362233f2c3b59759a100c55e843c61ba2ec10cae034d2f00d186a5a58e6ecad1"} May 21 16:22:31.129888 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:31.129853 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" event={"ID":"e909c369-b932-4443-9000-4e6981218045","Type":"ContainerStarted","Data":"8b38960bb9122fb60d30bebdc9b9061ef356a3ffd006ec57360b5f6986a67f6e"} May 21 16:22:31.130254 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:31.129991 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:31.148517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:31.148467 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" podStartSLOduration=1.653370861 podStartE2EDuration="4.148453225s" podCreationTimestamp="2026-05-21 16:22:27 +0000 UTC" firstStartedPulling="2026-05-21 16:22:28.418342816 +0000 UTC m=+690.948249788" lastFinishedPulling="2026-05-21 16:22:30.913425181 +0000 UTC m=+693.443332152" observedRunningTime="2026-05-21 16:22:31.146792215 +0000 UTC m=+693.676699211" watchObservedRunningTime="2026-05-21 16:22:31.148453225 +0000 UTC m=+693.678360219" May 21 16:22:42.134427 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:42.134396 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:44.336420 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:44.336344 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:44.336815 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:44.336556 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" podUID="e909c369-b932-4443-9000-4e6981218045" containerName="limitador" containerID="cri-o://8b38960bb9122fb60d30bebdc9b9061ef356a3ffd006ec57360b5f6986a67f6e" gracePeriod=30 May 21 16:22:45.177779 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.177741 2555 generic.go:358] "Generic (PLEG): container finished" podID="e909c369-b932-4443-9000-4e6981218045" containerID="8b38960bb9122fb60d30bebdc9b9061ef356a3ffd006ec57360b5f6986a67f6e" exitCode=0 May 21 16:22:45.177946 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.177823 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" event={"ID":"e909c369-b932-4443-9000-4e6981218045","Type":"ContainerDied","Data":"8b38960bb9122fb60d30bebdc9b9061ef356a3ffd006ec57360b5f6986a67f6e"} May 21 16:22:45.280845 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.280823 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:45.401358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.401267 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fct2\" (UniqueName: \"kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2\") pod \"e909c369-b932-4443-9000-4e6981218045\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " May 21 16:22:45.401358 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.401316 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file\") pod \"e909c369-b932-4443-9000-4e6981218045\" (UID: \"e909c369-b932-4443-9000-4e6981218045\") " May 21 16:22:45.401770 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.401703 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file" (OuterVolumeSpecName: "config-file") pod "e909c369-b932-4443-9000-4e6981218045" (UID: "e909c369-b932-4443-9000-4e6981218045"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:22:45.403522 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.403498 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2" (OuterVolumeSpecName: "kube-api-access-2fct2") pod "e909c369-b932-4443-9000-4e6981218045" (UID: "e909c369-b932-4443-9000-4e6981218045"). InnerVolumeSpecName "kube-api-access-2fct2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:22:45.502689 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.502635 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e909c369-b932-4443-9000-4e6981218045-config-file\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:22:45.502689 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.502683 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fct2\" (UniqueName: \"kubernetes.io/projected/e909c369-b932-4443-9000-4e6981218045-kube-api-access-2fct2\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:22:45.630619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.629835 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-p22mp"] May 21 16:22:45.630619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.630497 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e909c369-b932-4443-9000-4e6981218045" containerName="limitador" May 21 16:22:45.630619 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.630516 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e909c369-b932-4443-9000-4e6981218045" containerName="limitador" May 21 16:22:45.630904 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.630696 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="e909c369-b932-4443-9000-4e6981218045" containerName="limitador" May 21 16:22:45.634965 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.634875 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.638435 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.638276 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 16:22:45.638435 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.638306 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fwnlk\"" May 21 16:22:45.639367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.639344 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-p22mp"] May 21 16:22:45.805628 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.805514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxrl\" (UniqueName: \"kubernetes.io/projected/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-kube-api-access-clxrl\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.805781 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.805671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-data\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.906906 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.906867 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-data\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.907096 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.906928 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clxrl\" (UniqueName: \"kubernetes.io/projected/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-kube-api-access-clxrl\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.907262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.907237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-data\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.916551 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.916518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxrl\" (UniqueName: \"kubernetes.io/projected/f49fcbe8-c28f-4e59-b6ee-eb60eeee5241-kube-api-access-clxrl\") pod \"postgres-68c4fbbd6f-p22mp\" (UID: \"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241\") " pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:45.948051 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:45.948020 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:46.077892 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.077818 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-p22mp"] May 21 16:22:46.081465 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:22:46.081429 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49fcbe8_c28f_4e59_b6ee_eb60eeee5241.slice/crio-4685cc96103763a98b0033b32522f58db6df182a88e8013c3e09e9cb1e91f965 WatchSource:0}: Error finding container 4685cc96103763a98b0033b32522f58db6df182a88e8013c3e09e9cb1e91f965: Status 404 returned error can't find the container with id 4685cc96103763a98b0033b32522f58db6df182a88e8013c3e09e9cb1e91f965 May 21 16:22:46.182202 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.182159 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" event={"ID":"e909c369-b932-4443-9000-4e6981218045","Type":"ContainerDied","Data":"362233f2c3b59759a100c55e843c61ba2ec10cae034d2f00d186a5a58e6ecad1"} May 21 16:22:46.182202 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.182204 2555 scope.go:117] "RemoveContainer" containerID="8b38960bb9122fb60d30bebdc9b9061ef356a3ffd006ec57360b5f6986a67f6e" May 21 16:22:46.182445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.182215 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ndbrs" May 21 16:22:46.183408 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.183375 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-p22mp" event={"ID":"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241","Type":"ContainerStarted","Data":"4685cc96103763a98b0033b32522f58db6df182a88e8013c3e09e9cb1e91f965"} May 21 16:22:46.199080 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.199053 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:46.202890 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:46.202868 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ndbrs"] May 21 16:22:48.035339 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:48.035300 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e909c369-b932-4443-9000-4e6981218045" path="/var/lib/kubelet/pods/e909c369-b932-4443-9000-4e6981218045/volumes" May 21 16:22:52.212647 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:52.212607 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-p22mp" event={"ID":"f49fcbe8-c28f-4e59-b6ee-eb60eeee5241","Type":"ContainerStarted","Data":"900b8d5a0a6962d9a8d09e0ecf5305a0784f2ffa55f9957977eedfd3a6d60ce5"} May 21 16:22:52.213090 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:52.212709 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:22:52.228971 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:52.228916 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-p22mp" podStartSLOduration=2.037020421 podStartE2EDuration="7.228901051s" podCreationTimestamp="2026-05-21 16:22:45 +0000 UTC" firstStartedPulling="2026-05-21 16:22:46.082656696 +0000 UTC m=+708.612563667" lastFinishedPulling="2026-05-21 16:22:51.274537307 +0000 UTC m=+713.804444297" observedRunningTime="2026-05-21 16:22:52.227093417 +0000 UTC m=+714.757000423" watchObservedRunningTime="2026-05-21 16:22:52.228901051 +0000 UTC m=+714.758808079" May 21 16:22:58.245397 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:22:58.245323 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-p22mp" May 21 16:23:03.975732 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:03.975698 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:04.004699 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.004665 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:04.004876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.004847 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:04.008085 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.008066 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-npnq9\"" May 21 16:23:04.008384 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.008363 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 16:23:04.064892 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.064847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqffb\" (UniqueName: \"kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb\") pod \"maas-controller-7df575f8c9-snxmq\" (UID: \"b491660a-120d-4a75-801d-b9314f640398\") " pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:04.160110 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.160072 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:04.163413 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.163395 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:04.165906 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.165880 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmsz\" (UniqueName: \"kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz\") pod \"maas-controller-7666d8b6d-brgph\" (UID: \"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f\") " pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:04.166013 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.165933 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqffb\" (UniqueName: \"kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb\") pod \"maas-controller-7df575f8c9-snxmq\" (UID: \"b491660a-120d-4a75-801d-b9314f640398\") " pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:04.175413 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.175385 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:04.178738 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.178709 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqffb\" (UniqueName: \"kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb\") pod \"maas-controller-7df575f8c9-snxmq\" (UID: \"b491660a-120d-4a75-801d-b9314f640398\") " pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:04.266793 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.266699 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmsz\" (UniqueName: \"kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz\") pod \"maas-controller-7666d8b6d-brgph\" (UID: \"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f\") " pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:04.276334 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.276303 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmsz\" (UniqueName: \"kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz\") pod \"maas-controller-7666d8b6d-brgph\" (UID: \"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f\") " pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:04.287819 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.287788 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:04.288084 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.288063 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:04.342416 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.342383 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:04.347841 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.347535 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:04.358136 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.358108 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:04.367208 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.367185 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txlcw\" (UniqueName: \"kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw\") pod \"maas-controller-6899dbbbdb-grw79\" (UID: \"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43\") " pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:04.436182 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.436143 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:04.440275 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:23:04.440246 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb491660a_120d_4a75_801d_b9314f640398.slice/crio-ff2393cd204e4e7b29a969922a973a60cf83d950c1bf1a7fc6c306f479b8c972 WatchSource:0}: Error finding container ff2393cd204e4e7b29a969922a973a60cf83d950c1bf1a7fc6c306f479b8c972: Status 404 returned error can't find the container with id ff2393cd204e4e7b29a969922a973a60cf83d950c1bf1a7fc6c306f479b8c972 May 21 16:23:04.467963 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.467929 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txlcw\" (UniqueName: \"kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw\") pod \"maas-controller-6899dbbbdb-grw79\" (UID: \"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43\") " pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:04.474908 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.474887 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:04.480006 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.479986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txlcw\" (UniqueName: \"kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw\") pod \"maas-controller-6899dbbbdb-grw79\" (UID: \"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43\") " pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:04.607654 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.607624 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:04.610093 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:23:04.610055 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15d65e6_5f4c_4f5c_a2d0_be8b11a7c52f.slice/crio-09af461be569567051e958797a1fa64c17bf5b923d0df289e9cafa541f4e5737 WatchSource:0}: Error finding container 09af461be569567051e958797a1fa64c17bf5b923d0df289e9cafa541f4e5737: Status 404 returned error can't find the container with id 09af461be569567051e958797a1fa64c17bf5b923d0df289e9cafa541f4e5737 May 21 16:23:04.660675 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.660635 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:04.803881 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:04.798472 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:05.259856 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:05.259777 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6899dbbbdb-grw79" event={"ID":"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43","Type":"ContainerStarted","Data":"02c5fc2be3fc86cd0a97b4436bdce9959078f64fe1dbfbf7d3a9ad145c0916c9"} May 21 16:23:05.261683 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:05.261580 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-snxmq" event={"ID":"b491660a-120d-4a75-801d-b9314f640398","Type":"ContainerStarted","Data":"ff2393cd204e4e7b29a969922a973a60cf83d950c1bf1a7fc6c306f479b8c972"} May 21 16:23:05.263725 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:05.263659 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7666d8b6d-brgph" event={"ID":"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f","Type":"ContainerStarted","Data":"09af461be569567051e958797a1fa64c17bf5b923d0df289e9cafa541f4e5737"} May 21 16:23:08.280444 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.280348 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6899dbbbdb-grw79" event={"ID":"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43","Type":"ContainerStarted","Data":"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1"} May 21 16:23:08.280876 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.280457 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:08.281676 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.281655 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-snxmq" event={"ID":"b491660a-120d-4a75-801d-b9314f640398","Type":"ContainerStarted","Data":"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7"} May 21 16:23:08.281774 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.281703 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:08.281774 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.281713 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7df575f8c9-snxmq" podUID="b491660a-120d-4a75-801d-b9314f640398" containerName="manager" containerID="cri-o://e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7" gracePeriod=30 May 21 16:23:08.283247 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.283224 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7666d8b6d-brgph" event={"ID":"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f","Type":"ContainerStarted","Data":"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd"} May 21 16:23:08.283378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.283345 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:08.305026 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.304987 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6899dbbbdb-grw79" podStartSLOduration=1.093537172 podStartE2EDuration="4.304975795s" podCreationTimestamp="2026-05-21 16:23:04 +0000 UTC" firstStartedPulling="2026-05-21 16:23:04.804587279 +0000 UTC m=+727.334494254" lastFinishedPulling="2026-05-21 16:23:08.016025889 +0000 UTC m=+730.545932877" observedRunningTime="2026-05-21 16:23:08.302066504 +0000 UTC m=+730.831973499" watchObservedRunningTime="2026-05-21 16:23:08.304975795 +0000 UTC m=+730.834882788" May 21 16:23:08.320193 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.320148 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7666d8b6d-brgph" podStartSLOduration=0.905778801 podStartE2EDuration="4.320136665s" podCreationTimestamp="2026-05-21 16:23:04 +0000 UTC" firstStartedPulling="2026-05-21 16:23:04.611421081 +0000 UTC m=+727.141328053" lastFinishedPulling="2026-05-21 16:23:08.025778945 +0000 UTC m=+730.555685917" observedRunningTime="2026-05-21 16:23:08.318116878 +0000 UTC m=+730.848023872" watchObservedRunningTime="2026-05-21 16:23:08.320136665 +0000 UTC m=+730.850043827" May 21 16:23:08.341083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.340998 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7df575f8c9-snxmq" podStartSLOduration=1.76718278 podStartE2EDuration="5.3409832s" podCreationTimestamp="2026-05-21 16:23:03 +0000 UTC" firstStartedPulling="2026-05-21 16:23:04.441588029 +0000 UTC m=+726.971495001" lastFinishedPulling="2026-05-21 16:23:08.015388447 +0000 UTC m=+730.545295421" observedRunningTime="2026-05-21 16:23:08.338050197 +0000 UTC m=+730.867957192" watchObservedRunningTime="2026-05-21 16:23:08.3409832 +0000 UTC m=+730.870890195" May 21 16:23:08.520762 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.520740 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:08.597455 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.597431 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqffb\" (UniqueName: \"kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb\") pod \"b491660a-120d-4a75-801d-b9314f640398\" (UID: \"b491660a-120d-4a75-801d-b9314f640398\") " May 21 16:23:08.599744 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.599722 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb" (OuterVolumeSpecName: "kube-api-access-wqffb") pod "b491660a-120d-4a75-801d-b9314f640398" (UID: "b491660a-120d-4a75-801d-b9314f640398"). InnerVolumeSpecName "kube-api-access-wqffb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:08.698443 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:08.698397 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqffb\" (UniqueName: \"kubernetes.io/projected/b491660a-120d-4a75-801d-b9314f640398-kube-api-access-wqffb\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:23:09.287909 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.287823 2555 generic.go:358] "Generic (PLEG): container finished" podID="b491660a-120d-4a75-801d-b9314f640398" containerID="e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7" exitCode=0 May 21 16:23:09.288284 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.287913 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-snxmq" May 21 16:23:09.288284 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.287907 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-snxmq" event={"ID":"b491660a-120d-4a75-801d-b9314f640398","Type":"ContainerDied","Data":"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7"} May 21 16:23:09.288284 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.288027 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-snxmq" event={"ID":"b491660a-120d-4a75-801d-b9314f640398","Type":"ContainerDied","Data":"ff2393cd204e4e7b29a969922a973a60cf83d950c1bf1a7fc6c306f479b8c972"} May 21 16:23:09.288284 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.288044 2555 scope.go:117] "RemoveContainer" containerID="e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7" May 21 16:23:09.296426 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.296412 2555 scope.go:117] "RemoveContainer" containerID="e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7" May 21 16:23:09.296773 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:23:09.296754 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7\": container with ID starting with e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7 not found: ID does not exist" containerID="e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7" May 21 16:23:09.296834 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.296779 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7"} err="failed to get container status \"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7\": rpc error: code = NotFound desc = could not find container \"e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7\": container with ID starting with e6b07f41635eb990001e0c136d71beff807abac3e31a6c938c540f8f4ca730e7 not found: ID does not exist" May 21 16:23:09.317206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.317181 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:09.321698 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:09.321676 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-snxmq"] May 21 16:23:10.032726 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:10.032690 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b491660a-120d-4a75-801d-b9314f640398" path="/var/lib/kubelet/pods/b491660a-120d-4a75-801d-b9314f640398/volumes" May 21 16:23:19.293205 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.293171 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:19.293737 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.293227 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:19.373309 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.373271 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:19.373517 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.373491 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7666d8b6d-brgph" podUID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" containerName="manager" containerID="cri-o://499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd" gracePeriod=30 May 21 16:23:19.566381 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.566288 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:23:19.566703 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.566685 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b491660a-120d-4a75-801d-b9314f640398" containerName="manager" May 21 16:23:19.566703 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.566703 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b491660a-120d-4a75-801d-b9314f640398" containerName="manager" May 21 16:23:19.566885 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.566770 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b491660a-120d-4a75-801d-b9314f640398" containerName="manager" May 21 16:23:19.569958 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.569934 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:19.578184 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.578154 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:23:19.578439 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.578413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55z4\" (UniqueName: \"kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4\") pod \"maas-controller-6f46df6cb6-67zv5\" (UID: \"abf40222-8333-417b-98f7-aae4e694d22b\") " pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:19.621301 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.621281 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:19.679435 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.679406 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxmsz\" (UniqueName: \"kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz\") pod \"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f\" (UID: \"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f\") " May 21 16:23:19.679620 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.679545 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x55z4\" (UniqueName: \"kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4\") pod \"maas-controller-6f46df6cb6-67zv5\" (UID: \"abf40222-8333-417b-98f7-aae4e694d22b\") " pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:19.681577 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.681556 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz" (OuterVolumeSpecName: "kube-api-access-qxmsz") pod "f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" (UID: "f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f"). InnerVolumeSpecName "kube-api-access-qxmsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:19.688796 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.688770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55z4\" (UniqueName: \"kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4\") pod \"maas-controller-6f46df6cb6-67zv5\" (UID: \"abf40222-8333-417b-98f7-aae4e694d22b\") " pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:19.780943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.780907 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxmsz\" (UniqueName: \"kubernetes.io/projected/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f-kube-api-access-qxmsz\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:23:19.881403 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:19.881361 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:20.005252 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.005229 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:23:20.007506 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:23:20.007479 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf40222_8333_417b_98f7_aae4e694d22b.slice/crio-e8ad7760fc250c3fa42c7326b5f70e5160dd394957b7561a4ee559804db9d6a4 WatchSource:0}: Error finding container e8ad7760fc250c3fa42c7326b5f70e5160dd394957b7561a4ee559804db9d6a4: Status 404 returned error can't find the container with id e8ad7760fc250c3fa42c7326b5f70e5160dd394957b7561a4ee559804db9d6a4 May 21 16:23:20.327471 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.327383 2555 generic.go:358] "Generic (PLEG): container finished" podID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" containerID="499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd" exitCode=0 May 21 16:23:20.327471 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.327421 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7666d8b6d-brgph" event={"ID":"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f","Type":"ContainerDied","Data":"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd"} May 21 16:23:20.327471 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.327456 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7666d8b6d-brgph" May 21 16:23:20.327471 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.327468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7666d8b6d-brgph" event={"ID":"f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f","Type":"ContainerDied","Data":"09af461be569567051e958797a1fa64c17bf5b923d0df289e9cafa541f4e5737"} May 21 16:23:20.328051 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.327488 2555 scope.go:117] "RemoveContainer" containerID="499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd" May 21 16:23:20.328659 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.328632 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" event={"ID":"abf40222-8333-417b-98f7-aae4e694d22b","Type":"ContainerStarted","Data":"e8ad7760fc250c3fa42c7326b5f70e5160dd394957b7561a4ee559804db9d6a4"} May 21 16:23:20.335663 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.335646 2555 scope.go:117] "RemoveContainer" containerID="499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd" May 21 16:23:20.335944 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:23:20.335926 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd\": container with ID starting with 499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd not found: ID does not exist" containerID="499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd" May 21 16:23:20.336009 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.335952 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd"} err="failed to get container status \"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd\": rpc error: code = NotFound desc = could not find container \"499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd\": container with ID starting with 499a5f6c0b11a991abdbb3a58b912584773fc39cc0b902ed60815006d464b4cd not found: ID does not exist" May 21 16:23:20.345198 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.345173 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:20.351118 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:20.351091 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7666d8b6d-brgph"] May 21 16:23:21.334037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:21.334004 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" event={"ID":"abf40222-8333-417b-98f7-aae4e694d22b","Type":"ContainerStarted","Data":"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5"} May 21 16:23:21.334423 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:21.334137 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:21.353783 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:21.353543 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" podStartSLOduration=1.985499042 podStartE2EDuration="2.353526392s" podCreationTimestamp="2026-05-21 16:23:19 +0000 UTC" firstStartedPulling="2026-05-21 16:23:20.008669139 +0000 UTC m=+742.538576112" lastFinishedPulling="2026-05-21 16:23:20.376696471 +0000 UTC m=+742.906603462" observedRunningTime="2026-05-21 16:23:21.353143438 +0000 UTC m=+743.883050447" watchObservedRunningTime="2026-05-21 16:23:21.353526392 +0000 UTC m=+743.883433385" May 21 16:23:22.032926 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:22.032886 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" path="/var/lib/kubelet/pods/f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f/volumes" May 21 16:23:32.342740 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.342707 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:23:32.390295 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.390254 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:32.390625 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.390556 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6899dbbbdb-grw79" podUID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" containerName="manager" containerID="cri-o://809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1" gracePeriod=30 May 21 16:23:32.647852 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.647828 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:32.693343 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.693306 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txlcw\" (UniqueName: \"kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw\") pod \"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43\" (UID: \"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43\") " May 21 16:23:32.695545 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.695507 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw" (OuterVolumeSpecName: "kube-api-access-txlcw") pod "280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" (UID: "280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43"). InnerVolumeSpecName "kube-api-access-txlcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:32.794138 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:32.794086 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txlcw\" (UniqueName: \"kubernetes.io/projected/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43-kube-api-access-txlcw\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:23:33.374647 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.374585 2555 generic.go:358] "Generic (PLEG): container finished" podID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" containerID="809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1" exitCode=0 May 21 16:23:33.374647 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.374633 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6899dbbbdb-grw79" event={"ID":"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43","Type":"ContainerDied","Data":"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1"} May 21 16:23:33.375156 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.374676 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6899dbbbdb-grw79" event={"ID":"280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43","Type":"ContainerDied","Data":"02c5fc2be3fc86cd0a97b4436bdce9959078f64fe1dbfbf7d3a9ad145c0916c9"} May 21 16:23:33.375156 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.374682 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6899dbbbdb-grw79" May 21 16:23:33.375156 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.374694 2555 scope.go:117] "RemoveContainer" containerID="809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1" May 21 16:23:33.382886 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.382869 2555 scope.go:117] "RemoveContainer" containerID="809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1" May 21 16:23:33.383157 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:23:33.383139 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1\": container with ID starting with 809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1 not found: ID does not exist" containerID="809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1" May 21 16:23:33.383205 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.383167 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1"} err="failed to get container status \"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1\": rpc error: code = NotFound desc = could not find container \"809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1\": container with ID starting with 809ebc8ee8048a0612f83d7d49ec9b08d5114e532a5bb03993502182a57f0bc1 not found: ID does not exist" May 21 16:23:33.397859 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.397821 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:33.403670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:33.403638 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6899dbbbdb-grw79"] May 21 16:23:34.032891 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:34.032857 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" path="/var/lib/kubelet/pods/280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43/volumes" May 21 16:23:40.078507 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078475 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6dc66fd744-szl7l"] May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078805 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" containerName="manager" May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078816 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" containerName="manager" May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078827 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" containerName="manager" May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078832 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" containerName="manager" May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078884 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="f15d65e6-5f4c-4f5c-a2d0-be8b11a7c52f" containerName="manager" May 21 16:23:40.078911 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.078892 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="280b0bfb-9ab1-44d9-a80f-da3b2a9b0c43" containerName="manager" May 21 16:23:40.114703 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.114668 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dc66fd744-szl7l"] May 21 16:23:40.114894 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.114815 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.117777 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.117752 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 16:23:40.118237 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.118219 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4kq2g\"" May 21 16:23:40.265141 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.265092 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.265377 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.265153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sgrn\" (UniqueName: \"kubernetes.io/projected/cf50df99-4882-4ef5-95f0-7cd0208e80a2-kube-api-access-5sgrn\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.366586 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.366531 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.366799 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.366613 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sgrn\" (UniqueName: \"kubernetes.io/projected/cf50df99-4882-4ef5-95f0-7cd0208e80a2-kube-api-access-5sgrn\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.366799 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:23:40.366709 2555 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 21 16:23:40.366799 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:23:40.366788 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls podName:cf50df99-4882-4ef5-95f0-7cd0208e80a2 nodeName:}" failed. No retries permitted until 2026-05-21 16:23:40.866771014 +0000 UTC m=+763.396677986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls") pod "maas-api-6dc66fd744-szl7l" (UID: "cf50df99-4882-4ef5-95f0-7cd0208e80a2") : secret "maas-api-serving-cert" not found May 21 16:23:40.384750 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.384721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sgrn\" (UniqueName: \"kubernetes.io/projected/cf50df99-4882-4ef5-95f0-7cd0208e80a2-kube-api-access-5sgrn\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.458206 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.458166 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-s8g8p"] May 21 16:23:40.478338 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.478307 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-s8g8p"] May 21 16:23:40.478491 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.478429 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:40.481269 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.481244 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 16:23:40.481415 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.481279 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5979f\"" May 21 16:23:40.568464 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.568431 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gv8c\" (UniqueName: \"kubernetes.io/projected/0b99208a-7c12-4569-9dda-6269d4b67fe6-kube-api-access-7gv8c\") pod \"payload-processing-58b6c8fdc7-s8g8p\" (UID: \"0b99208a-7c12-4569-9dda-6269d4b67fe6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:40.669935 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.669849 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gv8c\" (UniqueName: \"kubernetes.io/projected/0b99208a-7c12-4569-9dda-6269d4b67fe6-kube-api-access-7gv8c\") pod \"payload-processing-58b6c8fdc7-s8g8p\" (UID: \"0b99208a-7c12-4569-9dda-6269d4b67fe6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:40.685663 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.685629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gv8c\" (UniqueName: \"kubernetes.io/projected/0b99208a-7c12-4569-9dda-6269d4b67fe6-kube-api-access-7gv8c\") pod \"payload-processing-58b6c8fdc7-s8g8p\" (UID: \"0b99208a-7c12-4569-9dda-6269d4b67fe6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:40.789914 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.789872 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:40.872223 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.871995 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.876917 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.876894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf50df99-4882-4ef5-95f0-7cd0208e80a2-maas-api-tls\") pod \"maas-api-6dc66fd744-szl7l\" (UID: \"cf50df99-4882-4ef5-95f0-7cd0208e80a2\") " pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:40.930744 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:40.930719 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-s8g8p"] May 21 16:23:40.932802 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:23:40.932755 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b99208a_7c12_4569_9dda_6269d4b67fe6.slice/crio-cabd81c3a58362a2e9e5ea42094052b80a87f9c3fe554bbc1c1f1e5375f18beb WatchSource:0}: Error finding container cabd81c3a58362a2e9e5ea42094052b80a87f9c3fe554bbc1c1f1e5375f18beb: Status 404 returned error can't find the container with id cabd81c3a58362a2e9e5ea42094052b80a87f9c3fe554bbc1c1f1e5375f18beb May 21 16:23:41.028674 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:41.028645 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:41.167049 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:41.167021 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dc66fd744-szl7l"] May 21 16:23:41.168531 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:23:41.168509 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf50df99_4882_4ef5_95f0_7cd0208e80a2.slice/crio-a26fa4fbcdfd1779f0e8c6a19f81069749a0ed04c64df76ee4958e075d1f4397 WatchSource:0}: Error finding container a26fa4fbcdfd1779f0e8c6a19f81069749a0ed04c64df76ee4958e075d1f4397: Status 404 returned error can't find the container with id a26fa4fbcdfd1779f0e8c6a19f81069749a0ed04c64df76ee4958e075d1f4397 May 21 16:23:41.403243 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:41.403206 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dc66fd744-szl7l" event={"ID":"cf50df99-4882-4ef5-95f0-7cd0208e80a2","Type":"ContainerStarted","Data":"a26fa4fbcdfd1779f0e8c6a19f81069749a0ed04c64df76ee4958e075d1f4397"} May 21 16:23:41.404261 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:41.404240 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" event={"ID":"0b99208a-7c12-4569-9dda-6269d4b67fe6","Type":"ContainerStarted","Data":"cabd81c3a58362a2e9e5ea42094052b80a87f9c3fe554bbc1c1f1e5375f18beb"} May 21 16:23:43.413253 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.413215 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dc66fd744-szl7l" event={"ID":"cf50df99-4882-4ef5-95f0-7cd0208e80a2","Type":"ContainerStarted","Data":"16fef5202c00eac5f62ce81bb79363ac092192045312d93d7957212e07eb03ef"} May 21 16:23:43.413736 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.413305 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:43.414673 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.414649 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" event={"ID":"0b99208a-7c12-4569-9dda-6269d4b67fe6","Type":"ContainerStarted","Data":"5d975f4c287bfabe7ab36fb4a5c2500191a075adfb06e447140eb73001e4372c"} May 21 16:23:43.414796 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.414753 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:23:43.432827 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.432787 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6dc66fd744-szl7l" podStartSLOduration=1.671314662 podStartE2EDuration="3.432774738s" podCreationTimestamp="2026-05-21 16:23:40 +0000 UTC" firstStartedPulling="2026-05-21 16:23:41.169940713 +0000 UTC m=+763.699847689" lastFinishedPulling="2026-05-21 16:23:42.931400789 +0000 UTC m=+765.461307765" observedRunningTime="2026-05-21 16:23:43.430436414 +0000 UTC m=+765.960343428" watchObservedRunningTime="2026-05-21 16:23:43.432774738 +0000 UTC m=+765.962681753" May 21 16:23:43.446947 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:43.446899 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" podStartSLOduration=1.452660602 podStartE2EDuration="3.446886892s" podCreationTimestamp="2026-05-21 16:23:40 +0000 UTC" firstStartedPulling="2026-05-21 16:23:40.934670227 +0000 UTC m=+763.464577203" lastFinishedPulling="2026-05-21 16:23:42.928896518 +0000 UTC m=+765.458803493" observedRunningTime="2026-05-21 16:23:43.446090034 +0000 UTC m=+765.975997043" watchObservedRunningTime="2026-05-21 16:23:43.446886892 +0000 UTC m=+765.976793889" May 21 16:23:49.423672 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:49.423640 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6dc66fd744-szl7l" May 21 16:23:54.420632 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:23:54.420014 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-s8g8p" May 21 16:24:01.672117 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.672073 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f"] May 21 16:24:01.677134 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.677106 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.680103 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.680069 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 16:24:01.681093 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.681073 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 16:24:01.681185 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.681121 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h7krh\"" May 21 16:24:01.681185 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.681131 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 16:24:01.684720 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.684696 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f"] May 21 16:24:01.749924 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.749887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.750092 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.749992 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwmfl\" (UniqueName: \"kubernetes.io/projected/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kube-api-access-qwmfl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.750092 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.750037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.750092 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.750053 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.750092 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.750067 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f460fb8-5b64-4cb4-ac52-df3fc480c613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.750309 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.750098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850746 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850703 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwmfl\" (UniqueName: \"kubernetes.io/projected/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kube-api-access-qwmfl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850803 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850830 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f460fb8-5b64-4cb4-ac52-df3fc480c613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.850943 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.850904 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.851302 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.851267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.851689 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.851665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.851835 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.851811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.853532 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.853505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f460fb8-5b64-4cb4-ac52-df3fc480c613-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.853982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.853962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f460fb8-5b64-4cb4-ac52-df3fc480c613-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.859980 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.859959 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwmfl\" (UniqueName: \"kubernetes.io/projected/7f460fb8-5b64-4cb4-ac52-df3fc480c613-kube-api-access-qwmfl\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f\" (UID: \"7f460fb8-5b64-4cb4-ac52-df3fc480c613\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:01.988118 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:01.988033 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:02.131848 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:02.131704 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f"] May 21 16:24:02.134811 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:24:02.134778 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f460fb8_5b64_4cb4_ac52_df3fc480c613.slice/crio-8ad4f50aef33f062c28d332ad2e5a5f8d489c4300057e7ff931d8b49a68fb850 WatchSource:0}: Error finding container 8ad4f50aef33f062c28d332ad2e5a5f8d489c4300057e7ff931d8b49a68fb850: Status 404 returned error can't find the container with id 8ad4f50aef33f062c28d332ad2e5a5f8d489c4300057e7ff931d8b49a68fb850 May 21 16:24:02.479671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:02.479633 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" event={"ID":"7f460fb8-5b64-4cb4-ac52-df3fc480c613","Type":"ContainerStarted","Data":"8ad4f50aef33f062c28d332ad2e5a5f8d489c4300057e7ff931d8b49a68fb850"} May 21 16:24:05.776381 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.776333 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72"] May 21 16:24:05.798808 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.798777 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72"] May 21 16:24:05.798995 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.798913 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.801512 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.801482 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 16:24:05.880778 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.880737 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvk9\" (UniqueName: \"kubernetes.io/projected/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kube-api-access-4tvk9\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.880953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.880795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.880953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.880864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.880953 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.880905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.881110 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.881017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.881110 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.881066 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.981960 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.981916 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982159 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.981969 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982159 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982015 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvk9\" (UniqueName: \"kubernetes.io/projected/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kube-api-access-4tvk9\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982159 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982054 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982159 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982097 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982159 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982128 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982854 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.982854 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.982799 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.983036 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.983019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.985753 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.985725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.986270 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.986250 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:05.991378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:05.991350 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvk9\" (UniqueName: \"kubernetes.io/projected/f52f9e46-8282-4ea1-ae52-50f339cdfc2c-kube-api-access-4tvk9\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72\" (UID: \"f52f9e46-8282-4ea1-ae52-50f339cdfc2c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:06.111539 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:06.111500 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:07.578303 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:07.578274 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72"] May 21 16:24:07.581510 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:24:07.581480 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52f9e46_8282_4ea1_ae52_50f339cdfc2c.slice/crio-7ba5a986f2df97ff4ef45eb283d6ab1bc2c797d286a9ee5ba145ea64abbbdfa9 WatchSource:0}: Error finding container 7ba5a986f2df97ff4ef45eb283d6ab1bc2c797d286a9ee5ba145ea64abbbdfa9: Status 404 returned error can't find the container with id 7ba5a986f2df97ff4ef45eb283d6ab1bc2c797d286a9ee5ba145ea64abbbdfa9 May 21 16:24:08.507250 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:08.507207 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" event={"ID":"f52f9e46-8282-4ea1-ae52-50f339cdfc2c","Type":"ContainerStarted","Data":"b27bb46d10cb3861e7993e3f9a8a69a55eb0ce6ae6495550d79d70e7c4f76cc7"} May 21 16:24:08.507250 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:08.507247 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" event={"ID":"f52f9e46-8282-4ea1-ae52-50f339cdfc2c","Type":"ContainerStarted","Data":"7ba5a986f2df97ff4ef45eb283d6ab1bc2c797d286a9ee5ba145ea64abbbdfa9"} May 21 16:24:08.509367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:08.509334 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" event={"ID":"7f460fb8-5b64-4cb4-ac52-df3fc480c613","Type":"ContainerStarted","Data":"4ebee26c1f6332d8fc7a143bded2b40ca706add06769780c6222cc3095399ba2"} May 21 16:24:13.542394 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:13.542306 2555 generic.go:358] "Generic (PLEG): container finished" podID="7f460fb8-5b64-4cb4-ac52-df3fc480c613" containerID="4ebee26c1f6332d8fc7a143bded2b40ca706add06769780c6222cc3095399ba2" exitCode=0 May 21 16:24:13.542394 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:13.542380 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" event={"ID":"7f460fb8-5b64-4cb4-ac52-df3fc480c613","Type":"ContainerDied","Data":"4ebee26c1f6332d8fc7a143bded2b40ca706add06769780c6222cc3095399ba2"} May 21 16:24:13.543861 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:13.543835 2555 generic.go:358] "Generic (PLEG): container finished" podID="f52f9e46-8282-4ea1-ae52-50f339cdfc2c" containerID="b27bb46d10cb3861e7993e3f9a8a69a55eb0ce6ae6495550d79d70e7c4f76cc7" exitCode=0 May 21 16:24:13.543935 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:13.543914 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" event={"ID":"f52f9e46-8282-4ea1-ae52-50f339cdfc2c","Type":"ContainerDied","Data":"b27bb46d10cb3861e7993e3f9a8a69a55eb0ce6ae6495550d79d70e7c4f76cc7"} May 21 16:24:15.553623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.553576 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" event={"ID":"7f460fb8-5b64-4cb4-ac52-df3fc480c613","Type":"ContainerStarted","Data":"8d2da3b7e618a91f77b911c74760b0d08dd0a63a2bb8767bdf02e805915f846f"} May 21 16:24:15.554058 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.553799 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:15.555311 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.555286 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" event={"ID":"f52f9e46-8282-4ea1-ae52-50f339cdfc2c","Type":"ContainerStarted","Data":"6f530edcf136ed127d144f33a074573126679dc45b550fcaa8f1d62cea70ea00"} May 21 16:24:15.555478 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.555466 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:15.573894 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.573844 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" podStartSLOduration=1.8468277899999999 podStartE2EDuration="14.573831638s" podCreationTimestamp="2026-05-21 16:24:01 +0000 UTC" firstStartedPulling="2026-05-21 16:24:02.136791919 +0000 UTC m=+784.666698890" lastFinishedPulling="2026-05-21 16:24:14.863795749 +0000 UTC m=+797.393702738" observedRunningTime="2026-05-21 16:24:15.572733658 +0000 UTC m=+798.102640678" watchObservedRunningTime="2026-05-21 16:24:15.573831638 +0000 UTC m=+798.103738632" May 21 16:24:15.593033 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:15.592983 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" podStartSLOduration=9.278429808 podStartE2EDuration="10.59296979s" podCreationTimestamp="2026-05-21 16:24:05 +0000 UTC" firstStartedPulling="2026-05-21 16:24:13.54445534 +0000 UTC m=+796.074362313" lastFinishedPulling="2026-05-21 16:24:14.858995321 +0000 UTC m=+797.388902295" observedRunningTime="2026-05-21 16:24:15.591317139 +0000 UTC m=+798.121224157" watchObservedRunningTime="2026-05-21 16:24:15.59296979 +0000 UTC m=+798.122876784" May 21 16:24:24.469810 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.469769 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4"] May 21 16:24:24.473546 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.473524 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.476285 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.476256 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 16:24:24.482983 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.482954 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4"] May 21 16:24:24.553462 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553426 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.553462 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.553706 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwg68\" (UniqueName: \"kubernetes.io/projected/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kube-api-access-rwg68\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.553706 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.553706 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.553818 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.553720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.654948 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.654908 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655139 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.654965 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655139 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.654982 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655139 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655003 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwg68\" (UniqueName: \"kubernetes.io/projected/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kube-api-access-rwg68\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655139 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655034 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655139 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655066 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655465 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655581 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.655581 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.655570 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.657544 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.657523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.657787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.657771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.664700 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.664675 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwg68\" (UniqueName: \"kubernetes.io/projected/1098f4c6-5f52-49c4-a92d-1b9e2b8ee192-kube-api-access-rwg68\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-c69x4\" (UID: \"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.784074 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.783977 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:24.939780 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:24.939754 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4"] May 21 16:24:24.941768 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:24:24.941737 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1098f4c6_5f52_49c4_a92d_1b9e2b8ee192.slice/crio-1599119e14880a679ab72019c19ac27aeb99cb299b62bbf8aea62b155a06ab7c WatchSource:0}: Error finding container 1599119e14880a679ab72019c19ac27aeb99cb299b62bbf8aea62b155a06ab7c: Status 404 returned error can't find the container with id 1599119e14880a679ab72019c19ac27aeb99cb299b62bbf8aea62b155a06ab7c May 21 16:24:25.589514 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:25.589470 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" event={"ID":"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192","Type":"ContainerStarted","Data":"21afd49327621fb1ecc8c56fdaac3f16361b47f77cc1f295688260e5cf99de72"} May 21 16:24:25.589514 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:25.589515 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" event={"ID":"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192","Type":"ContainerStarted","Data":"1599119e14880a679ab72019c19ac27aeb99cb299b62bbf8aea62b155a06ab7c"} May 21 16:24:26.571564 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:26.571536 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72" May 21 16:24:26.571775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:26.571634 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f" May 21 16:24:33.624275 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:33.624236 2555 generic.go:358] "Generic (PLEG): container finished" podID="1098f4c6-5f52-49c4-a92d-1b9e2b8ee192" containerID="21afd49327621fb1ecc8c56fdaac3f16361b47f77cc1f295688260e5cf99de72" exitCode=0 May 21 16:24:33.624666 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:33.624314 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" event={"ID":"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192","Type":"ContainerDied","Data":"21afd49327621fb1ecc8c56fdaac3f16361b47f77cc1f295688260e5cf99de72"} May 21 16:24:34.629895 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:34.629859 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" event={"ID":"1098f4c6-5f52-49c4-a92d-1b9e2b8ee192","Type":"ContainerStarted","Data":"0bbef4837f4853f2b3c4558d3716af81aad0bc34b0e041d15ce60f0482126ca3"} May 21 16:24:34.630364 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:34.630084 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:34.650615 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:34.650549 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" podStartSLOduration=10.453378897 podStartE2EDuration="10.650534169s" podCreationTimestamp="2026-05-21 16:24:24 +0000 UTC" firstStartedPulling="2026-05-21 16:24:33.6251662 +0000 UTC m=+816.155073177" lastFinishedPulling="2026-05-21 16:24:33.822321462 +0000 UTC m=+816.352228449" observedRunningTime="2026-05-21 16:24:34.64968947 +0000 UTC m=+817.179596465" watchObservedRunningTime="2026-05-21 16:24:34.650534169 +0000 UTC m=+817.180441185" May 21 16:24:38.275772 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.275730 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97"] May 21 16:24:38.363633 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.363586 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97"] May 21 16:24:38.363794 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.363732 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.367064 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.367046 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.490760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.490828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.490912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/029ae003-9097-445e-a98b-82488788d609-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.490972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.491014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-266l2\" (UniqueName: \"kubernetes.io/projected/029ae003-9097-445e-a98b-82488788d609-kube-api-access-266l2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.495344 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.491057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.591972 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.591935 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592014 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/029ae003-9097-445e-a98b-82488788d609-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592060 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592161 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592098 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-266l2\" (UniqueName: \"kubernetes.io/projected/029ae003-9097-445e-a98b-82488788d609-kube-api-access-266l2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592239 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592342 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592333 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592521 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592610 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.592720 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.592696 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.594835 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.594809 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/029ae003-9097-445e-a98b-82488788d609-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.594999 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.594981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/029ae003-9097-445e-a98b-82488788d609-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.599981 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.599958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-266l2\" (UniqueName: \"kubernetes.io/projected/029ae003-9097-445e-a98b-82488788d609-kube-api-access-266l2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97\" (UID: \"029ae003-9097-445e-a98b-82488788d609\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.673735 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.673691 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:38.824850 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:38.824786 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97"] May 21 16:24:38.828355 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:24:38.828314 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029ae003_9097_445e_a98b_82488788d609.slice/crio-601bf5a8e7a2de28e3ba6b62e49f86b4b4965a9fd9b86cfc42c0f4aac21be045 WatchSource:0}: Error finding container 601bf5a8e7a2de28e3ba6b62e49f86b4b4965a9fd9b86cfc42c0f4aac21be045: Status 404 returned error can't find the container with id 601bf5a8e7a2de28e3ba6b62e49f86b4b4965a9fd9b86cfc42c0f4aac21be045 May 21 16:24:39.653753 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:39.653717 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" event={"ID":"029ae003-9097-445e-a98b-82488788d609","Type":"ContainerStarted","Data":"3447a17cfc65840acfb2006cd8a21f4cd4c2afce7b6ac12a65e8152f17ef8325"} May 21 16:24:39.653753 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:39.653753 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" event={"ID":"029ae003-9097-445e-a98b-82488788d609","Type":"ContainerStarted","Data":"601bf5a8e7a2de28e3ba6b62e49f86b4b4965a9fd9b86cfc42c0f4aac21be045"} May 21 16:24:45.647543 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:45.647504 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-c69x4" May 21 16:24:45.677359 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:45.677325 2555 generic.go:358] "Generic (PLEG): container finished" podID="029ae003-9097-445e-a98b-82488788d609" containerID="3447a17cfc65840acfb2006cd8a21f4cd4c2afce7b6ac12a65e8152f17ef8325" exitCode=0 May 21 16:24:45.677532 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:45.677404 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" event={"ID":"029ae003-9097-445e-a98b-82488788d609","Type":"ContainerDied","Data":"3447a17cfc65840acfb2006cd8a21f4cd4c2afce7b6ac12a65e8152f17ef8325"} May 21 16:24:46.682413 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:46.682370 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" event={"ID":"029ae003-9097-445e-a98b-82488788d609","Type":"ContainerStarted","Data":"124de2d253f5833169432e71b89fd01944aa7f48f8eaba88ed267b477ebad715"} May 21 16:24:46.683383 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:46.683356 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:24:46.702151 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:46.702085 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" podStartSLOduration=8.235638319 podStartE2EDuration="8.70206829s" podCreationTimestamp="2026-05-21 16:24:38 +0000 UTC" firstStartedPulling="2026-05-21 16:24:45.678036309 +0000 UTC m=+828.207943281" lastFinishedPulling="2026-05-21 16:24:46.144466281 +0000 UTC m=+828.674373252" observedRunningTime="2026-05-21 16:24:46.702027013 +0000 UTC m=+829.231934007" watchObservedRunningTime="2026-05-21 16:24:46.70206829 +0000 UTC m=+829.231975285" May 21 16:24:57.698715 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:24:57.698686 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97" May 21 16:26:17.444766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.444728 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:26:17.447308 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.445048 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" podUID="abf40222-8333-417b-98f7-aae4e694d22b" containerName="manager" containerID="cri-o://716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5" gracePeriod=30 May 21 16:26:17.709744 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.709673 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:26:17.806023 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.805982 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x55z4\" (UniqueName: \"kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4\") pod \"abf40222-8333-417b-98f7-aae4e694d22b\" (UID: \"abf40222-8333-417b-98f7-aae4e694d22b\") " May 21 16:26:17.808239 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.808209 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4" (OuterVolumeSpecName: "kube-api-access-x55z4") pod "abf40222-8333-417b-98f7-aae4e694d22b" (UID: "abf40222-8333-417b-98f7-aae4e694d22b"). InnerVolumeSpecName "kube-api-access-x55z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:26:17.907467 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:17.907430 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x55z4\" (UniqueName: \"kubernetes.io/projected/abf40222-8333-417b-98f7-aae4e694d22b-kube-api-access-x55z4\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:26:18.021812 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.021711 2555 generic.go:358] "Generic (PLEG): container finished" podID="abf40222-8333-417b-98f7-aae4e694d22b" containerID="716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5" exitCode=0 May 21 16:26:18.021812 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.021766 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" event={"ID":"abf40222-8333-417b-98f7-aae4e694d22b","Type":"ContainerDied","Data":"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5"} May 21 16:26:18.021812 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.021788 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" May 21 16:26:18.021812 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.021799 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-67zv5" event={"ID":"abf40222-8333-417b-98f7-aae4e694d22b","Type":"ContainerDied","Data":"e8ad7760fc250c3fa42c7326b5f70e5160dd394957b7561a4ee559804db9d6a4"} May 21 16:26:18.022134 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.021818 2555 scope.go:117] "RemoveContainer" containerID="716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5" May 21 16:26:18.030972 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.030950 2555 scope.go:117] "RemoveContainer" containerID="716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5" May 21 16:26:18.031234 ip-10-0-140-222 kubenswrapper[2555]: E0521 16:26:18.031211 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5\": container with ID starting with 716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5 not found: ID does not exist" containerID="716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5" May 21 16:26:18.031301 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.031247 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5"} err="failed to get container status \"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5\": rpc error: code = NotFound desc = could not find container \"716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5\": container with ID starting with 716220b0ce13bb4020e4738437599f14a2096c58d16dc7ba2bad41924cc83dc5 not found: ID does not exist" May 21 16:26:18.044747 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.044719 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:26:18.046262 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.046241 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-67zv5"] May 21 16:26:18.806083 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.806038 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-xt9bj"] May 21 16:26:18.806582 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.806560 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf40222-8333-417b-98f7-aae4e694d22b" containerName="manager" May 21 16:26:18.806695 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.806587 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf40222-8333-417b-98f7-aae4e694d22b" containerName="manager" May 21 16:26:18.806761 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.806742 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="abf40222-8333-417b-98f7-aae4e694d22b" containerName="manager" May 21 16:26:18.809898 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.809876 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:18.812378 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.812356 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-npnq9\"" May 21 16:26:18.820426 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.820400 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-xt9bj"] May 21 16:26:18.915892 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:18.915841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svrv9\" (UniqueName: \"kubernetes.io/projected/64de0258-b6a6-4c2f-94e5-c31e185c45c6-kube-api-access-svrv9\") pod \"maas-controller-6f46df6cb6-xt9bj\" (UID: \"64de0258-b6a6-4c2f-94e5-c31e185c45c6\") " pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:19.017270 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:19.017231 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svrv9\" (UniqueName: \"kubernetes.io/projected/64de0258-b6a6-4c2f-94e5-c31e185c45c6-kube-api-access-svrv9\") pod \"maas-controller-6f46df6cb6-xt9bj\" (UID: \"64de0258-b6a6-4c2f-94e5-c31e185c45c6\") " pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:19.026289 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:19.026263 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svrv9\" (UniqueName: \"kubernetes.io/projected/64de0258-b6a6-4c2f-94e5-c31e185c45c6-kube-api-access-svrv9\") pod \"maas-controller-6f46df6cb6-xt9bj\" (UID: \"64de0258-b6a6-4c2f-94e5-c31e185c45c6\") " pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:19.123380 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:19.123325 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:19.264982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:19.264812 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f46df6cb6-xt9bj"] May 21 16:26:19.267240 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:26:19.267207 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64de0258_b6a6_4c2f_94e5_c31e185c45c6.slice/crio-163367d050eebc74c60f0863deff48f4119fae5bb49c79de813ae9e6a632ff73 WatchSource:0}: Error finding container 163367d050eebc74c60f0863deff48f4119fae5bb49c79de813ae9e6a632ff73: Status 404 returned error can't find the container with id 163367d050eebc74c60f0863deff48f4119fae5bb49c79de813ae9e6a632ff73 May 21 16:26:20.032909 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:20.032866 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf40222-8333-417b-98f7-aae4e694d22b" path="/var/lib/kubelet/pods/abf40222-8333-417b-98f7-aae4e694d22b/volumes" May 21 16:26:20.033289 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:20.033263 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" event={"ID":"64de0258-b6a6-4c2f-94e5-c31e185c45c6","Type":"ContainerStarted","Data":"2f60af2955ce54b9e7407822034ebc05eb528f8049b27168004f0e2cd94f1b31"} May 21 16:26:20.033362 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:20.033294 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" event={"ID":"64de0258-b6a6-4c2f-94e5-c31e185c45c6","Type":"ContainerStarted","Data":"163367d050eebc74c60f0863deff48f4119fae5bb49c79de813ae9e6a632ff73"} May 21 16:26:20.033362 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:20.033315 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:26:20.049503 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:20.049434 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" podStartSLOduration=1.4397628980000001 podStartE2EDuration="2.049413012s" podCreationTimestamp="2026-05-21 16:26:18 +0000 UTC" firstStartedPulling="2026-05-21 16:26:19.26858458 +0000 UTC m=+921.798491553" lastFinishedPulling="2026-05-21 16:26:19.878234691 +0000 UTC m=+922.408141667" observedRunningTime="2026-05-21 16:26:20.046940886 +0000 UTC m=+922.576847883" watchObservedRunningTime="2026-05-21 16:26:20.049413012 +0000 UTC m=+922.579320007" May 21 16:26:31.041390 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:26:31.041362 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f46df6cb6-xt9bj" May 21 16:27:58.034510 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:27:58.034481 2555 scope.go:117] "RemoveContainer" containerID="61df0f9f4b712e958033f74c63946b2bc4296cf7b26faa0931ae406de03b3569" May 21 16:36:41.352532 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:41.352495 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:36:41.353186 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:41.352760 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" podUID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" containerName="manager" containerID="cri-o://a92ad240f0837b450e8b338d511fdbd6e1f5bbadb941ccc1c2e0d4a49f5ebfe0" gracePeriod=10 May 21 16:36:42.281062 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.281022 2555 generic.go:358] "Generic (PLEG): container finished" podID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" containerID="a92ad240f0837b450e8b338d511fdbd6e1f5bbadb941ccc1c2e0d4a49f5ebfe0" exitCode=0 May 21 16:36:42.281227 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.281092 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" event={"ID":"b0c24c70-4751-41ad-b621-a2cfd77d1dcd","Type":"ContainerDied","Data":"a92ad240f0837b450e8b338d511fdbd6e1f5bbadb941ccc1c2e0d4a49f5ebfe0"} May 21 16:36:42.316518 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.316493 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:36:42.432623 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.432514 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume\") pod \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " May 21 16:36:42.433057 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.432637 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xm2d\" (UniqueName: \"kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d\") pod \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\" (UID: \"b0c24c70-4751-41ad-b621-a2cfd77d1dcd\") " May 21 16:36:42.433057 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.432878 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0c24c70-4751-41ad-b621-a2cfd77d1dcd" (UID: "b0c24c70-4751-41ad-b621-a2cfd77d1dcd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:36:42.434824 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.434795 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d" (OuterVolumeSpecName: "kube-api-access-9xm2d") pod "b0c24c70-4751-41ad-b621-a2cfd77d1dcd" (UID: "b0c24c70-4751-41ad-b621-a2cfd77d1dcd"). InnerVolumeSpecName "kube-api-access-9xm2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:36:42.533844 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.533804 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xm2d\" (UniqueName: \"kubernetes.io/projected/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-kube-api-access-9xm2d\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:36:42.533844 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:42.533834 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0c24c70-4751-41ad-b621-a2cfd77d1dcd-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" May 21 16:36:43.285839 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:43.285803 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" May 21 16:36:43.286014 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:43.285811 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj" event={"ID":"b0c24c70-4751-41ad-b621-a2cfd77d1dcd","Type":"ContainerDied","Data":"361e8e3537658b876d99c4a041b3d1a28ed1f7ef293b9c31e514306dfb96b3e9"} May 21 16:36:43.286014 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:43.285928 2555 scope.go:117] "RemoveContainer" containerID="a92ad240f0837b450e8b338d511fdbd6e1f5bbadb941ccc1c2e0d4a49f5ebfe0" May 21 16:36:43.310084 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:43.309786 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:36:43.314582 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:43.314541 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-crlfj"] May 21 16:36:44.033179 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:36:44.033142 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" path="/var/lib/kubelet/pods/b0c24c70-4751-41ad-b621-a2cfd77d1dcd/volumes" May 21 16:37:47.490925 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.490842 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn"] May 21 16:37:47.493315 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.491254 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" containerName="manager" May 21 16:37:47.493315 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.491270 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" containerName="manager" May 21 16:37:47.493315 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.491333 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0c24c70-4751-41ad-b621-a2cfd77d1dcd" containerName="manager" May 21 16:37:47.494314 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.494297 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.496919 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.496892 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 16:37:47.496919 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.496899 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsxsc\"" May 21 16:37:47.497087 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.496931 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 16:37:47.506722 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.506695 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn"] May 21 16:37:47.592671 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.592622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.592848 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.592730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bj55\" (UniqueName: \"kubernetes.io/projected/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-kube-api-access-7bj55\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.694037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.693998 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bj55\" (UniqueName: \"kubernetes.io/projected/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-kube-api-access-7bj55\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.694243 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.694090 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.694427 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.694409 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.704457 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.704424 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bj55\" (UniqueName: \"kubernetes.io/projected/ffa41e10-01c0-44d9-ad5c-7cbed0edc651-kube-api-access-7bj55\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9nvjn\" (UID: \"ffa41e10-01c0-44d9-ad5c-7cbed0edc651\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.806341 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.806251 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:47.953150 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.953119 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn"] May 21 16:37:47.955287 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:37:47.955261 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa41e10_01c0_44d9_ad5c_7cbed0edc651.slice/crio-8e7c6c04871b3b14d4ed1969a99fa277ab148b0102472ae23a874bc28e5d465c WatchSource:0}: Error finding container 8e7c6c04871b3b14d4ed1969a99fa277ab148b0102472ae23a874bc28e5d465c: Status 404 returned error can't find the container with id 8e7c6c04871b3b14d4ed1969a99fa277ab148b0102472ae23a874bc28e5d465c May 21 16:37:47.957538 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:47.957519 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:37:48.524347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:48.524314 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" event={"ID":"ffa41e10-01c0-44d9-ad5c-7cbed0edc651","Type":"ContainerStarted","Data":"e8278b8f329184cf2707b5ab7bf1af6b20e674be4c23131fa99d7dd64f1443fc"} May 21 16:37:48.524347 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:48.524350 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" event={"ID":"ffa41e10-01c0-44d9-ad5c-7cbed0edc651","Type":"ContainerStarted","Data":"8e7c6c04871b3b14d4ed1969a99fa277ab148b0102472ae23a874bc28e5d465c"} May 21 16:37:48.524817 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:48.524548 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:37:48.543769 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:48.543717 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" podStartSLOduration=1.543698956 podStartE2EDuration="1.543698956s" podCreationTimestamp="2026-05-21 16:37:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:37:48.542079492 +0000 UTC m=+1611.071986589" watchObservedRunningTime="2026-05-21 16:37:48.543698956 +0000 UTC m=+1611.073605952" May 21 16:37:59.530321 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:37:59.530288 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9nvjn" May 21 16:47:35.960769 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:35.960736 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-66wkg_c3753fba-e1d1-430c-8715-21951d807d23/manager/0.log" May 21 16:47:36.104316 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:36.104283 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dc66fd744-szl7l_cf50df99-4882-4ef5-95f0-7cd0208e80a2/maas-api/0.log" May 21 16:47:36.453608 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:36.453566 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f46df6cb6-xt9bj_64de0258-b6a6-4c2f-94e5-c31e185c45c6/manager/0.log" May 21 16:47:36.574710 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:36.574681 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xzgvn_93e02e59-cdad-420c-b5a1-9c2e75ada5c7/manager/2.log" May 21 16:47:36.818366 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:36.818283 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77666b9699-kxfgx_c41b1416-fead-44bb-aa67-7599156566fa/manager/0.log" May 21 16:47:37.081176 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:37.081105 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-p22mp_f49fcbe8-c28f-4e59-b6ee-eb60eeee5241/postgres/0.log" May 21 16:47:39.019861 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:39.019826 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9nvjn_ffa41e10-01c0-44d9-ad5c-7cbed0edc651/manager/0.log" May 21 16:47:39.773493 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:39.773467 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-476m9_927cc303-d6fc-459a-8ec8-4f98eb590f06/discovery/0.log" May 21 16:47:40.015689 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.015658 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6d59cc87-h2w2t_002a0daa-c832-4d84-be41-87a8e28be568/kube-auth-proxy/0.log" May 21 16:47:40.271481 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.271448 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-s8g8p_0b99208a-7c12-4569-9dda-6269d4b67fe6/payload-processing/0.log" May 21 16:47:40.771405 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.771371 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97_029ae003-9097-445e-a98b-82488788d609/storage-initializer/0.log" May 21 16:47:40.782680 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.782658 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4bj97_029ae003-9097-445e-a98b-82488788d609/main/0.log" May 21 16:47:40.902559 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.902526 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72_f52f9e46-8282-4ea1-ae52-50f339cdfc2c/storage-initializer/0.log" May 21 16:47:40.910523 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:40.910504 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-n4g72_f52f9e46-8282-4ea1-ae52-50f339cdfc2c/main/0.log" May 21 16:47:41.271349 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:41.271316 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f_7f460fb8-5b64-4cb4-ac52-df3fc480c613/storage-initializer/0.log" May 21 16:47:41.278634 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:41.278610 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-xgh7f_7f460fb8-5b64-4cb4-ac52-df3fc480c613/main/0.log" May 21 16:47:41.392188 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:41.392161 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-c69x4_1098f4c6-5f52-49c4-a92d-1b9e2b8ee192/storage-initializer/0.log" May 21 16:47:41.399160 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:41.399139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-c69x4_1098f4c6-5f52-49c4-a92d-1b9e2b8ee192/main/0.log" May 21 16:47:48.771994 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:48.771968 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5c6ms_277bb8be-fac0-4eec-b24e-48423f253d7c/global-pull-secret-syncer/0.log" May 21 16:47:48.898945 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:48.898916 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjzwf_ea42079d-6994-4f86-adbd-6ec471aa0228/konnectivity-agent/0.log" May 21 16:47:49.030279 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:49.030185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-222.ec2.internal_0b4d7d85952786a43a7e0615acac9d95/haproxy/0.log" May 21 16:47:53.132959 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:53.132933 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9nvjn_ffa41e10-01c0-44d9-ad5c-7cbed0edc651/manager/0.log" May 21 16:47:54.871860 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:54.871803 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-vzsg4_cf9643a4-53b1-4cbf-a662-ec25358e18a6/monitoring-plugin/0.log" May 21 16:47:55.076354 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:55.076322 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgpmv_5a5dbfb4-1138-41a3-a233-eea7c79ecdf1/node-exporter/0.log" May 21 16:47:55.100878 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:55.100839 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgpmv_5a5dbfb4-1138-41a3-a233-eea7c79ecdf1/kube-rbac-proxy/0.log" May 21 16:47:55.122070 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:55.122005 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zgpmv_5a5dbfb4-1138-41a3-a233-eea7c79ecdf1/init-textfile/0.log" May 21 16:47:56.881769 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:56.881726 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-jp8bl_8ae48aae-817a-4fb9-b908-e328a11faa14/networking-console-plugin/0.log" May 21 16:47:57.839391 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.839351 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c"] May 21 16:47:57.842903 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.842879 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.845438 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.845417 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6pf4\"/\"default-dockercfg-f74fq\"" May 21 16:47:57.845566 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.845489 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"openshift-service-ca.crt\"" May 21 16:47:57.846221 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.846207 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"kube-root-ca.crt\"" May 21 16:47:57.852266 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.852239 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c"] May 21 16:47:57.887559 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.887518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-lib-modules\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.887559 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.887560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-podres\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.887997 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.887630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-sys\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.887997 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.887673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-proc\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.887997 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.887697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs99l\" (UniqueName: \"kubernetes.io/projected/cf5cec0b-f76e-466e-bc5a-9af687899851-kube-api-access-vs99l\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.988787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988753 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-lib-modules\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.988787 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988787 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-podres\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988819 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-sys\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-proc\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988883 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs99l\" (UniqueName: \"kubernetes.io/projected/cf5cec0b-f76e-466e-bc5a-9af687899851-kube-api-access-vs99l\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988927 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-lib-modules\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-proc\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-podres\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.989037 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.988992 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5cec0b-f76e-466e-bc5a-9af687899851-sys\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:57.997924 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:57.997903 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"kube-root-ca.crt\"" May 21 16:47:58.002040 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.002023 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b4ccf7bb9-gm28f_6b3cd35a-1add-4039-9125-74a0148e3f86/console/0.log" May 21 16:47:58.007957 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.007936 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"openshift-service-ca.crt\"" May 21 16:47:58.018867 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.018843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs99l\" (UniqueName: \"kubernetes.io/projected/cf5cec0b-f76e-466e-bc5a-9af687899851-kube-api-access-vs99l\") pod \"perf-node-gather-daemonset-9tr8c\" (UID: \"cf5cec0b-f76e-466e-bc5a-9af687899851\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:58.041226 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.041187 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-k6qqw_2c5d015c-082a-4d78-9d7b-709e12ec7f37/download-server/0.log" May 21 16:47:58.156066 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.156034 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6pf4\"/\"default-dockercfg-f74fq\"" May 21 16:47:58.164288 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.164262 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:58.296304 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.296278 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c"] May 21 16:47:58.298367 ip-10-0-140-222 kubenswrapper[2555]: W0521 16:47:58.298342 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf5cec0b_f76e_466e_bc5a_9af687899851.slice/crio-c394228875efc1b50fb003926400559cc8804a192eb684a884a41ff4e7e3298b WatchSource:0}: Error finding container c394228875efc1b50fb003926400559cc8804a192eb684a884a41ff4e7e3298b: Status 404 returned error can't find the container with id c394228875efc1b50fb003926400559cc8804a192eb684a884a41ff4e7e3298b May 21 16:47:58.299982 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.299965 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:47:58.688546 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.688456 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" event={"ID":"cf5cec0b-f76e-466e-bc5a-9af687899851","Type":"ContainerStarted","Data":"488f8f11e499a703e59ebc21fc92e7c7ac020f88917db276cfb0735050e60b98"} May 21 16:47:58.688546 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.688492 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" event={"ID":"cf5cec0b-f76e-466e-bc5a-9af687899851","Type":"ContainerStarted","Data":"c394228875efc1b50fb003926400559cc8804a192eb684a884a41ff4e7e3298b"} May 21 16:47:58.688546 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.688517 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:47:58.704880 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:58.704833 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" podStartSLOduration=1.70481803 podStartE2EDuration="1.70481803s" podCreationTimestamp="2026-05-21 16:47:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:47:58.703136122 +0000 UTC m=+2221.233043133" watchObservedRunningTime="2026-05-21 16:47:58.70481803 +0000 UTC m=+2221.234725024" May 21 16:47:59.437707 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:59.437679 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vnsx_ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4/dns/0.log" May 21 16:47:59.461713 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:59.461682 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vnsx_ed0ac0e1-6c14-4dc9-b644-8136ce97a9b4/kube-rbac-proxy/0.log" May 21 16:47:59.530469 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:47:59.530440 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bj28k_d1bb26ff-8204-420e-a8b9-ef4f1df4351c/dns-node-resolver/0.log" May 21 16:48:00.104765 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:00.104733 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jg8qw_8ecc9ecc-01bd-4859-af63-919fcfa92e04/node-ca/0.log" May 21 16:48:01.084260 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:01.084226 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-476m9_927cc303-d6fc-459a-8ec8-4f98eb590f06/discovery/0.log" May 21 16:48:01.130775 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:01.130743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6d59cc87-h2w2t_002a0daa-c832-4d84-be41-87a8e28be568/kube-auth-proxy/0.log" May 21 16:48:01.250445 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:01.250398 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-s8g8p_0b99208a-7c12-4569-9dda-6269d4b67fe6/payload-processing/0.log" May 21 16:48:01.808626 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:01.808579 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5d9mz_ac1e190e-4d93-43fb-8ebc-394619d741e1/serve-healthcheck-canary/0.log" May 21 16:48:02.321844 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:02.321811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq9qz_04996518-d372-4f78-bbb0-4d035c206961/kube-rbac-proxy/0.log" May 21 16:48:02.341367 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:02.341340 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq9qz_04996518-d372-4f78-bbb0-4d035c206961/exporter/0.log" May 21 16:48:02.361817 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:02.361793 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lq9qz_04996518-d372-4f78-bbb0-4d035c206961/extractor/0.log" May 21 16:48:04.428489 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.428458 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-66wkg_c3753fba-e1d1-430c-8715-21951d807d23/manager/0.log" May 21 16:48:04.458989 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.458963 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dc66fd744-szl7l_cf50df99-4882-4ef5-95f0-7cd0208e80a2/maas-api/0.log" May 21 16:48:04.591365 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.591334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f46df6cb6-xt9bj_64de0258-b6a6-4c2f-94e5-c31e185c45c6/manager/0.log" May 21 16:48:04.617736 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.617713 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xzgvn_93e02e59-cdad-420c-b5a1-9c2e75ada5c7/manager/1.log" May 21 16:48:04.629831 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.629811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xzgvn_93e02e59-cdad-420c-b5a1-9c2e75ada5c7/manager/2.log" May 21 16:48:04.703141 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.703069 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-9tr8c" May 21 16:48:04.718431 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.718399 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77666b9699-kxfgx_c41b1416-fead-44bb-aa67-7599156566fa/manager/0.log" May 21 16:48:04.772275 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:04.772246 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-p22mp_f49fcbe8-c28f-4e59-b6ee-eb60eeee5241/postgres/0.log" May 21 16:48:12.747556 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:12.747524 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2r6bb_b5ada9b2-85c7-4b92-b428-0e5e86969b8d/kube-multus/0.log" May 21 16:48:12.964236 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:12.964211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/kube-multus-additional-cni-plugins/0.log" May 21 16:48:12.990460 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:12.990430 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/egress-router-binary-copy/0.log" May 21 16:48:13.011670 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.011582 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/cni-plugins/0.log" May 21 16:48:13.032488 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.032466 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/bond-cni-plugin/0.log" May 21 16:48:13.054454 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.054421 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/routeoverride-cni/0.log" May 21 16:48:13.075932 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.075904 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/whereabouts-cni-bincopy/0.log" May 21 16:48:13.096030 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.096000 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5t6s_6a4d7a5d-bc2b-4acd-9e4b-18761add406f/whereabouts-cni/0.log" May 21 16:48:13.476043 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.475985 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tphnz_a13c9f8c-3e4e-4f93-8257-0a221759ab83/network-metrics-daemon/0.log" May 21 16:48:13.495458 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:13.495421 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tphnz_a13c9f8c-3e4e-4f93-8257-0a221759ab83/kube-rbac-proxy/0.log" May 21 16:48:14.570800 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.570723 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/ovn-controller/0.log" May 21 16:48:14.601766 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.601736 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/ovn-acl-logging/0.log" May 21 16:48:14.629897 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.629870 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/kube-rbac-proxy-node/0.log" May 21 16:48:14.651409 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.651386 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/kube-rbac-proxy-ovn-metrics/0.log" May 21 16:48:14.673734 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.673699 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/northd/0.log" May 21 16:48:14.696541 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.696509 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/nbdb/0.log" May 21 16:48:14.719546 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.719519 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/sbdb/0.log" May 21 16:48:14.824711 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:14.824639 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7qqz6_890d57f8-f340-486d-8f77-9ceffc7549ef/ovnkube-controller/0.log" May 21 16:48:16.249179 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:16.249151 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-kbtzx_d2a5d505-134e-4548-9f98-6656f93460ab/check-endpoints/0.log" May 21 16:48:16.327425 ip-10-0-140-222 kubenswrapper[2555]: I0521 16:48:16.327392 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-m4hpp_3ff63bd6-71ac-444f-a99e-1a085671a6d9/network-check-target-container/0.log"