May 21 14:03:53.412710 ip-10-0-143-189 systemd[1]: Starting Kubernetes Kubelet... May 21 14:03:53.910987 ip-10-0-143-189 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:03:53.910987 ip-10-0-143-189 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:03:53.910987 ip-10-0-143-189 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:03:53.910987 ip-10-0-143-189 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:03:53.910987 ip-10-0-143-189 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:03:53.913969 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.913878 2549 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:03:53.918505 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918486 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:03:53.918505 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918502 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:03:53.918505 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918508 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918513 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918518 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918522 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918531 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918535 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918539 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918545 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918549 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918553 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918557 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918561 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918565 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918570 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918574 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918578 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918582 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918590 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918595 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918600 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:03:53.918696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918604 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918608 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918612 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918617 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918622 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918626 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918630 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918634 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918639 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918643 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918652 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918657 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918661 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918666 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918671 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918676 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918681 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918685 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918689 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:03:53.919303 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918693 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918699 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918703 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918713 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918716 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918720 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918725 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918729 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918733 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918738 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918743 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918747 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918751 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918756 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918761 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918769 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918774 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918780 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918787 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:03:53.919863 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918792 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918797 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918802 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918806 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918811 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918816 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918823 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918832 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918842 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918847 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918853 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918860 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918865 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918870 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918874 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918880 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918884 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918889 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918894 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:03:53.920668 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918898 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918907 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918912 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918916 2549 feature_gate.go:328] unrecognized feature gate: Example May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918921 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918925 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.918930 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920940 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920953 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920959 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920963 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920968 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920973 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920978 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920988 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920993 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.920998 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921002 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921006 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:03:53.921470 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921011 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921015 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921019 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921023 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921028 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921032 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921037 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921041 2549 feature_gate.go:328] unrecognized feature gate: Example May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921050 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921055 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921059 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921064 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921068 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921072 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921076 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921082 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921087 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921092 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921096 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921101 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:03:53.922155 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921110 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921115 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921120 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921125 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921130 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921134 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921139 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921143 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921148 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921152 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921156 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921161 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921165 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921174 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921178 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921184 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921189 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921193 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921198 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921202 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:03:53.922680 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921207 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921211 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921217 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921224 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921235 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921240 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921245 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921250 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921254 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921259 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921263 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921268 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921273 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921277 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921281 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921285 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921290 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921298 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921305 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:03:53.923171 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921311 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921319 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921324 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921328 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921333 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921354 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921359 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921364 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921368 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921372 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921381 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921385 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921390 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921395 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.921399 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921621 2549 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921643 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921816 2549 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921833 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921838 2549 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921842 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:03:53.923653 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921846 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921860 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921863 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921867 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921870 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921874 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921877 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921879 2549 flags.go:64] FLAG: --cgroup-root="" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921882 2549 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921885 2549 flags.go:64] FLAG: --client-ca-file="" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921888 2549 flags.go:64] FLAG: --cloud-config="" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921891 2549 flags.go:64] FLAG: --cloud-provider="external" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921894 2549 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921899 2549 flags.go:64] FLAG: --cluster-domain="" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921902 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921905 2549 flags.go:64] FLAG: --config-dir="" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921908 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921911 2549 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921915 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921918 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921921 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921925 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921928 2549 flags.go:64] FLAG: --contention-profiling="false" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921931 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:03:53.924178 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921934 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921937 2549 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921940 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921945 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921949 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921952 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921955 2549 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921958 2549 flags.go:64] FLAG: --enable-server="true" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921963 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921970 2549 flags.go:64] FLAG: --event-burst="100" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921973 2549 flags.go:64] FLAG: --event-qps="50" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921976 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921980 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921982 2549 flags.go:64] FLAG: --eviction-hard="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921986 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921991 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921994 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.921997 2549 flags.go:64] FLAG: --eviction-soft="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922000 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922006 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922011 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922014 2549 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922017 2549 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922022 2549 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922025 2549 flags.go:64] FLAG: --feature-gates="" May 21 14:03:53.924778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922040 2549 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922043 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922048 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922052 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922055 2549 flags.go:64] FLAG: --healthz-port="10248" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922060 2549 flags.go:64] FLAG: --help="false" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922063 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-143-189.ec2.internal" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922068 2549 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922071 2549 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922076 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922081 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922086 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922089 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922092 2549 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922095 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922098 2549 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922100 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922104 2549 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922107 2549 flags.go:64] FLAG: --kube-reserved="" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922110 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922112 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922115 2549 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922118 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922121 2549 flags.go:64] FLAG: --lock-file="" May 21 14:03:53.925406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922124 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922127 2549 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922130 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922135 2549 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922138 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922141 2549 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922144 2549 flags.go:64] FLAG: --logging-format="text" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922147 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922150 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922153 2549 flags.go:64] FLAG: --manifest-url="" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922157 2549 flags.go:64] FLAG: --manifest-url-header="" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922162 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922165 2549 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922170 2549 flags.go:64] FLAG: --max-pods="110" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922173 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922176 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922180 2549 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922183 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922186 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922189 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922192 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922201 2549 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922204 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922207 2549 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:03:53.926015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922210 2549 flags.go:64] FLAG: --pod-cidr="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922213 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922218 2549 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922221 2549 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922224 2549 flags.go:64] FLAG: --pods-per-core="0" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922227 2549 flags.go:64] FLAG: --port="10250" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922230 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922233 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b945296535bdc82c" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922236 2549 flags.go:64] FLAG: --qos-reserved="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922239 2549 flags.go:64] FLAG: --read-only-port="10255" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922243 2549 flags.go:64] FLAG: --register-node="true" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922246 2549 flags.go:64] FLAG: --register-schedulable="true" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922249 2549 flags.go:64] FLAG: --register-with-taints="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922252 2549 flags.go:64] FLAG: --registry-burst="10" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922255 2549 flags.go:64] FLAG: --registry-qps="5" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922258 2549 flags.go:64] FLAG: --reserved-cpus="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922261 2549 flags.go:64] FLAG: --reserved-memory="" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922265 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922268 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922271 2549 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922274 2549 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922277 2549 flags.go:64] FLAG: --runonce="false" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922279 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922283 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922286 2549 flags.go:64] FLAG: --seccomp-default="false" May 21 14:03:53.926639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922289 2549 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922292 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922296 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922299 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922302 2549 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922306 2549 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922309 2549 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922312 2549 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922314 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922317 2549 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922320 2549 flags.go:64] FLAG: --system-cgroups="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922323 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922329 2549 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922332 2549 flags.go:64] FLAG: --tls-cert-file="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922335 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922352 2549 flags.go:64] FLAG: --tls-min-version="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922355 2549 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922357 2549 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922360 2549 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922363 2549 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922366 2549 flags.go:64] FLAG: --v="2" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922371 2549 flags.go:64] FLAG: --version="false" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922375 2549 flags.go:64] FLAG: --vmodule="" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922379 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.922383 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:03:53.927266 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922474 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922478 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922481 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922484 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922487 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922490 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922494 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922496 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922499 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922502 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922504 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922507 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922510 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922513 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922515 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922518 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922521 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922523 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922526 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922529 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:03:53.927910 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922531 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922534 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922537 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922539 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922542 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922544 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922547 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922549 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922552 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922555 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922557 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922560 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922564 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922566 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922571 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922574 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922577 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922580 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922583 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922586 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:03:53.928455 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922588 2549 feature_gate.go:328] unrecognized feature gate: Example May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922591 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922594 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922597 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922600 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922603 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922605 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922608 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922610 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922613 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922616 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922618 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922621 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922623 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922626 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922629 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922631 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922634 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922636 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:03:53.928954 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922639 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922641 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922644 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922646 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922649 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922653 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922657 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922661 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922663 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922666 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922669 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922671 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922674 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922676 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922679 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922681 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922684 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922687 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922690 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922693 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:03:53.929425 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922696 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922699 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922702 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922704 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922707 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922709 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.922712 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.923427 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.929668 2549 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.929684 2549 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929729 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929734 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929737 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929740 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929743 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929746 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:03:53.929913 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929749 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929751 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929754 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929757 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929759 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929762 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929765 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929767 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929770 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929773 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929775 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929778 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929782 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929787 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929790 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929793 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929796 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929799 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929803 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:03:53.930354 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929805 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929808 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929810 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929813 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929815 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929818 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929822 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929825 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929828 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929831 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929834 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929836 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929839 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929843 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929847 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929850 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929853 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929856 2549 feature_gate.go:328] unrecognized feature gate: Example May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929859 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929862 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:03:53.930821 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929864 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929867 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929869 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929872 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929875 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929877 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929880 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929882 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929885 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929887 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929891 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929894 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929896 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929899 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929901 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929904 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929907 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929909 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929913 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929916 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:03:53.931313 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929919 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929922 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929925 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929927 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929930 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929932 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929935 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929938 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929940 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929943 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929946 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929948 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929951 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929953 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929956 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929958 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929961 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929964 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929966 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929969 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:03:53.931827 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.929971 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.929976 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930071 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930076 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930079 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930081 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930084 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930087 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930089 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930092 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930094 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930098 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930101 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930103 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930106 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930108 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:03:53.932307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930111 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930114 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930116 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930119 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930123 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930126 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930130 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930133 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930137 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930140 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930143 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930146 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930149 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930152 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930154 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930157 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930160 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930163 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930166 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:03:53.932707 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930168 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930171 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930174 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930176 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930179 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930181 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930184 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930187 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930190 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930193 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930196 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930198 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930201 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930204 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930206 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930209 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930211 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930214 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930216 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:03:53.933169 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930219 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930222 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930224 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930227 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930230 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930233 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930235 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930238 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930240 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930243 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930246 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930249 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930251 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930253 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930256 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930259 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930262 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930264 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930267 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930269 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:03:53.933642 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930272 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930274 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930277 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930280 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930282 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930285 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930287 2549 feature_gate.go:328] unrecognized feature gate: Example May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930290 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930292 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930295 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930297 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930300 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930302 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:53.930305 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.930310 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:03:53.934142 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.931018 2549 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:03:53.934537 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.933030 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:03:53.934656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.934645 2549 server.go:1019] "Starting client certificate rotation" May 21 14:03:53.934758 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.934742 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:03:53.935688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.935676 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:03:53.960543 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.960524 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:03:53.962327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.962313 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:03:53.980660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.980638 2549 log.go:25] "Validated CRI v1 runtime API" May 21 14:03:53.986381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.986367 2549 log.go:25] "Validated CRI v1 image API" May 21 14:03:53.989703 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.989691 2549 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:03:53.995311 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.994149 2549 fs.go:135] Filesystem UUIDs: map[26e9d2f3-9760-48a8-8498-5a38c33e76c9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 caaf59ab-ea4d-48ee-80f1-e2f2ba6d2dbf:/dev/nvme0n1p4] May 21 14:03:53.995311 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.994395 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:03:53.995847 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.995590 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:03:53.999727 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:53.999619 2549 manager.go:217] Machine: {Timestamp:2026-05-21 14:03:53.999129841 +0000 UTC m=+0.451443342 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100725 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260321ea6dd8d7dfe8d3b8f56dce59 SystemUUID:ec260321-ea6d-d8d7-dfe8-d3b8f56dce59 BootID:6a20ed39-866d-451d-8e6c-93375347f423 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:af:d6:5d:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:af:d6:5d:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:ca:96:62:32:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:03:54.000480 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.000469 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:03:54.000561 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.000550 2549 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:03:54.001792 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.001771 2549 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:03:54.001919 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.001792 2549 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:03:54.001996 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.001927 2549 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:03:54.001996 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.001936 2549 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:03:54.001996 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.001942 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:03:54.002812 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.002799 2549 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:03:54.004369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.004356 2549 state_mem.go:36] "Initialized new in-memory state store" May 21 14:03:54.004470 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.004460 2549 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:03:54.007033 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.007024 2549 kubelet.go:491] "Attempting to sync node with API server" May 21 14:03:54.007077 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.007037 2549 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:03:54.007077 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.007049 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:03:54.007077 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.007057 2549 kubelet.go:397] "Adding apiserver pod source" May 21 14:03:54.007077 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.007065 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:03:54.008191 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.008179 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:03:54.008240 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.008197 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:03:54.011374 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.011360 2549 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:03:54.013165 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.013152 2549 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:03:54.015240 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015228 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015246 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015253 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015259 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015269 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015278 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015286 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015292 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015299 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:03:54.015301 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015305 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:03:54.015549 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015319 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:03:54.015549 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.015325 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:03:54.016303 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.016292 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:03:54.016357 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.016308 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:03:54.019004 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.018987 2549 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:03:54.019004 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.018989 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:03:54.019004 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.018995 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:03:54.019601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.019589 2549 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:03:54.019635 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.019629 2549 server.go:1295] "Started kubelet" May 21 14:03:54.019683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.019663 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:03:54.019804 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.019757 2549 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:03:54.019875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.019831 2549 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:03:54.020298 ip-10-0-143-189 systemd[1]: Started Kubernetes Kubelet. May 21 14:03:54.021039 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.020992 2549 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:03:54.022412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.022398 2549 server.go:317] "Adding debug handlers to kubelet server" May 21 14:03:54.027551 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.027524 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:03:54.028755 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.028739 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:03:54.028865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.028852 2549 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:03:54.028934 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.028868 2549 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:03:54.028985 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.028940 2549 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:03:54.029059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.029048 2549 reconstruct.go:97] "Volume reconstruction finished" May 21 14:03:54.029107 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.029061 2549 reconciler.go:26] "Reconciler: start to sync state" May 21 14:03:54.031865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.031809 2549 factory.go:55] Registering systemd factory May 21 14:03:54.031865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.031848 2549 factory.go:223] Registration of the systemd container factory successfully May 21 14:03:54.032039 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.031813 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.032481 2549 factory.go:153] Registering CRI-O factory May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.032498 2549 factory.go:223] Registration of the crio container factory successfully May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.032549 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.032568 2549 factory.go:103] Registering Raw factory May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.032591 2549 manager.go:1196] Started watching for new ooms in manager May 21 14:03:54.032780 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.032651 2549 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:03:54.033265 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.033248 2549 manager.go:319] Starting recovery of all containers May 21 14:03:54.038113 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.037971 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 14:03:54.038113 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.037975 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 14:03:54.038262 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.038206 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s2kqs" May 21 14:03:54.039297 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.038057 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-189.ec2.internal.18b1999e8bee7dc9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-189.ec2.internal,UID:ip-10-0-143-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-189.ec2.internal,},FirstTimestamp:2026-05-21 14:03:54.019601865 +0000 UTC m=+0.471915365,LastTimestamp:2026-05-21 14:03:54.019601865 +0000 UTC m=+0.471915365,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-189.ec2.internal,}" May 21 14:03:54.044035 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.043886 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s2kqs" May 21 14:03:54.045447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.045416 2549 manager.go:324] Recovery completed May 21 14:03:54.049622 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.049608 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.052248 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052235 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.052306 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052266 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.052306 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052275 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.052730 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052716 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:03:54.052730 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052726 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:03:54.052822 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.052739 2549 state_mem.go:36] "Initialized new in-memory state store" May 21 14:03:54.054213 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.054154 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-189.ec2.internal.18b1999e8de0a469 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-189.ec2.internal,UID:ip-10-0-143-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-189.ec2.internal,},FirstTimestamp:2026-05-21 14:03:54.052248681 +0000 UTC m=+0.504562182,LastTimestamp:2026-05-21 14:03:54.052248681 +0000 UTC m=+0.504562182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-189.ec2.internal,}" May 21 14:03:54.055560 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.055540 2549 policy_none.go:49] "None policy: Start" May 21 14:03:54.055560 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.055562 2549 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:03:54.055656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.055576 2549 state_mem.go:35] "Initializing new in-memory state store" May 21 14:03:54.091923 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.091910 2549 manager.go:341] "Starting Device Plugin manager" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.091938 2549 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.091948 2549 server.go:85] "Starting device plugin registration server" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.092211 2549 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.092223 2549 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.092318 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.092410 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.092420 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.092895 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:03:54.097917 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.092928 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.169538 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.169485 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:03:54.170672 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.170657 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:03:54.170751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.170680 2549 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:03:54.170751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.170702 2549 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:03:54.170751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.170711 2549 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:03:54.170885 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.170754 2549 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:03:54.174318 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.174303 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:03:54.193105 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.193081 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.193844 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.193828 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.193925 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.193857 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.193925 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.193872 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.193925 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.193898 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-189.ec2.internal" May 21 14:03:54.202623 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.202608 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-189.ec2.internal" May 21 14:03:54.202672 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.202646 2549 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-189.ec2.internal\": node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.216261 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.216241 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.271913 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.271893 2549 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"] May 21 14:03:54.271982 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.271949 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.273090 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.273076 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.273168 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.273103 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.273168 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.273113 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.274556 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.274536 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.274725 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.274711 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.274784 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.274745 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.280700 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280682 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.280795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280714 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.280795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280729 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.280873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280808 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.280873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280829 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.280873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.280854 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.281985 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.281970 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:54.282039 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.282012 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:03:54.282717 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.282700 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory" May 21 14:03:54.282782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.282731 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:03:54.282782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.282745 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID" May 21 14:03:54.316750 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.316729 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.322925 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.322909 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-189.ec2.internal\" not found" node="ip-10-0-143-189.ec2.internal" May 21 14:03:54.326440 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.326425 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-189.ec2.internal\" not found" node="ip-10-0-143-189.ec2.internal" May 21 14:03:54.330592 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.330569 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.330663 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.330602 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.330663 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.330621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4112976232576c5a9014be7a6a9c4a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"ac4112976232576c5a9014be7a6a9c4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:54.417259 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.417237 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.431577 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431519 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.431577 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431547 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.431577 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431563 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4112976232576c5a9014be7a6a9c4a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"ac4112976232576c5a9014be7a6a9c4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:54.431785 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431612 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac4112976232576c5a9014be7a6a9c4a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"ac4112976232576c5a9014be7a6a9c4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:54.431785 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431620 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.431785 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.431632 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0183d7f35a9bc9964072ef55d317b57c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"0183d7f35a9bc9964072ef55d317b57c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.517911 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.517880 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.618383 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.618332 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.625433 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.625416 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:54.629202 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.629184 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:54.719153 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.719087 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.819580 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.819553 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.920037 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:54.920012 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:54.934423 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.934405 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:03:54.934559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:54.934543 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:03:55.020160 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:55.020106 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:55.028150 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.028133 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:03:55.042806 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.042790 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:03:55.045851 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.045826 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 13:58:54 +0000 UTC" deadline="2027-11-08 11:41:38.052819714 +0000 UTC" May 21 14:03:55.045851 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.045849 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12861h37m43.006973346s" May 21 14:03:55.067244 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.067226 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-scb8t" May 21 14:03:55.075938 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.075918 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-scb8t" May 21 14:03:55.120475 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:55.120445 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:55.149652 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:55.149620 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4112976232576c5a9014be7a6a9c4a.slice/crio-b24e2c25210f5abdebf8c9974c4afd61696b6faa8023f4fece456e9570fbd5d7 WatchSource:0}: Error finding container b24e2c25210f5abdebf8c9974c4afd61696b6faa8023f4fece456e9570fbd5d7: Status 404 returned error can't find the container with id b24e2c25210f5abdebf8c9974c4afd61696b6faa8023f4fece456e9570fbd5d7 May 21 14:03:55.149826 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:55.149811 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0183d7f35a9bc9964072ef55d317b57c.slice/crio-51ba710ad762fdbbd8db62019cc025cb40e6542c29827ec0958565f3c3d76a39 WatchSource:0}: Error finding container 51ba710ad762fdbbd8db62019cc025cb40e6542c29827ec0958565f3c3d76a39: Status 404 returned error can't find the container with id 51ba710ad762fdbbd8db62019cc025cb40e6542c29827ec0958565f3c3d76a39 May 21 14:03:55.153892 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.153866 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:03:55.173902 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.173846 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" event={"ID":"ac4112976232576c5a9014be7a6a9c4a","Type":"ContainerStarted","Data":"b24e2c25210f5abdebf8c9974c4afd61696b6faa8023f4fece456e9570fbd5d7"} May 21 14:03:55.174756 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.174737 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"0183d7f35a9bc9964072ef55d317b57c","Type":"ContainerStarted","Data":"51ba710ad762fdbbd8db62019cc025cb40e6542c29827ec0958565f3c3d76a39"} May 21 14:03:55.220903 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:55.220884 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:55.321409 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:55.321335 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:55.421797 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:55.421776 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found" May 21 14:03:55.433308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.433289 2549 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:03:55.527506 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.527487 2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:03:55.529392 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.529378 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" May 21 14:03:55.540801 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.540784 2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:03:55.543120 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.543105 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:03:55.544116 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.544104 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" May 21 14:03:55.550865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:55.550854 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:03:56.008420 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.008385 2549 apiserver.go:52] "Watching apiserver" May 21 14:03:56.016658 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.016632 2549 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:03:56.017097 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.017067 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-lbdtg","openshift-multus/multus-pgmp6","openshift-multus/network-metrics-daemon-fdpbx","openshift-network-diagnostics/network-check-target-nrd2m","kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7","openshift-cluster-node-tuning-operator/tuned-kd4bt","openshift-image-registry/node-ca-6jnlc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-24z8l","openshift-network-operator/iptables-alerter-z8p6s","openshift-ovn-kubernetes/ovnkube-node-6n977","kube-system/konnectivity-agent-4bpt8"] May 21 14:03:56.018540 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.018519 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.021062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.020875 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:03:56.021062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.020879 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:03:56.021062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.020977 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mm79k\"" May 21 14:03:56.021291 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.021271 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgmp6" May 21 14:03:56.023907 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.023434 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.023907 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.023532 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:03:56.023907 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.023739 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:56.023907 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.023817 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:03:56.023907 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.023843 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:03:56.025365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.024628 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-96t66\"" May 21 14:03:56.025365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.024942 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:03:56.025365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.025139 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:03:56.025365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.025361 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:03:56.026876 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.026857 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.027476 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.027454 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.028876 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.028775 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.029267 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.029249 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:03:56.029489 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.029468 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:03:56.030437 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030305 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:03:56.030525 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030510 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-clp6k\"" May 21 14:03:56.030564 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030533 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j7zv5\"" May 21 14:03:56.030608 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030568 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:03:56.030608 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030531 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:03:56.030987 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.030969 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:03:56.031193 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.031177 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztb55\"" May 21 14:03:56.031410 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.031394 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:03:56.031783 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.031761 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.032480 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.031932 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.032480 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.032203 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:03:56.033409 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.033389 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.034396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034245 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:03:56.034396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034313 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:03:56.034396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034362 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:03:56.034396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034313 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:03:56.034644 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034465 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:03:56.034719 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.034705 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.035106 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.035087 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9rfn8\"" May 21 14:03:56.035175 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.035115 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wb9fk\"" May 21 14:03:56.036305 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036288 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:03:56.036638 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036367 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036476 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2fsk\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036501 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036537 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.036539 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.037031 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.037176 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4q685\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.037181 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:03:56.037195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.037188 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040157 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-system-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hl7\" (UniqueName: \"kubernetes.io/projected/426dfaa0-fbb1-4ebc-849f-00efd86eb480-kube-api-access-v9hl7\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040240 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-daemon-config\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040263 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-os-release\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040288 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c1944f-0919-4765-8643-dfc19df42810-tmp-dir\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysconfig\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040335 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040401 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040422 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-socket-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040450 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-systemd\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040484 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-tuned\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040511 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-cni-binary-copy\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040534 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-socket-dir-parent\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040574 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-bin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040625 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cnibin\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040653 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02c1944f-0919-4765-8643-dfc19df42810-hosts-file\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040694 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-lib-modules\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-host\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-cnibin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040762 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040787 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qm2f\" (UniqueName: \"kubernetes.io/projected/02c1944f-0919-4765-8643-dfc19df42810-kube-api-access-5qm2f\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.040869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-tmp\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2tx4\" (UniqueName: \"kubernetes.io/projected/88b118b8-3ea0-4082-92e8-08e85779fb7d-kube-api-access-j2tx4\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-os-release\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-k8s-cni-cncf-io\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4mr\" (UniqueName: \"kubernetes.io/projected/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kube-api-access-fr4mr\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/426dfaa0-fbb1-4ebc-849f-00efd86eb480-host\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-netns\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.040983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/426dfaa0-fbb1-4ebc-849f-00efd86eb480-serviceca\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-sys\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041029 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-var-lib-kubelet\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041053 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh4bm\" (UniqueName: \"kubernetes.io/projected/524d6a26-388d-49e0-88e7-fdefe217d79e-kube-api-access-vh4bm\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041076 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-system-cni-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041105 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256zl\" (UniqueName: \"kubernetes.io/projected/a6f70967-1f54-4e26-9d3e-7054f61a16e5-kube-api-access-256zl\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-conf-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041221 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041256 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.041656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041315 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-multus-certs\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041381 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-multus\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041480 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-hostroot\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041512 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-device-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041542 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-sys-fs\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041563 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-kubernetes\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041589 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-conf\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041610 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-modprobe-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041631 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-run\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041666 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-kubelet\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-etc-kubernetes\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041737 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjp4h\" (UniqueName: \"kubernetes.io/projected/ea332b5e-87f3-42b5-a260-1b87a27af6b8-kube-api-access-fjp4h\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.042381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.041794 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-registration-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.076670 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.076593 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 13:58:55 +0000 UTC" deadline="2027-11-05 18:48:31.63782159 +0000 UTC" May 21 14:03:56.076670 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.076619 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12796h44m35.561205135s" May 21 14:03:56.130626 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.130592 2549 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:03:56.142023 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142001 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c1944f-0919-4765-8643-dfc19df42810-tmp-dir\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.142126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142037 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysconfig\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142061 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142087 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.142126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142113 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142138 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-socket-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142161 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-systemd\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142185 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-tuned\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142208 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-cni-binary-copy\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142234 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-socket-dir-parent\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142259 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142287 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-systemd-units\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142311 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-agent-certs\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142334 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-bin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.142369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142334 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02c1944f-0919-4765-8643-dfc19df42810-tmp-dir\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142376 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cnibin\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-slash\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142467 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02c1944f-0919-4765-8643-dfc19df42810-hosts-file\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142491 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-lib-modules\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142515 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-host\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142539 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-cnibin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142565 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142590 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qm2f\" (UniqueName: \"kubernetes.io/projected/02c1944f-0919-4765-8643-dfc19df42810-kube-api-access-5qm2f\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142616 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-tmp\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142641 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2tx4\" (UniqueName: \"kubernetes.io/projected/88b118b8-3ea0-4082-92e8-08e85779fb7d-kube-api-access-j2tx4\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142670 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-os-release\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142690 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:03:56.142845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142740 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-k8s-cni-cncf-io\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143062 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02c1944f-0919-4765-8643-dfc19df42810-hosts-file\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143092 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-socket-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143118 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143128 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-socket-dir-parent\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143171 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cnibin\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143194 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-bin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.143201 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143207 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysconfig\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143258 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-cni-binary-copy\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143291 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143318 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.142695 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-k8s-cni-cncf-io\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.143381 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:56.64333466 +0000 UTC m=+3.095648150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143407 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-netns\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143416 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-host\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-var-lib-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.143508 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143449 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-ovn\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143467 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4mr\" (UniqueName: \"kubernetes.io/projected/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kube-api-access-fr4mr\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143487 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/426dfaa0-fbb1-4ebc-849f-00efd86eb480-host\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143510 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-netns\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143534 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-netd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143558 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d559b3b6-a134-4e79-b36e-1306db610a88-ovn-node-metrics-cert\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143608 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/426dfaa0-fbb1-4ebc-849f-00efd86eb480-serviceca\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-lib-modules\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143620 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/426dfaa0-fbb1-4ebc-849f-00efd86eb480-host\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143628 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143632 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-sys\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143673 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-var-lib-kubelet\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143699 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh4bm\" (UniqueName: \"kubernetes.io/projected/524d6a26-388d-49e0-88e7-fdefe217d79e-kube-api-access-vh4bm\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143734 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-system-cni-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143737 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-sys\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143749 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-var-lib-kubelet\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.144205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143783 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-system-cni-dir\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143803 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-cnibin\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143820 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-os-release\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143846 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-systemd\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143849 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-netns\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143853 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-256zl\" (UniqueName: \"kubernetes.io/projected/a6f70967-1f54-4e26-9d3e-7054f61a16e5-kube-api-access-256zl\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143891 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-conf-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143919 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143965 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-conf-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143988 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.143990 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144030 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-multus-certs\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144037 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144070 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/426dfaa0-fbb1-4ebc-849f-00efd86eb480-serviceca\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144059 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144087 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-run-multus-certs\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144112 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:56.145059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144142 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-iptables-alerter-script\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-host-slash\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-node-log\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144220 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-script-lib\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144247 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-multus\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144285 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-hostroot\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144296 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-cni-multus\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-systemd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144378 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-hostroot\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144379 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-log-socket\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144422 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc2ng\" (UniqueName: \"kubernetes.io/projected/d559b3b6-a134-4e79-b36e-1306db610a88-kube-api-access-xc2ng\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144448 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-etc-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144499 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-device-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144539 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-device-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144565 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6f70967-1f54-4e26-9d3e-7054f61a16e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144568 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-sys-fs\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.145859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144614 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-sys-fs\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144618 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-kubernetes\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144648 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-conf\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144658 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-kubernetes\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144676 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-kubelet\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144700 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-env-overrides\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144727 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-konnectivity-ca\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144761 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-modprobe-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144772 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-sysctl-conf\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144786 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-run\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144825 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-kubelet\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144856 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-modprobe-d\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144871 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-host-var-lib-kubelet\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144882 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88b118b8-3ea0-4082-92e8-08e85779fb7d-run\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144906 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-etc-kubernetes\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144947 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjp4h\" (UniqueName: \"kubernetes.io/projected/ea332b5e-87f3-42b5-a260-1b87a27af6b8-kube-api-access-fjp4h\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144980 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-bin\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.146660 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.144992 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-etc-kubernetes\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145008 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-registration-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145043 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-system-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145074 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145111 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hl7\" (UniqueName: \"kubernetes.io/projected/426dfaa0-fbb1-4ebc-849f-00efd86eb480-kube-api-access-v9hl7\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145121 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-registration-dir\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145134 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-daemon-config\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145157 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-os-release\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145184 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdxb\" (UniqueName: \"kubernetes.io/projected/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-kube-api-access-5wdxb\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145205 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145209 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-config\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145296 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d6a26-388d-49e0-88e7-fdefe217d79e-system-cni-dir\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6f70967-1f54-4e26-9d3e-7054f61a16e5-os-release\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.145643 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d6a26-388d-49e0-88e7-fdefe217d79e-multus-daemon-config\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.146701 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-etc-tuned\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.147459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.146875 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88b118b8-3ea0-4082-92e8-08e85779fb7d-tmp\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.156307 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.156287 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:03:56.156427 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.156311 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:03:56.156427 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.156324 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:56.156427 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.156408 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:56.656389666 +0000 UTC m=+3.108703167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:56.157098 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.157073 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2tx4\" (UniqueName: \"kubernetes.io/projected/88b118b8-3ea0-4082-92e8-08e85779fb7d-kube-api-access-j2tx4\") pod \"tuned-kd4bt\" (UID: \"88b118b8-3ea0-4082-92e8-08e85779fb7d\") " pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.159384 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.159160 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh4bm\" (UniqueName: \"kubernetes.io/projected/524d6a26-388d-49e0-88e7-fdefe217d79e-kube-api-access-vh4bm\") pod \"multus-pgmp6\" (UID: \"524d6a26-388d-49e0-88e7-fdefe217d79e\") " pod="openshift-multus/multus-pgmp6" May 21 14:03:56.159384 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.159326 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qm2f\" (UniqueName: \"kubernetes.io/projected/02c1944f-0919-4765-8643-dfc19df42810-kube-api-access-5qm2f\") pod \"node-resolver-lbdtg\" (UID: \"02c1944f-0919-4765-8643-dfc19df42810\") " pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.159529 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.159393 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256zl\" (UniqueName: \"kubernetes.io/projected/a6f70967-1f54-4e26-9d3e-7054f61a16e5-kube-api-access-256zl\") pod \"multus-additional-cni-plugins-24z8l\" (UID: \"a6f70967-1f54-4e26-9d3e-7054f61a16e5\") " pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.160333 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.160288 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjp4h\" (UniqueName: \"kubernetes.io/projected/ea332b5e-87f3-42b5-a260-1b87a27af6b8-kube-api-access-fjp4h\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.160482 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.160439 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hl7\" (UniqueName: \"kubernetes.io/projected/426dfaa0-fbb1-4ebc-849f-00efd86eb480-kube-api-access-v9hl7\") pod \"node-ca-6jnlc\" (UID: \"426dfaa0-fbb1-4ebc-849f-00efd86eb480\") " pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.161405 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.161228 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4mr\" (UniqueName: \"kubernetes.io/projected/e140eec5-25f3-44cd-8f8e-00f56c98a8fa-kube-api-access-fr4mr\") pod \"aws-ebs-csi-driver-node-xqrs7\" (UID: \"e140eec5-25f3-44cd-8f8e-00f56c98a8fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.245550 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245520 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-iptables-alerter-script\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.245688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245557 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-host-slash\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.245688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245578 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-node-log\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245593 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-script-lib\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245634 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-systemd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245672 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-log-socket\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245700 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xc2ng\" (UniqueName: \"kubernetes.io/projected/d559b3b6-a134-4e79-b36e-1306db610a88-kube-api-access-xc2ng\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245747 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-etc-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245758 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-systemd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245796 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245810 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-etc-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245816 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-kubelet\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245835 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-env-overrides\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-node-log\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245874 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-konnectivity-ca\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245891 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-host-slash\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.245915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245899 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-bin\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245932 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdxb\" (UniqueName: \"kubernetes.io/projected/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-kube-api-access-5wdxb\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245951 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-config\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245984 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-systemd-units\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.245998 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-agent-certs\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246020 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-slash\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246045 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246073 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-netns\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246095 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-var-lib-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246120 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-iptables-alerter-script\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246167 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-systemd-units\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246188 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246216 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-script-lib\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246235 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-kubelet\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246276 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-bin\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246358 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246380 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-slash\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246411 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-run-netns\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246443 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-var-lib-openvswitch\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246449 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-ovn\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246121 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-run-ovn\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246497 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-netd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246522 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246549 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d559b3b6-a134-4e79-b36e-1306db610a88-ovn-node-metrics-cert\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246568 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-ovnkube-config\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246587 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-host-cni-netd\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246651 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d559b3b6-a134-4e79-b36e-1306db610a88-env-overrides\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.246957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.246661 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d559b3b6-a134-4e79-b36e-1306db610a88-log-socket\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.247655 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.247081 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-konnectivity-ca\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.248739 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.248721 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9777a5e6-ec1f-4994-bf7e-b04d4bae250c-agent-certs\") pod \"konnectivity-agent-4bpt8\" (UID: \"9777a5e6-ec1f-4994-bf7e-b04d4bae250c\") " pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.248857 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.248812 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d559b3b6-a134-4e79-b36e-1306db610a88-ovn-node-metrics-cert\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.254286 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.254264 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdxb\" (UniqueName: \"kubernetes.io/projected/eb2da72f-4adf-423d-b33d-cd3bb1e76a52-kube-api-access-5wdxb\") pod \"iptables-alerter-z8p6s\" (UID: \"eb2da72f-4adf-423d-b33d-cd3bb1e76a52\") " pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.254478 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.254460 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc2ng\" (UniqueName: \"kubernetes.io/projected/d559b3b6-a134-4e79-b36e-1306db610a88-kube-api-access-xc2ng\") pod \"ovnkube-node-6n977\" (UID: \"d559b3b6-a134-4e79-b36e-1306db610a88\") " pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.341475 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.341406 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" May 21 14:03:56.348193 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.348170 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgmp6" May 21 14:03:56.356782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.356763 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" May 21 14:03:56.363266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.363248 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbdtg" May 21 14:03:56.372806 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.372787 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jnlc" May 21 14:03:56.379351 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.379315 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24z8l" May 21 14:03:56.388917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.388899 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8p6s" May 21 14:03:56.396439 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.396422 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:03:56.401917 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.401900 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:03:56.508299 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.508267 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:03:56.649243 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.649166 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:56.649385 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.649362 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:56.649458 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.649445 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:57.649423935 +0000 UTC m=+4.101737437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:56.749840 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:56.749794 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:56.749999 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.749910 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:03:56.749999 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.749924 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:03:56.749999 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.749933 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:56.749999 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:56.749979 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:57.749966504 +0000 UTC m=+4.202279990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:56.950970 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.950934 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b118b8_3ea0_4082_92e8_08e85779fb7d.slice/crio-08dd72edca1044c00363631509b1d19aab1cfc97b06ac08a9df7f9a4150d7d02 WatchSource:0}: Error finding container 08dd72edca1044c00363631509b1d19aab1cfc97b06ac08a9df7f9a4150d7d02: Status 404 returned error can't find the container with id 08dd72edca1044c00363631509b1d19aab1cfc97b06ac08a9df7f9a4150d7d02 May 21 14:03:56.952219 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.952204 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode140eec5_25f3_44cd_8f8e_00f56c98a8fa.slice/crio-17a35dc006a89c7308407e23ba0cba61f09bee95af4899ee63aa5a252f7a250d WatchSource:0}: Error finding container 17a35dc006a89c7308407e23ba0cba61f09bee95af4899ee63aa5a252f7a250d: Status 404 returned error can't find the container with id 17a35dc006a89c7308407e23ba0cba61f09bee95af4899ee63aa5a252f7a250d May 21 14:03:56.954090 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.954052 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd559b3b6_a134_4e79_b36e_1306db610a88.slice/crio-3b3e180df94861195b753b0cda1bb12efaf84c48f008a90091ffd7500da93101 WatchSource:0}: Error finding container 3b3e180df94861195b753b0cda1bb12efaf84c48f008a90091ffd7500da93101: Status 404 returned error can't find the container with id 3b3e180df94861195b753b0cda1bb12efaf84c48f008a90091ffd7500da93101 May 21 14:03:56.956759 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.956709 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9777a5e6_ec1f_4994_bf7e_b04d4bae250c.slice/crio-6ff2583dc3658c422707c8e1a95774c135b4683c3ec74476c1e242eecf38502e WatchSource:0}: Error finding container 6ff2583dc3658c422707c8e1a95774c135b4683c3ec74476c1e242eecf38502e: Status 404 returned error can't find the container with id 6ff2583dc3658c422707c8e1a95774c135b4683c3ec74476c1e242eecf38502e May 21 14:03:56.957623 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.957517 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2da72f_4adf_423d_b33d_cd3bb1e76a52.slice/crio-1ad8026ae0af965d1403fe9ad1cd869853ffbdaa64b8ae45ead562fd521eeeca WatchSource:0}: Error finding container 1ad8026ae0af965d1403fe9ad1cd869853ffbdaa64b8ae45ead562fd521eeeca: Status 404 returned error can't find the container with id 1ad8026ae0af965d1403fe9ad1cd869853ffbdaa64b8ae45ead562fd521eeeca May 21 14:03:56.958249 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:03:56.958207 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524d6a26_388d_49e0_88e7_fdefe217d79e.slice/crio-546b32e4b150cd529680abc5a442877beaec7ba0b141be8932ab5529fdab0530 WatchSource:0}: Error finding container 546b32e4b150cd529680abc5a442877beaec7ba0b141be8932ab5529fdab0530: Status 404 returned error can't find the container with id 546b32e4b150cd529680abc5a442877beaec7ba0b141be8932ab5529fdab0530 May 21 14:03:57.077950 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.077780 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 13:58:55 +0000 UTC" deadline="2028-01-26 04:28:24.628485755 +0000 UTC" May 21 14:03:57.077950 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.077947 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14750h24m27.550542642s" May 21 14:03:57.171598 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.171567 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:57.171764 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.171577 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:57.171764 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.171696 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:03:57.171864 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.171774 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:03:57.178801 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.178779 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" event={"ID":"e140eec5-25f3-44cd-8f8e-00f56c98a8fa","Type":"ContainerStarted","Data":"17a35dc006a89c7308407e23ba0cba61f09bee95af4899ee63aa5a252f7a250d"} May 21 14:03:57.180516 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.180448 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" event={"ID":"ac4112976232576c5a9014be7a6a9c4a","Type":"ContainerStarted","Data":"a4756a5518824493d6f0043c0640b56e54a3c019bc9418d4b612af773887b49c"} May 21 14:03:57.181477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.181434 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerStarted","Data":"155bd659c22e738a210bfdf2fbb451cc31e07945431b0b9f1b46bb4cd4c424a5"} May 21 14:03:57.182659 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.182638 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgmp6" event={"ID":"524d6a26-388d-49e0-88e7-fdefe217d79e","Type":"ContainerStarted","Data":"546b32e4b150cd529680abc5a442877beaec7ba0b141be8932ab5529fdab0530"} May 21 14:03:57.183722 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.183698 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" event={"ID":"88b118b8-3ea0-4082-92e8-08e85779fb7d","Type":"ContainerStarted","Data":"08dd72edca1044c00363631509b1d19aab1cfc97b06ac08a9df7f9a4150d7d02"} May 21 14:03:57.184686 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.184665 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbdtg" event={"ID":"02c1944f-0919-4765-8643-dfc19df42810","Type":"ContainerStarted","Data":"4fc205ef4ed203d379a1b8e7812b50172b5235ef4678bd8dc52e3d6bb28dd314"} May 21 14:03:57.185734 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.185713 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jnlc" event={"ID":"426dfaa0-fbb1-4ebc-849f-00efd86eb480","Type":"ContainerStarted","Data":"5d8522ac37d32978c38360717dc16b16656786886555b54cc116adc011c02830"} May 21 14:03:57.187681 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.187653 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8p6s" event={"ID":"eb2da72f-4adf-423d-b33d-cd3bb1e76a52","Type":"ContainerStarted","Data":"1ad8026ae0af965d1403fe9ad1cd869853ffbdaa64b8ae45ead562fd521eeeca"} May 21 14:03:57.189845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.189762 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4bpt8" event={"ID":"9777a5e6-ec1f-4994-bf7e-b04d4bae250c","Type":"ContainerStarted","Data":"6ff2583dc3658c422707c8e1a95774c135b4683c3ec74476c1e242eecf38502e"} May 21 14:03:57.191240 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.191222 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"3b3e180df94861195b753b0cda1bb12efaf84c48f008a90091ffd7500da93101"} May 21 14:03:57.195585 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.193840 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" podStartSLOduration=2.193364069 podStartE2EDuration="2.193364069s" podCreationTimestamp="2026-05-21 14:03:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:03:57.193265889 +0000 UTC m=+3.645579398" watchObservedRunningTime="2026-05-21 14:03:57.193364069 +0000 UTC m=+3.645677576" May 21 14:03:57.659396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.658764 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:57.659396 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.658919 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:57.659396 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.658981 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:59.658961524 +0000 UTC m=+6.111275025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:57.760285 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:57.759622 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:57.760285 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.759792 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:03:57.760285 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.759812 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:03:57.760285 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.759824 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:57.760285 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:57.759882 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:03:59.759862866 +0000 UTC m=+6.212176582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:58.219305 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:58.219159 2549 generic.go:358] "Generic (PLEG): container finished" podID="0183d7f35a9bc9964072ef55d317b57c" containerID="7d7f7fd5cd50e17b0b995d88860921021cfcd49e860ce291a47e4c7576030c96" exitCode=0 May 21 14:03:58.220304 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:58.220149 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"0183d7f35a9bc9964072ef55d317b57c","Type":"ContainerDied","Data":"7d7f7fd5cd50e17b0b995d88860921021cfcd49e860ce291a47e4c7576030c96"} May 21 14:03:59.173364 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.172687 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:59.173364 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.172816 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:03:59.173364 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.172912 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:59.173364 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.172993 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:03:59.237282 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.237053 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"0183d7f35a9bc9964072ef55d317b57c","Type":"ContainerStarted","Data":"0deec7b9631dba83e1f31176f77ccd7fa6e45f878d8bf671355219b82c3f34da"} May 21 14:03:59.252233 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.252184 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" podStartSLOduration=4.252166651 podStartE2EDuration="4.252166651s" podCreationTimestamp="2026-05-21 14:03:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:03:59.251550078 +0000 UTC m=+5.703863589" watchObservedRunningTime="2026-05-21 14:03:59.252166651 +0000 UTC m=+5.704480161" May 21 14:03:59.675935 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.675418 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:03:59.675935 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.675562 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:59.675935 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.675616 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:03.675599441 +0000 UTC m=+10.127912946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:03:59.776537 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:03:59.776503 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:03:59.777173 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.776714 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:03:59.777173 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.776736 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:03:59.777173 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.776749 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:03:59.777173 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:03:59.776802 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:03.776785138 +0000 UTC m=+10.229098656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:01.171206 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:01.171166 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:01.171678 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:01.171312 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:01.171757 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:01.171184 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:01.171853 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:01.171830 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:03.171455 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:03.171420 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:03.171907 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:03.171557 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:03.171907 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.171551 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:03.171907 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.171644 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:03.709776 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:03.709743 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:03.709979 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.709867 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:03.709979 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.709931 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:11.709913301 +0000 UTC m=+18.162226787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:03.810185 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:03.810149 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:03.810374 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.810352 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:03.810434 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.810384 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:03.810434 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.810397 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:03.810564 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:03.810460 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:11.810441102 +0000 UTC m=+18.262754594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:05.171617 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:05.171578 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:05.172052 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:05.171714 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:05.172052 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:05.171573 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:05.172052 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:05.171842 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:07.171871 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:07.171793 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:07.172258 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:07.171917 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:07.172258 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:07.171978 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:07.172258 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:07.172075 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:09.111536 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.111497 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kxtsg"] May 21 14:04:09.114596 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.114575 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.114711 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.114658 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:09.170880 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.170857 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:09.171004 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.170857 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:09.171004 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.170967 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:09.171111 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.171038 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:09.252103 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.252072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.252273 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.252160 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-kubelet-config\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.252273 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.252230 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-dbus\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.353425 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-kubelet-config\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353628 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.353476 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-dbus\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353628 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.353512 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-kubelet-config\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353628 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.353522 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353751 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.353666 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:09.353751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.353693 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/848e94cd-29f4-44de-b724-678e50be6c28-dbus\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.353751 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.353747 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:09.853726794 +0000 UTC m=+16.306040282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:09.857589 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:09.857557 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:09.857784 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.857746 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:09.857854 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:09.857820 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:10.857800031 +0000 UTC m=+17.310113518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:10.865392 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:10.865358 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:10.865803 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:10.865530 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:10.865803 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:10.865594 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:12.865576765 +0000 UTC m=+19.317890257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:11.171221 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:11.171134 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:11.171221 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:11.171166 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:11.171470 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.171245 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:11.171470 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:11.171134 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:11.171470 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.171377 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:11.171617 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.171476 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:11.773145 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:11.773108 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:11.773295 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.773240 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:11.773336 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.773302 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:27.773283976 +0000 UTC m=+34.225597477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:11.873496 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:11.873460 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:11.873897 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.873608 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:11.873897 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.873631 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:11.873897 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.873643 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:11.873897 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:11.873702 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:27.873686209 +0000 UTC m=+34.325999696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:12.880281 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:12.880205 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:12.880720 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:12.880373 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:12.880720 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:12.880454 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:16.880437726 +0000 UTC m=+23.332751214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:13.171521 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:13.171438 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:13.171644 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:13.171561 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:13.171644 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:13.171572 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:13.171740 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:13.171675 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:13.171740 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:13.171728 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:13.171812 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:13.171787 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:15.172103 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.171899 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:15.172521 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.171931 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:15.172521 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:15.172214 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:15.172521 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.171952 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:15.172521 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:15.172249 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:15.172521 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:15.172334 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:15.263334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.263305 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jnlc" event={"ID":"426dfaa0-fbb1-4ebc-849f-00efd86eb480","Type":"ContainerStarted","Data":"91dedb6e223a2037e9fbd75ea3cc5aa2010c80da8a06b0473e080ea5ca699448"} May 21 14:04:15.264878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.264852 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4bpt8" event={"ID":"9777a5e6-ec1f-4994-bf7e-b04d4bae250c","Type":"ContainerStarted","Data":"a1b913443f50d67912f7b514d1d70fa188d5bc652aabe578090340ffbd3b28bd"} May 21 14:04:15.267124 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.267106 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:04:15.267491 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.267463 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"60e4d4085d846508e18dbb0d26ef5cf12ebf8826950454a001fdaf28675172b1"} May 21 14:04:15.267561 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.267494 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"9f8f08530207f264577a9da0835e24ec96076b3944b4051d67ce75569fc36df7"} May 21 14:04:15.269040 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.268997 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" event={"ID":"e140eec5-25f3-44cd-8f8e-00f56c98a8fa","Type":"ContainerStarted","Data":"3254e333c69257652ef74cbcbb903d6004b8c93bf134add13f66b71a43bafe67"} May 21 14:04:15.270590 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.270562 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerStarted","Data":"59c5b2868c1f89b23f383ce1efea20c6cc32a3b1c0c9fd7e439d597926c87adb"} May 21 14:04:15.271920 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.271895 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgmp6" event={"ID":"524d6a26-388d-49e0-88e7-fdefe217d79e","Type":"ContainerStarted","Data":"2af309e89488888bc6e0d9938b4eff59e19f6253d086fb2968e1024ccb5d8d9f"} May 21 14:04:15.273489 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.273437 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" event={"ID":"88b118b8-3ea0-4082-92e8-08e85779fb7d","Type":"ContainerStarted","Data":"b01ac8522ffd1d0c9bb093d5b0ecb015e9f75c862e36d1063e470a9bdab0e9f6"} May 21 14:04:15.275107 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.275089 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbdtg" event={"ID":"02c1944f-0919-4765-8643-dfc19df42810","Type":"ContainerStarted","Data":"5a05b4d49581f3ddecfcfe30208dc0ad055442028b54c4b1e2392748d580e5d7"} May 21 14:04:15.297923 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.297887 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4bpt8" podStartSLOduration=7.333077155 podStartE2EDuration="21.297876054s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.95850263 +0000 UTC m=+3.410816117" lastFinishedPulling="2026-05-21 14:04:10.923301522 +0000 UTC m=+17.375615016" observedRunningTime="2026-05-21 14:04:15.281525131 +0000 UTC m=+21.733838693" watchObservedRunningTime="2026-05-21 14:04:15.297876054 +0000 UTC m=+21.750189572" May 21 14:04:15.318263 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.318223 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6jnlc" podStartSLOduration=3.481319644 podStartE2EDuration="21.3182104s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.96206635 +0000 UTC m=+3.414379838" lastFinishedPulling="2026-05-21 14:04:14.798957104 +0000 UTC m=+21.251270594" observedRunningTime="2026-05-21 14:04:15.297862345 +0000 UTC m=+21.750175854" watchObservedRunningTime="2026-05-21 14:04:15.3182104 +0000 UTC m=+21.770523911" May 21 14:04:15.346232 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.346040 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kd4bt" podStartSLOduration=3.49975553 podStartE2EDuration="21.346020657s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.952685033 +0000 UTC m=+3.404998519" lastFinishedPulling="2026-05-21 14:04:14.798950143 +0000 UTC m=+21.251263646" observedRunningTime="2026-05-21 14:04:15.34505429 +0000 UTC m=+21.797367792" watchObservedRunningTime="2026-05-21 14:04:15.346020657 +0000 UTC m=+21.798334168" May 21 14:04:15.361332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:15.361294 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pgmp6" podStartSLOduration=3.440714548 podStartE2EDuration="21.361277811s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.959838232 +0000 UTC m=+3.412151723" lastFinishedPulling="2026-05-21 14:04:14.880401492 +0000 UTC m=+21.332714986" observedRunningTime="2026-05-21 14:04:15.360943858 +0000 UTC m=+21.813257368" watchObservedRunningTime="2026-05-21 14:04:15.361277811 +0000 UTC m=+21.813591319" May 21 14:04:16.279940 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.279916 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280229 2549 generic.go:358] "Generic (PLEG): container finished" podID="d559b3b6-a134-4e79-b36e-1306db610a88" containerID="60e4d4085d846508e18dbb0d26ef5cf12ebf8826950454a001fdaf28675172b1" exitCode=1 May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280297 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerDied","Data":"60e4d4085d846508e18dbb0d26ef5cf12ebf8826950454a001fdaf28675172b1"} May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280388 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"85b049ce7688fd649b9a3265cc4488624fabf241f2207dee7bcd72c52ebf855d"} May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280408 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"d0435187644d0750f5be797b52f36115c6037940a5c683a153d0ea1777cbf6f9"} May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280421 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"46ee3caef80aecb13a91ec234e4d4435d167ada8cbe069d7352f26a822acb899"} May 21 14:04:16.280610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.280429 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"66c00b3504af180b4b9cc7af9f553cce1720dcd496e49685e6adb0661ff79757"} May 21 14:04:16.281906 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.281883 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" event={"ID":"e140eec5-25f3-44cd-8f8e-00f56c98a8fa","Type":"ContainerStarted","Data":"da6b1ca00223570d769f5cc7c9fa5d05299bafc91b06cccf5cadffe6b381bb00"} May 21 14:04:16.283263 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.283242 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="59c5b2868c1f89b23f383ce1efea20c6cc32a3b1c0c9fd7e439d597926c87adb" exitCode=0 May 21 14:04:16.283455 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.283407 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"59c5b2868c1f89b23f383ce1efea20c6cc32a3b1c0c9fd7e439d597926c87adb"} May 21 14:04:16.346878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.346830 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:04:16.914848 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:16.914810 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:16.915030 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:16.914968 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:16.915092 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:16.915039 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:24.915024515 +0000 UTC m=+31.367338002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:17.107149 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.107057 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:04:16.34684631Z","UUID":"a5369558-152d-4141-95ed-408419f92b50","Handler":null,"Name":"","Endpoint":""} May 21 14:04:17.108802 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.108777 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:04:17.108802 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.108808 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:04:17.171239 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.171161 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:17.171239 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.171192 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:17.171439 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:17.171267 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:17.171439 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.171302 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:17.171439 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:17.171389 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:17.171598 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:17.171455 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:17.286681 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.286650 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8p6s" event={"ID":"eb2da72f-4adf-423d-b33d-cd3bb1e76a52","Type":"ContainerStarted","Data":"e58a64f8295cddbd21d7c41c23fd095246ac888318cd0501046f7c2f4c7652bc"} May 21 14:04:17.333106 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.333067 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lbdtg" podStartSLOduration=5.856923593 podStartE2EDuration="23.333053068s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.963955723 +0000 UTC m=+3.416269212" lastFinishedPulling="2026-05-21 14:04:14.440085186 +0000 UTC m=+20.892398687" observedRunningTime="2026-05-21 14:04:15.38422287 +0000 UTC m=+21.836536379" watchObservedRunningTime="2026-05-21 14:04:17.333053068 +0000 UTC m=+23.785366577" May 21 14:04:17.393903 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.393869 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:04:17.394554 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.394535 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:04:17.414448 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.414407 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z8p6s" podStartSLOduration=5.604090715 podStartE2EDuration="23.414394853s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.959463831 +0000 UTC m=+3.411777318" lastFinishedPulling="2026-05-21 14:04:14.76976797 +0000 UTC m=+21.222081456" observedRunningTime="2026-05-21 14:04:17.332895135 +0000 UTC m=+23.785208645" watchObservedRunningTime="2026-05-21 14:04:17.414394853 +0000 UTC m=+23.866708361" May 21 14:04:17.718059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.718031 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:04:17.718637 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:17.718565 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4bpt8" May 21 14:04:18.291292 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:18.291136 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:04:18.291712 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:18.291617 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"ee30cedf1d356792245d4e1650cb4f4821ad203f21333f6a5b1a1143ac76bfc1"} May 21 14:04:18.293167 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:18.293135 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" event={"ID":"e140eec5-25f3-44cd-8f8e-00f56c98a8fa","Type":"ContainerStarted","Data":"c70132d4b47ae3deb79155d74423cb2dd2dc4706b9edb9e3228d5a176ca6076c"} May 21 14:04:18.315886 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:18.315845 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqrs7" podStartSLOduration=4.0390433550000004 podStartE2EDuration="24.315833383s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.954281316 +0000 UTC m=+3.406594816" lastFinishedPulling="2026-05-21 14:04:17.231071353 +0000 UTC m=+23.683384844" observedRunningTime="2026-05-21 14:04:18.315539413 +0000 UTC m=+24.767852925" watchObservedRunningTime="2026-05-21 14:04:18.315833383 +0000 UTC m=+24.768146891" May 21 14:04:19.171374 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:19.171330 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:19.171580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:19.171330 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:19.171580 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:19.171470 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:19.171580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:19.171330 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:19.171580 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:19.171557 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:19.171795 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:19.171634 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:21.171757 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.171585 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:21.172454 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.171591 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:21.172454 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:21.171829 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:21.172454 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.171599 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:21.172454 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:21.171913 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:21.172454 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:21.171985 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:21.299705 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.299668 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="49bef0dd5c1c6507eefd583ee852246660bde72ab8cf10165ea6e2e2b8e4785d" exitCode=0 May 21 14:04:21.299880 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.299755 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"49bef0dd5c1c6507eefd583ee852246660bde72ab8cf10165ea6e2e2b8e4785d"} May 21 14:04:21.302903 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.302889 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:04:21.303189 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.303169 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"b4126fb9be57ab4c5bffbffc14ea20356fa2f3a0fcdd172b5430984ed300c14d"} May 21 14:04:21.303442 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.303428 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:21.303658 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.303644 2549 scope.go:117] "RemoveContainer" containerID="60e4d4085d846508e18dbb0d26ef5cf12ebf8826950454a001fdaf28675172b1" May 21 14:04:21.319325 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:21.319307 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:22.308003 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.307976 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:04:22.308468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.308282 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" event={"ID":"d559b3b6-a134-4e79-b36e-1306db610a88","Type":"ContainerStarted","Data":"ae42bdeaa84e9e48156ed576788a487bddeaca085f7c40d3c44ee60a5a719430"} May 21 14:04:22.308468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.308423 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:04:22.308689 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.308671 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:22.323443 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.323418 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:22.337677 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.337640 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" podStartSLOduration=10.446846992 podStartE2EDuration="28.337627201s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.955902293 +0000 UTC m=+3.408215784" lastFinishedPulling="2026-05-21 14:04:14.846682506 +0000 UTC m=+21.298995993" observedRunningTime="2026-05-21 14:04:22.335993712 +0000 UTC m=+28.788307221" watchObservedRunningTime="2026-05-21 14:04:22.337627201 +0000 UTC m=+28.789940710" May 21 14:04:22.371758 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.371733 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxtsg"] May 21 14:04:22.371881 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.371840 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:22.371927 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:22.371915 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:22.374956 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.374934 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdpbx"] May 21 14:04:22.375073 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.375045 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:22.375182 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:22.375159 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:22.375784 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.375761 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrd2m"] May 21 14:04:22.375873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:22.375859 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:22.375967 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:22.375945 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:23.311998 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:23.311961 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="7a5e95952e35746d2b8d68a80262529cb6593abb13345eea2b82925ca12a1247" exitCode=0 May 21 14:04:23.312410 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:23.312050 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"7a5e95952e35746d2b8d68a80262529cb6593abb13345eea2b82925ca12a1247"} May 21 14:04:23.312410 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:23.312161 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:04:24.174296 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.174231 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:24.174432 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.174232 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:24.174432 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.174231 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:24.174432 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:24.174423 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:24.174533 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:24.174497 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:24.174533 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:24.174318 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:24.313758 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.313735 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 14:04:24.978607 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.978433 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:24.978793 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:24.978568 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:04:24.978793 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:24.978684 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret podName:848e94cd-29f4-44de-b724-678e50be6c28 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:40.978665213 +0000 UTC m=+47.430978702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret") pod "global-pull-secret-syncer-kxtsg" (UID: "848e94cd-29f4-44de-b724-678e50be6c28") : object "kube-system"/"original-pull-secret" not registered May 21 14:04:24.997822 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:24.997797 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:25.320562 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:25.320530 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="9805b99430378c046efc5b8ae53b092c6cecb13f1b78c6a0e9856530b59af4da" exitCode=0 May 21 14:04:25.320948 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:25.320616 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"9805b99430378c046efc5b8ae53b092c6cecb13f1b78c6a0e9856530b59af4da"} May 21 14:04:25.336550 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:25.336515 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" podUID="d559b3b6-a134-4e79-b36e-1306db610a88" containerName="ovnkube-controller" probeResult="failure" output="" May 21 14:04:26.174504 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:26.174474 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:26.174504 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:26.174493 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:26.174737 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:26.174580 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxtsg" podUID="848e94cd-29f4-44de-b724-678e50be6c28" May 21 14:04:26.174737 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:26.174600 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:26.174737 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:26.174703 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:04:26.174889 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:26.174851 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrd2m" podUID="38baed31-922b-4282-881c-62bca60c3a82" May 21 14:04:27.797885 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.797815 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:27.798415 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.797931 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:27.798415 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.797982 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:59.797967264 +0000 UTC m=+66.250280763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:04:27.893712 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.893688 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeReady" May 21 14:04:27.893850 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.893825 2549 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:04:27.899012 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.898991 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:27.899164 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.899150 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:04:27.899219 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.899168 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:04:27.899219 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.899177 2549 projected.go:194] Error preparing data for projected volume kube-api-access-4xc2s for pod openshift-network-diagnostics/network-check-target-nrd2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:27.899288 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:27.899223 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s podName:38baed31-922b-4282-881c-62bca60c3a82 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:59.899206575 +0000 UTC m=+66.351520079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4xc2s" (UniqueName: "kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s") pod "network-check-target-nrd2m" (UID: "38baed31-922b-4282-881c-62bca60c3a82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:04:27.935489 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.935460 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77df66cc9b-hwdfr"] May 21 14:04:27.957317 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.957295 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77df66cc9b-hwdfr"] May 21 14:04:27.957476 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.957324 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8rm2"] May 21 14:04:27.957532 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.957474 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:27.960822 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.960631 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-shx8g\"" May 21 14:04:27.960938 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.960885 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:04:27.961475 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.961147 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:04:27.961475 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.961246 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:04:27.966532 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.966489 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:04:27.977868 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.977845 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fswvs"] May 21 14:04:27.978023 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.978002 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8rm2" May 21 14:04:27.980688 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.980635 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:04:27.980815 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.980797 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v7ff7\"" May 21 14:04:27.980908 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.980891 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:04:27.992142 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.992124 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8rm2"] May 21 14:04:27.992142 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.992144 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fswvs"] May 21 14:04:27.992266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.992226 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:27.994748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.994731 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:04:27.995020 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.995005 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:04:27.995115 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.995100 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:04:27.995411 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:27.995368 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8szvz\"" May 21 14:04:28.100672 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100636 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-config-volume\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.100818 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100675 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.100818 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100706 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxhx\" (UniqueName: \"kubernetes.io/projected/02500ec9-9b90-4e4d-8409-415f4ee0894f-kube-api-access-knxhx\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.100818 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.100818 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcn9\" (UniqueName: \"kubernetes.io/projected/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-kube-api-access-5kcn9\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.100971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100814 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.100971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.100971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.101103 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.100999 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.101103 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.101015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.101103 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.101094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-tmp-dir\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.101252 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.101127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.101252 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.101161 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.101252 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.101194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8bnw\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.173516 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.173494 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:28.173651 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.173494 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:28.173697 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.173494 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:28.176336 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176317 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:04:28.176469 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176357 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:04:28.176469 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176401 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2rcd\"" May 21 14:04:28.176567 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176514 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:04:28.176617 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176590 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgr2\"" May 21 14:04:28.176669 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.176625 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:04:28.201773 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.201755 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-tmp-dir\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.201858 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.201783 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.201858 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.201803 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.201944 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.201927 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8bnw\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202006 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.201988 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-config-volume\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.202044 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202021 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.202091 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202057 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knxhx\" (UniqueName: \"kubernetes.io/projected/02500ec9-9b90-4e4d-8409-415f4ee0894f-kube-api-access-knxhx\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.202143 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202087 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202143 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202088 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-tmp-dir\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.202143 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202122 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcn9\" (UniqueName: \"kubernetes.io/projected/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-kube-api-access-5kcn9\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.202279 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202154 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202279 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202157 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:28.202279 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202176 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.202279 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202204 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202279 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202218 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:28.702198141 +0000 UTC m=+35.154511653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202295 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202326 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202435 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202438 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202453 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:28.202547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202522 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:28.202820 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202529 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:28.70251076 +0000 UTC m=+35.154824265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:28.202820 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.202589 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:28.702574485 +0000 UTC m=+35.154887979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:28.202820 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202611 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-config-volume\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.203018 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.202993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.203610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.203590 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.205960 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.205943 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.206036 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.205977 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.211308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.211280 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.211624 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.211602 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxhx\" (UniqueName: \"kubernetes.io/projected/02500ec9-9b90-4e4d-8409-415f4ee0894f-kube-api-access-knxhx\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.211742 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.211722 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcn9\" (UniqueName: \"kubernetes.io/projected/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-kube-api-access-5kcn9\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.211795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.211753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8bnw\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.708237 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.708205 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.708257 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:28.708282 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708370 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708417 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708443 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:29.708422545 +0000 UTC m=+36.160736036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708443 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708464 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:28.708486 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708468 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:29.708451269 +0000 UTC m=+36.160764760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:28.708808 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:28.708527 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:29.70851103 +0000 UTC m=+36.160824520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:29.716098 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:29.716060 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:29.716138 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:29.716168 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716175 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716237 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:31.716218558 +0000 UTC m=+38.168532065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716277 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716300 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716319 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:31.716307272 +0000 UTC m=+38.168620764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716324 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:29.716845 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:29.716399 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:31.716381536 +0000 UTC m=+38.168695028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:31.733894 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:31.733851 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:31.733908 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.733992 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734000 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:31.734019 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734064 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:35.734048606 +0000 UTC m=+42.186362110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734082 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734004 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734121 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:35.734106678 +0000 UTC m=+42.186420167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:31.734460 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:31.734154 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:35.734136138 +0000 UTC m=+42.186449640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:32.335312 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:32.335284 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="d56513078333bfd209f63e2da993ad01c1f0cb76a0f68dba9da5c0cbf9875509" exitCode=0 May 21 14:04:32.335480 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:32.335324 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"d56513078333bfd209f63e2da993ad01c1f0cb76a0f68dba9da5c0cbf9875509"} May 21 14:04:33.339846 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:33.339809 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6f70967-1f54-4e26-9d3e-7054f61a16e5" containerID="48f9a8fea258d552270205ea0482c2cd2b94c1c4558dd357299387b84325fa64" exitCode=0 May 21 14:04:33.340206 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:33.339864 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerDied","Data":"48f9a8fea258d552270205ea0482c2cd2b94c1c4558dd357299387b84325fa64"} May 21 14:04:34.344472 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:34.344432 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24z8l" event={"ID":"a6f70967-1f54-4e26-9d3e-7054f61a16e5","Type":"ContainerStarted","Data":"4039d9f381662327f570fb618d0d0cee83a0dd1e2bd469782808096e2b599fed"} May 21 14:04:34.368123 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:34.368078 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-24z8l" podStartSLOduration=5.777061528 podStartE2EDuration="40.368066644s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:03:56.963859502 +0000 UTC m=+3.416172989" lastFinishedPulling="2026-05-21 14:04:31.554864615 +0000 UTC m=+38.007178105" observedRunningTime="2026-05-21 14:04:34.367745532 +0000 UTC m=+40.820059040" watchObservedRunningTime="2026-05-21 14:04:34.368066644 +0000 UTC m=+40.820380152" May 21 14:04:35.764466 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:35.764412 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:35.764466 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:35.764464 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:35.764518 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764578 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764604 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764640 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764640 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764673 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:43.764653027 +0000 UTC m=+50.216966535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764690 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:43.764681371 +0000 UTC m=+50.216994862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:35.764886 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:35.764703 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:43.764695751 +0000 UTC m=+50.217009238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:40.996944 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:40.996906 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:40.999384 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:40.999360 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/848e94cd-29f4-44de-b724-678e50be6c28-original-pull-secret\") pod \"global-pull-secret-syncer-kxtsg\" (UID: \"848e94cd-29f4-44de-b724-678e50be6c28\") " pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:41.087681 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:41.087606 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxtsg" May 21 14:04:41.257429 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:41.257395 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxtsg"] May 21 14:04:41.266873 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:04:41.266840 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848e94cd_29f4_44de_b724_678e50be6c28.slice/crio-74e06d4e41ddd1cc3165f68d5dcab56d1ec9870e85b47081d1c2e2512e2b17a8 WatchSource:0}: Error finding container 74e06d4e41ddd1cc3165f68d5dcab56d1ec9870e85b47081d1c2e2512e2b17a8: Status 404 returned error can't find the container with id 74e06d4e41ddd1cc3165f68d5dcab56d1ec9870e85b47081d1c2e2512e2b17a8 May 21 14:04:41.356969 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:41.356890 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxtsg" event={"ID":"848e94cd-29f4-44de-b724-678e50be6c28","Type":"ContainerStarted","Data":"74e06d4e41ddd1cc3165f68d5dcab56d1ec9870e85b47081d1c2e2512e2b17a8"} May 21 14:04:43.818848 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:43.818814 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:43.818848 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:43.818849 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:43.818898 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.818957 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.818977 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.818990 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.819010 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.819028 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:04:59.819013918 +0000 UTC m=+66.271327405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.819041 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:59.819035342 +0000 UTC m=+66.271348828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:43.819271 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:43.819050 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:04:59.819045787 +0000 UTC m=+66.271359275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:47.369704 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:47.369667 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxtsg" event={"ID":"848e94cd-29f4-44de-b724-678e50be6c28","Type":"ContainerStarted","Data":"c3235e1fd774ba4a885d4e3e3134b6c3df9f89825f9e10d17153166ada68bcbf"} May 21 14:04:47.386061 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:47.386015 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kxtsg" podStartSLOduration=33.359371579 podStartE2EDuration="38.386000778s" podCreationTimestamp="2026-05-21 14:04:09 +0000 UTC" firstStartedPulling="2026-05-21 14:04:41.268482487 +0000 UTC m=+47.720795974" lastFinishedPulling="2026-05-21 14:04:46.295111683 +0000 UTC m=+52.747425173" observedRunningTime="2026-05-21 14:04:47.385305699 +0000 UTC m=+53.837619208" watchObservedRunningTime="2026-05-21 14:04:47.386000778 +0000 UTC m=+53.838314287" May 21 14:04:55.330436 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:55.330404 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6n977" May 21 14:04:59.832308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.832270 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:04:59.832308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.832307 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.832352 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.832370 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832453 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832476 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832532 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:05:31.832517712 +0000 UTC m=+98.284831199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832451 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832459 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832557 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:05:31.832551486 +0000 UTC m=+98.284864973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:04:59.832747 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.832620 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:05:31.83260354 +0000 UTC m=+98.284917030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:04:59.835336 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.835322 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:04:59.843232 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.843220 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:04:59.843276 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:04:59.843259 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:03.843248719 +0000 UTC m=+130.295562209 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : secret "metrics-daemon-secret" not found May 21 14:04:59.933077 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.933055 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:59.936048 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.936033 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:04:59.945771 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.945754 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:04:59.956210 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.956181 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xc2s\" (UniqueName: \"kubernetes.io/projected/38baed31-922b-4282-881c-62bca60c3a82-kube-api-access-4xc2s\") pod \"network-check-target-nrd2m\" (UID: \"38baed31-922b-4282-881c-62bca60c3a82\") " pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:04:59.995519 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:04:59.995496 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgr2\"" May 21 14:05:00.003721 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:00.003703 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:05:00.132755 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:00.132728 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrd2m"] May 21 14:05:00.394579 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:00.394496 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrd2m" event={"ID":"38baed31-922b-4282-881c-62bca60c3a82","Type":"ContainerStarted","Data":"8304da4680378c386e841821d040d6450430cff6a0cdb8dc63ce0a81b4f9b7e5"} May 21 14:05:04.403101 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:04.403071 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrd2m" event={"ID":"38baed31-922b-4282-881c-62bca60c3a82","Type":"ContainerStarted","Data":"20f7e9423e78460689fba98c487c3bc0a8452f63ee5f836a15f1f560045e4a45"} May 21 14:05:04.403517 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:04.403177 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:05:04.418062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:04.418022 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nrd2m" podStartSLOduration=67.138411416 podStartE2EDuration="1m10.418010486s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:05:00.140787398 +0000 UTC m=+66.593100888" lastFinishedPulling="2026-05-21 14:05:03.420386457 +0000 UTC m=+69.872699958" observedRunningTime="2026-05-21 14:05:04.41731633 +0000 UTC m=+70.869629840" watchObservedRunningTime="2026-05-21 14:05:04.418010486 +0000 UTC m=+70.870323992" May 21 14:05:31.854390 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:31.854356 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:31.854405 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:31.854424 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854500 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854501 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854546 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:06:35.854532583 +0000 UTC m=+162.306846078 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854567 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:06:35.854552712 +0000 UTC m=+162.306866214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854503 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854580 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:05:31.854850 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:05:31.854607 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:35.854600305 +0000 UTC m=+162.306913791 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:05:35.410820 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:05:35.410793 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nrd2m" May 21 14:06:03.875050 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:03.875013 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:06:03.875642 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:03.875185 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:06:03.875642 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:03.875289 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs podName:ea332b5e-87f3-42b5-a260-1b87a27af6b8 nodeName:}" failed. No retries permitted until 2026-05-21 14:08:05.875267165 +0000 UTC m=+252.327580671 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs") pod "network-metrics-daemon-fdpbx" (UID: "ea332b5e-87f3-42b5-a260-1b87a27af6b8") : secret "metrics-daemon-secret" not found May 21 14:06:25.911472 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.911440 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7"] May 21 14:06:25.913109 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.913094 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:25.915565 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.915548 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8tgs\"" May 21 14:06:25.915673 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.915605 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:06:25.916634 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.916618 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 14:06:25.918282 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.918262 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 14:06:25.918377 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.918265 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:06:25.924651 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.924629 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7"] May 21 14:06:25.926952 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.926934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:25.927026 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.926963 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:25.927026 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:25.927018 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nl9d\" (UniqueName: \"kubernetes.io/projected/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-kube-api-access-5nl9d\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.018334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.018308 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp"] May 21 14:06:26.020067 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.020052 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.023327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.023296 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4bgjw\"" May 21 14:06:26.023442 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.023360 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 14:06:26.023659 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.023640 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 14:06:26.023760 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.023686 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 14:06:26.023760 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.023698 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 14:06:26.024333 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.024219 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7h8s7"] May 21 14:06:26.025862 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.025846 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-97fcr"] May 21 14:06:26.025986 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.025971 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.027297 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027282 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.027413 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027311 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.027476 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.027423 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:26.027530 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027477 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nl9d\" (UniqueName: \"kubernetes.io/projected/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-kube-api-access-5nl9d\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.027530 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.027494 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.527474018 +0000 UTC m=+152.979787528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:26.027697 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027545 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c3f1127-374c-4018-afe2-b23038b41b91-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.027697 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027579 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c3f1127-374c-4018-afe2-b23038b41b91-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.027807 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027715 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcp9\" (UniqueName: \"kubernetes.io/projected/5c3f1127-374c-4018-afe2-b23038b41b91-kube-api-access-ndcp9\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.027807 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.027773 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.028072 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.028050 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.031842 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.031824 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 14:06:26.032329 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.032310 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:06:26.032444 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.032329 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:06:26.032444 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.032310 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 14:06:26.034039 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.034002 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 14:06:26.034039 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.034030 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 14:06:26.034263 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.034244 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 14:06:26.034780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.034756 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 14:06:26.034780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.034777 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fgm6d\"" May 21 14:06:26.035033 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.035017 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dtw74\"" May 21 14:06:26.043323 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.042334 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp"] May 21 14:06:26.043323 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.042924 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-97fcr"] May 21 14:06:26.044299 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.044279 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7h8s7"] May 21 14:06:26.045450 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.045432 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 14:06:26.045739 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.045721 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 14:06:26.054801 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.054776 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nl9d\" (UniqueName: \"kubernetes.io/projected/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-kube-api-access-5nl9d\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.119525 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.119504 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt"] May 21 14:06:26.121573 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.121558 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" May 21 14:06:26.122928 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.122910 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d"] May 21 14:06:26.124220 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.124177 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l7zvw\"" May 21 14:06:26.124789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.124773 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.126664 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.126647 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr"] May 21 14:06:26.127624 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.127462 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-g5nvc\"" May 21 14:06:26.128059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-snapshots\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.128147 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128084 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-tmp\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.128147 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128108 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c3f1127-374c-4018-afe2-b23038b41b91-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.128147 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128133 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c3f1127-374c-4018-afe2-b23038b41b91-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.128284 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128185 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-trusted-ca\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.128352 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128288 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 14:06:26.128352 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128297 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8591746-6e8f-4d84-94fc-3b2383b42c94-serving-cert\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128334 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n25gq\" (UniqueName: \"kubernetes.io/projected/27621f7a-7951-44d1-b630-bc7eb98f6237-kube-api-access-n25gq\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128378 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5km5j\" (UniqueName: \"kubernetes.io/projected/f8591746-6e8f-4d84-94fc-3b2383b42c94-kube-api-access-5km5j\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128393 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgf6\" (UniqueName: \"kubernetes.io/projected/6a334ba5-faaa-4191-be2a-89a244cd8bac-kube-api-access-bpgf6\") pod \"network-check-source-7f44b6dd87-v2mgt\" (UID: \"6a334ba5-faaa-4191-be2a-89a244cd8bac\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" May 21 14:06:26.128490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-config\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.128789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128525 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.128789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128569 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7885fd88f8-pb46v"] May 21 14:06:26.128789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128607 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 14:06:26.128789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128761 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c3f1127-374c-4018-afe2-b23038b41b91-config\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.128789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128783 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.129130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128569 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcp9\" (UniqueName: \"kubernetes.io/projected/5c3f1127-374c-4018-afe2-b23038b41b91-kube-api-access-ndcp9\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.129130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.128905 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27621f7a-7951-44d1-b630-bc7eb98f6237-serving-cert\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.129570 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.129553 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 14:06:26.130835 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.130818 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.130925 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.130913 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c3f1127-374c-4018-afe2-b23038b41b91-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.132351 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.132320 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ngv49\"" May 21 14:06:26.132816 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.132799 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt"] May 21 14:06:26.133332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.133315 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 14:06:26.134123 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134097 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 14:06:26.134268 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134152 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:06:26.134268 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134178 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 14:06:26.134268 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134237 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 14:06:26.134447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134303 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:06:26.134447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134325 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r6fvf\"" May 21 14:06:26.134447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134333 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 14:06:26.134596 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.134552 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 14:06:26.140631 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.140483 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d"] May 21 14:06:26.143672 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.143653 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr"] May 21 14:06:26.147750 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.147729 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7885fd88f8-pb46v"] May 21 14:06:26.149875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.149853 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcp9\" (UniqueName: \"kubernetes.io/projected/5c3f1127-374c-4018-afe2-b23038b41b91-kube-api-access-ndcp9\") pod \"kube-storage-version-migrator-operator-565644f49-j5hvp\" (UID: \"5c3f1127-374c-4018-afe2-b23038b41b91\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.229468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229399 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8591746-6e8f-4d84-94fc-3b2383b42c94-serving-cert\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.229468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-serving-cert\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.229468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229458 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n25gq\" (UniqueName: \"kubernetes.io/projected/27621f7a-7951-44d1-b630-bc7eb98f6237-kube-api-access-n25gq\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229473 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5km5j\" (UniqueName: \"kubernetes.io/projected/f8591746-6e8f-4d84-94fc-3b2383b42c94-kube-api-access-5km5j\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229494 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229517 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229533 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229550 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229579 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgf6\" (UniqueName: \"kubernetes.io/projected/6a334ba5-faaa-4191-be2a-89a244cd8bac-kube-api-access-bpgf6\") pod \"network-check-source-7f44b6dd87-v2mgt\" (UID: \"6a334ba5-faaa-4191-be2a-89a244cd8bac\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229629 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-stats-auth\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229664 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-config\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.229706 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229697 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229800 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzn6\" (UniqueName: \"kubernetes.io/projected/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-kube-api-access-whzn6\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229865 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27621f7a-7951-44d1-b630-bc7eb98f6237-serving-cert\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229912 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-snapshots\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.229974 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f822a75f-89b0-4a16-a6c0-c5862547b18a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230008 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-default-certificate\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.230066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230052 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-config\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.230327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230084 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-tmp\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230168 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-trusted-ca\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.230327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230207 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ljt\" (UniqueName: \"kubernetes.io/projected/c58c66a6-c3a5-492d-993a-15e7c2a0c495-kube-api-access-n2ljt\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.230502 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230401 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-config\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.230502 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230502 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230485 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-tmp\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.230912 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.230860 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/27621f7a-7951-44d1-b630-bc7eb98f6237-snapshots\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.231068 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.231047 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8591746-6e8f-4d84-94fc-3b2383b42c94-trusted-ca\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.231216 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.231196 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27621f7a-7951-44d1-b630-bc7eb98f6237-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.232005 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.231984 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8591746-6e8f-4d84-94fc-3b2383b42c94-serving-cert\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.232135 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.232120 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27621f7a-7951-44d1-b630-bc7eb98f6237-serving-cert\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.238968 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.238949 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25gq\" (UniqueName: \"kubernetes.io/projected/27621f7a-7951-44d1-b630-bc7eb98f6237-kube-api-access-n25gq\") pod \"insights-operator-78bdfb888c-7h8s7\" (UID: \"27621f7a-7951-44d1-b630-bc7eb98f6237\") " pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.239129 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.239114 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5km5j\" (UniqueName: \"kubernetes.io/projected/f8591746-6e8f-4d84-94fc-3b2383b42c94-kube-api-access-5km5j\") pod \"console-operator-76dff48d59-97fcr\" (UID: \"f8591746-6e8f-4d84-94fc-3b2383b42c94\") " pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.239729 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.239713 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgf6\" (UniqueName: \"kubernetes.io/projected/6a334ba5-faaa-4191-be2a-89a244cd8bac-kube-api-access-bpgf6\") pod \"network-check-source-7f44b6dd87-v2mgt\" (UID: \"6a334ba5-faaa-4191-be2a-89a244cd8bac\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" May 21 14:06:26.329650 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.329631 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" May 21 14:06:26.331388 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331367 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-serving-cert\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.331443 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331419 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.331486 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331449 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.331486 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331474 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.331575 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331505 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-stats-auth\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.331575 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331540 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whzn6\" (UniqueName: \"kubernetes.io/projected/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-kube-api-access-whzn6\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.331670 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.331576 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:26.331670 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.331585 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:26.331670 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.331605 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.831585027 +0000 UTC m=+153.283898542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:26.331670 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.331640 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.831623841 +0000 UTC m=+153.283937360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:26.331911 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.331674 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:26.831663576 +0000 UTC m=+153.283977063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:26.331911 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331704 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f822a75f-89b0-4a16-a6c0-c5862547b18a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.331911 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331732 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-default-certificate\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.331911 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331765 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-config\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.331911 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.331836 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ljt\" (UniqueName: \"kubernetes.io/projected/c58c66a6-c3a5-492d-993a-15e7c2a0c495-kube-api-access-n2ljt\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.332390 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.332366 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f822a75f-89b0-4a16-a6c0-c5862547b18a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.332530 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.332377 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-config\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.334933 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.333781 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-serving-cert\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.335334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.335309 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-default-certificate\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.335435 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.335353 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-stats-auth\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.337356 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.337320 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" May 21 14:06:26.340762 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.340743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzn6\" (UniqueName: \"kubernetes.io/projected/e1f2f9bd-2087-4b70-b59f-afeefd9342b2-kube-api-access-whzn6\") pod \"service-ca-operator-57b5b68b8-th89d\" (UID: \"e1f2f9bd-2087-4b70-b59f-afeefd9342b2\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.340845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.340781 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ljt\" (UniqueName: \"kubernetes.io/projected/c58c66a6-c3a5-492d-993a-15e7c2a0c495-kube-api-access-n2ljt\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.345017 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.344996 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:26.432605 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.432268 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" May 21 14:06:26.444662 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.444356 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" May 21 14:06:26.468452 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.468421 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp"] May 21 14:06:26.473756 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:26.473652 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3f1127_374c_4018_afe2_b23038b41b91.slice/crio-b8d83f464544e4dbf59063a3dc829d96ec1398387ea822770b5c7951f145af09 WatchSource:0}: Error finding container b8d83f464544e4dbf59063a3dc829d96ec1398387ea822770b5c7951f145af09: Status 404 returned error can't find the container with id b8d83f464544e4dbf59063a3dc829d96ec1398387ea822770b5c7951f145af09 May 21 14:06:26.533778 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.533753 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:26.533931 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.533909 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:26.534004 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.533992 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.533969199 +0000 UTC m=+153.986282703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:26.557437 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.557410 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" event={"ID":"5c3f1127-374c-4018-afe2-b23038b41b91","Type":"ContainerStarted","Data":"b8d83f464544e4dbf59063a3dc829d96ec1398387ea822770b5c7951f145af09"} May 21 14:06:26.563488 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.563463 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt"] May 21 14:06:26.566045 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:26.566019 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a334ba5_faaa_4191_be2a_89a244cd8bac.slice/crio-32fdd5df4290dc364eee6517afd4ebd2ed3b2a08cf6ae24f1ed4aab9efa2a284 WatchSource:0}: Error finding container 32fdd5df4290dc364eee6517afd4ebd2ed3b2a08cf6ae24f1ed4aab9efa2a284: Status 404 returned error can't find the container with id 32fdd5df4290dc364eee6517afd4ebd2ed3b2a08cf6ae24f1ed4aab9efa2a284 May 21 14:06:26.580438 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.580415 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d"] May 21 14:06:26.583622 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:26.583552 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f2f9bd_2087_4b70_b59f_afeefd9342b2.slice/crio-2d214e6a30701aac043de793e9419a6cde867c2117aa925ab997be5f563c4751 WatchSource:0}: Error finding container 2d214e6a30701aac043de793e9419a6cde867c2117aa925ab997be5f563c4751: Status 404 returned error can't find the container with id 2d214e6a30701aac043de793e9419a6cde867c2117aa925ab997be5f563c4751 May 21 14:06:26.699081 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.699042 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-97fcr"] May 21 14:06:26.701510 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.701486 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7h8s7"] May 21 14:06:26.702296 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:26.702258 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8591746_6e8f_4d84_94fc_3b2383b42c94.slice/crio-83448dbfd83a5684d78c3fea96b5e343298c9627b61a848b7ba44890f583ae9e WatchSource:0}: Error finding container 83448dbfd83a5684d78c3fea96b5e343298c9627b61a848b7ba44890f583ae9e: Status 404 returned error can't find the container with id 83448dbfd83a5684d78c3fea96b5e343298c9627b61a848b7ba44890f583ae9e May 21 14:06:26.704123 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:26.704102 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27621f7a_7951_44d1_b630_bc7eb98f6237.slice/crio-d5e82f485a85085ae38bfeed6c837f7d40c46b096035eff6e0a774eeb7dbbfaa WatchSource:0}: Error finding container d5e82f485a85085ae38bfeed6c837f7d40c46b096035eff6e0a774eeb7dbbfaa: Status 404 returned error can't find the container with id d5e82f485a85085ae38bfeed6c837f7d40c46b096035eff6e0a774eeb7dbbfaa May 21 14:06:26.836305 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.836279 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.836440 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.836311 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:26.836440 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:26.836381 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:26.836504 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.836456 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.836436941 +0000 UTC m=+154.288750434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:26.836504 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.836475 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:26.836504 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.836490 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:26.836616 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.836508 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.836498171 +0000 UTC m=+154.288811659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:26.836616 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:26.836537 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:27.836522346 +0000 UTC m=+154.288835833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:27.544245 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.543528 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:27.544245 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.543826 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:27.544245 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.543894 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.543873733 +0000 UTC m=+155.996187235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:27.561868 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.561824 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" event={"ID":"f8591746-6e8f-4d84-94fc-3b2383b42c94","Type":"ContainerStarted","Data":"83448dbfd83a5684d78c3fea96b5e343298c9627b61a848b7ba44890f583ae9e"} May 21 14:06:27.563070 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.563034 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" event={"ID":"e1f2f9bd-2087-4b70-b59f-afeefd9342b2","Type":"ContainerStarted","Data":"2d214e6a30701aac043de793e9419a6cde867c2117aa925ab997be5f563c4751"} May 21 14:06:27.564630 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.564596 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" event={"ID":"27621f7a-7951-44d1-b630-bc7eb98f6237","Type":"ContainerStarted","Data":"d5e82f485a85085ae38bfeed6c837f7d40c46b096035eff6e0a774eeb7dbbfaa"} May 21 14:06:27.566936 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.566909 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" event={"ID":"6a334ba5-faaa-4191-be2a-89a244cd8bac","Type":"ContainerStarted","Data":"8876f107c8f7f4800c38ad0e25b22de494c05698bb940e72ab1982e169f68bee"} May 21 14:06:27.567025 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.566945 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" event={"ID":"6a334ba5-faaa-4191-be2a-89a244cd8bac","Type":"ContainerStarted","Data":"32fdd5df4290dc364eee6517afd4ebd2ed3b2a08cf6ae24f1ed4aab9efa2a284"} May 21 14:06:27.594850 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.593757 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-v2mgt" podStartSLOduration=1.593742488 podStartE2EDuration="1.593742488s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:06:27.592979949 +0000 UTC m=+154.045293459" watchObservedRunningTime="2026-05-21 14:06:27.593742488 +0000 UTC m=+154.046055998" May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.846194 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.846248 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.846390 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.846826 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.846882 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.846861327 +0000 UTC m=+156.299174820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.846908 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.846898983 +0000 UTC m=+156.299212472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:27.847051 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:27.847170 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:27.847137 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:29.847127076 +0000 UTC m=+156.299440568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:29.571725 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:29.571692 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:29.572198 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.571866 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:29.572198 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.571943 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.571922334 +0000 UTC m=+160.024235845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:29.874477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:29.874393 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:29.874477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:29.874446 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:29.874477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:29.874478 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:29.874734 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.874559 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.874539221 +0000 UTC m=+160.326852709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:29.874734 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.874596 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:29.874734 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.874600 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:29.874734 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.874657 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.87464076 +0000 UTC m=+160.326954252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:29.874734 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:29.874674 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:33.874664732 +0000 UTC m=+160.326978226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:30.574633 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.574594 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" event={"ID":"e1f2f9bd-2087-4b70-b59f-afeefd9342b2","Type":"ContainerStarted","Data":"31921bdb469722b305af858509080ba67666cc663c693f02ae79396052aef0e4"} May 21 14:06:30.576037 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.576015 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" event={"ID":"27621f7a-7951-44d1-b630-bc7eb98f6237","Type":"ContainerStarted","Data":"c09ce83508f4e9517220e059482fda696d7bcecfe5573dc0bbe9f537da41aae9"} May 21 14:06:30.577381 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.577357 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" event={"ID":"5c3f1127-374c-4018-afe2-b23038b41b91","Type":"ContainerStarted","Data":"46de19174c71d49e3ce6403c8ceaad14341cabb48b56c81bbdc75f4ee6004e11"} May 21 14:06:30.578818 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.578797 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/0.log" May 21 14:06:30.578901 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.578837 2549 generic.go:358] "Generic (PLEG): container finished" podID="f8591746-6e8f-4d84-94fc-3b2383b42c94" containerID="a6c7713b208468729870a403b1a9af4b5e8514b7747e36545458e2a59ece710d" exitCode=255 May 21 14:06:30.578901 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.578863 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" event={"ID":"f8591746-6e8f-4d84-94fc-3b2383b42c94","Type":"ContainerDied","Data":"a6c7713b208468729870a403b1a9af4b5e8514b7747e36545458e2a59ece710d"} May 21 14:06:30.579060 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.579044 2549 scope.go:117] "RemoveContainer" containerID="a6c7713b208468729870a403b1a9af4b5e8514b7747e36545458e2a59ece710d" May 21 14:06:30.594325 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.594275 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" podStartSLOduration=0.983141608 podStartE2EDuration="4.5942605s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:26.585042996 +0000 UTC m=+153.037356487" lastFinishedPulling="2026-05-21 14:06:30.196161892 +0000 UTC m=+156.648475379" observedRunningTime="2026-05-21 14:06:30.592240693 +0000 UTC m=+157.044554211" watchObservedRunningTime="2026-05-21 14:06:30.5942605 +0000 UTC m=+157.046574010" May 21 14:06:30.617112 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.616946 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" podStartSLOduration=1.126234042 podStartE2EDuration="4.61693366s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:26.705991028 +0000 UTC m=+153.158304515" lastFinishedPulling="2026-05-21 14:06:30.196690632 +0000 UTC m=+156.649004133" observedRunningTime="2026-05-21 14:06:30.614700455 +0000 UTC m=+157.067013965" watchObservedRunningTime="2026-05-21 14:06:30.61693366 +0000 UTC m=+157.069247169" May 21 14:06:30.656060 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:30.655917 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" podStartSLOduration=0.940814773 podStartE2EDuration="4.655900795s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:26.475488041 +0000 UTC m=+152.927801527" lastFinishedPulling="2026-05-21 14:06:30.190574048 +0000 UTC m=+156.642887549" observedRunningTime="2026-05-21 14:06:30.655089178 +0000 UTC m=+157.107402688" watchObservedRunningTime="2026-05-21 14:06:30.655900795 +0000 UTC m=+157.108214306" May 21 14:06:30.971612 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:30.971521 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" podUID="ffea9fd2-7a74-42cb-9310-44d4c869f745" May 21 14:06:30.987710 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:30.987678 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8rm2" podUID="a1d0a36f-a6fd-4ae9-916e-f20bb556293f" May 21 14:06:31.001875 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:31.001845 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fswvs" podUID="02500ec9-9b90-4e4d-8409-415f4ee0894f" May 21 14:06:31.182027 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:31.181986 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fdpbx" podUID="ea332b5e-87f3-42b5-a260-1b87a27af6b8" May 21 14:06:31.583304 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.583274 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/1.log" May 21 14:06:31.583825 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.583647 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/0.log" May 21 14:06:31.583825 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.583682 2549 generic.go:358] "Generic (PLEG): container finished" podID="f8591746-6e8f-4d84-94fc-3b2383b42c94" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" exitCode=255 May 21 14:06:31.583825 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.583796 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" event={"ID":"f8591746-6e8f-4d84-94fc-3b2383b42c94","Type":"ContainerDied","Data":"8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5"} May 21 14:06:31.584003 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.583835 2549 scope.go:117] "RemoveContainer" containerID="a6c7713b208468729870a403b1a9af4b5e8514b7747e36545458e2a59ece710d" May 21 14:06:31.584052 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.584027 2549 scope.go:117] "RemoveContainer" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" May 21 14:06:31.584127 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:31.584109 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8rm2" May 21 14:06:31.584246 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:31.584226 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-97fcr_openshift-console-operator(f8591746-6e8f-4d84-94fc-3b2383b42c94)\"" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podUID="f8591746-6e8f-4d84-94fc-3b2383b42c94" May 21 14:06:32.587523 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:32.587486 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/1.log" May 21 14:06:32.587959 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:32.587895 2549 scope.go:117] "RemoveContainer" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" May 21 14:06:32.588083 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:32.588066 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-97fcr_openshift-console-operator(f8591746-6e8f-4d84-94fc-3b2383b42c94)\"" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podUID="f8591746-6e8f-4d84-94fc-3b2383b42c94" May 21 14:06:33.605096 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:33.605063 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:33.605572 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.605229 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:33.605572 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.605307 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.605286011 +0000 UTC m=+168.057599499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:33.907260 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:33.907178 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:33.907260 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:33.907216 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:33.907260 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:33.907236 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:33.907541 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.907355 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:33.907541 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.907366 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:33.907541 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.907356 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.907323606 +0000 UTC m=+168.359637097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:33.907541 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.907405 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.907393601 +0000 UTC m=+168.359707088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:33.907541 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:33.907473 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:41.907466538 +0000 UTC m=+168.359780025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:34.375879 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:34.375852 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbdtg_02c1944f-0919-4765-8643-dfc19df42810/dns-node-resolver/0.log" May 21 14:06:35.380932 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:35.380905 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jnlc_426dfaa0-fbb1-4ebc-849f-00efd86eb480/node-ca/0.log" May 21 14:06:35.926199 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:35.926159 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:06:35.926406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:35.926206 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") pod \"image-registry-77df66cc9b-hwdfr\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:06:35.926406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:35.926276 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:06:35.926406 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926332 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926420 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926429 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls podName:a1d0a36f-a6fd-4ae9-916e-f20bb556293f nodeName:}" failed. No retries permitted until 2026-05-21 14:08:37.926409869 +0000 UTC m=+284.378723360 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls") pod "dns-default-f8rm2" (UID: "a1d0a36f-a6fd-4ae9-916e-f20bb556293f") : secret "dns-default-metrics-tls" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926426 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926446 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77df66cc9b-hwdfr: secret "image-registry-tls" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926470 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert podName:02500ec9-9b90-4e4d-8409-415f4ee0894f nodeName:}" failed. No retries permitted until 2026-05-21 14:08:37.926457748 +0000 UTC m=+284.378771235 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert") pod "ingress-canary-fswvs" (UID: "02500ec9-9b90-4e4d-8409-415f4ee0894f") : secret "canary-serving-cert" not found May 21 14:06:35.926547 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:35.926482 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls podName:ffea9fd2-7a74-42cb-9310-44d4c869f745 nodeName:}" failed. No retries permitted until 2026-05-21 14:08:37.926476569 +0000 UTC m=+284.378790056 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls") pod "image-registry-77df66cc9b-hwdfr" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745") : secret "image-registry-tls" not found May 21 14:06:36.345512 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:36.345480 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:36.345512 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:36.345517 2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:36.345906 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:36.345890 2549 scope.go:117] "RemoveContainer" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" May 21 14:06:36.346092 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:36.346072 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-97fcr_openshift-console-operator(f8591746-6e8f-4d84-94fc-3b2383b42c94)\"" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podUID="f8591746-6e8f-4d84-94fc-3b2383b42c94" May 21 14:06:37.177662 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:37.177631 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j5hvp_5c3f1127-374c-4018-afe2-b23038b41b91/kube-storage-version-migrator-operator/0.log" May 21 14:06:41.672878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:41.672846 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:41.673260 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.672995 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:06:41.673260 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.673058 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls podName:d44a8e7b-179e-4bda-b78b-b2c6ca7039f1 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:57.673040537 +0000 UTC m=+184.125354032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dvmz7" (UID: "d44a8e7b-179e-4bda-b78b-b2c6ca7039f1") : secret "cluster-monitoring-operator-tls" not found May 21 14:06:41.975364 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:41.975261 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:41.975364 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:41.975303 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:41.975364 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:41.975351 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:41.975634 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.975479 2549 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:06:41.975634 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.975511 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:57.975493925 +0000 UTC m=+184.427807413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : configmap references non-existent config key: service-ca.crt May 21 14:06:41.975634 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.975533 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert podName:f822a75f-89b0-4a16-a6c0-c5862547b18a nodeName:}" failed. No retries permitted until 2026-05-21 14:06:57.975526554 +0000 UTC m=+184.427840040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-26gcr" (UID: "f822a75f-89b0-4a16-a6c0-c5862547b18a") : secret "networking-console-plugin-cert" not found May 21 14:06:41.975634 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.975562 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:06:41.975634 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:41.975609 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs podName:c58c66a6-c3a5-492d-993a-15e7c2a0c495 nodeName:}" failed. No retries permitted until 2026-05-21 14:06:57.975593675 +0000 UTC m=+184.427907162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs") pod "router-default-7885fd88f8-pb46v" (UID: "c58c66a6-c3a5-492d-993a-15e7c2a0c495") : secret "router-metrics-certs-default" not found May 21 14:06:42.171843 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:42.171807 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:06:42.171843 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:42.171829 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:06:44.172552 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:44.172518 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:06:47.171837 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.171807 2549 scope.go:117] "RemoveContainer" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" May 21 14:06:47.622356 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.622316 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:06:47.622682 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.622665 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/1.log" May 21 14:06:47.622780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.622705 2549 generic.go:358] "Generic (PLEG): container finished" podID="f8591746-6e8f-4d84-94fc-3b2383b42c94" containerID="74f1c28f1329f93a317b5f2d470791ecc1d12d6d5751eec09e26a2f5e4d38dc4" exitCode=255 May 21 14:06:47.622780 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.622763 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" event={"ID":"f8591746-6e8f-4d84-94fc-3b2383b42c94","Type":"ContainerDied","Data":"74f1c28f1329f93a317b5f2d470791ecc1d12d6d5751eec09e26a2f5e4d38dc4"} May 21 14:06:47.622883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.622803 2549 scope.go:117] "RemoveContainer" containerID="8b9139e0080baad0c47aa9afb0aa00d14883aa39d7686cb10ca0fa74f75501a5" May 21 14:06:47.623087 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:47.623067 2549 scope.go:117] "RemoveContainer" containerID="74f1c28f1329f93a317b5f2d470791ecc1d12d6d5751eec09e26a2f5e4d38dc4" May 21 14:06:47.623281 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:47.623263 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-97fcr_openshift-console-operator(f8591746-6e8f-4d84-94fc-3b2383b42c94)\"" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podUID="f8591746-6e8f-4d84-94fc-3b2383b42c94" May 21 14:06:48.626798 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:48.626770 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:06:53.451757 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.451725 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2ntqk"] May 21 14:06:53.482601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.482570 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ntqk"] May 21 14:06:53.482735 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.482635 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.485444 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.485419 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:06:53.486520 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.486504 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:06:53.486520 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.486516 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nx82v\"" May 21 14:06:53.568495 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.568463 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.568636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.568500 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-crio-socket\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.568636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.568526 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.568636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.568627 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-data-volume\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.568760 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.568710 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7kpp\" (UniqueName: \"kubernetes.io/projected/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-api-access-h7kpp\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669115 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669088 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7kpp\" (UniqueName: \"kubernetes.io/projected/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-api-access-h7kpp\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669162 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669191 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-crio-socket\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669218 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669460 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669287 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-data-volume\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669460 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669289 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-crio-socket\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669647 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669630 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-data-volume\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.669754 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.669737 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.671391 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.671375 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.679676 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.679655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7kpp\" (UniqueName: \"kubernetes.io/projected/1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8-kube-api-access-h7kpp\") pod \"insights-runtime-extractor-2ntqk\" (UID: \"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8\") " pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.791229 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.791156 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ntqk" May 21 14:06:53.911877 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:53.911849 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ntqk"] May 21 14:06:53.914746 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:53.914712 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8b6fce_2455_4d34_83a8_0bc04f9a1bc8.slice/crio-4f0fa90bac9ba8486d91d92933e29fe651f680f57380d0d53b4942ed09c00437 WatchSource:0}: Error finding container 4f0fa90bac9ba8486d91d92933e29fe651f680f57380d0d53b4942ed09c00437: Status 404 returned error can't find the container with id 4f0fa90bac9ba8486d91d92933e29fe651f680f57380d0d53b4942ed09c00437 May 21 14:06:54.642405 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:54.642372 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ntqk" event={"ID":"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8","Type":"ContainerStarted","Data":"47a2a2000622712128028702a98fdb65b0bcbcf27e94dc8cd704bdef1af663f2"} May 21 14:06:54.642405 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:54.642406 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ntqk" event={"ID":"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8","Type":"ContainerStarted","Data":"4f0fa90bac9ba8486d91d92933e29fe651f680f57380d0d53b4942ed09c00437"} May 21 14:06:55.645994 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:55.645961 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ntqk" event={"ID":"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8","Type":"ContainerStarted","Data":"d3f19cc02151fff9fe85bc82d23c07cbb787b0e521449684b5437cb0ba69fbc7"} May 21 14:06:56.345315 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:56.345281 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:56.345315 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:56.345317 2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:06:56.345726 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:56.345703 2549 scope.go:117] "RemoveContainer" containerID="74f1c28f1329f93a317b5f2d470791ecc1d12d6d5751eec09e26a2f5e4d38dc4" May 21 14:06:56.345943 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:06:56.345916 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-97fcr_openshift-console-operator(f8591746-6e8f-4d84-94fc-3b2383b42c94)\"" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podUID="f8591746-6e8f-4d84-94fc-3b2383b42c94" May 21 14:06:56.652786 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:56.652712 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ntqk" event={"ID":"1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8","Type":"ContainerStarted","Data":"9871cbf1460e4c977bbac996b8acc087b1875be19ffe6000df669b70072ccf98"} May 21 14:06:56.671291 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:56.671249 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2ntqk" podStartSLOduration=1.255098149 podStartE2EDuration="3.671236367s" podCreationTimestamp="2026-05-21 14:06:53 +0000 UTC" firstStartedPulling="2026-05-21 14:06:54.036961614 +0000 UTC m=+180.489275101" lastFinishedPulling="2026-05-21 14:06:56.453099831 +0000 UTC m=+182.905413319" observedRunningTime="2026-05-21 14:06:56.67037151 +0000 UTC m=+183.122685020" watchObservedRunningTime="2026-05-21 14:06:56.671236367 +0000 UTC m=+183.123549873" May 21 14:06:57.702379 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:57.702323 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:57.704642 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:57.704622 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d44a8e7b-179e-4bda-b78b-b2c6ca7039f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dvmz7\" (UID: \"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:57.724327 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:57.724305 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8tgs\"" May 21 14:06:57.731548 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:57.731530 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" May 21 14:06:57.850272 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:57.850241 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7"] May 21 14:06:57.852989 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:57.852963 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44a8e7b_179e_4bda_b78b_b2c6ca7039f1.slice/crio-87d72aa9a0bc8a0cb7461427396cbff351ee2a5724da93f7741a1756d9f80932 WatchSource:0}: Error finding container 87d72aa9a0bc8a0cb7461427396cbff351ee2a5724da93f7741a1756d9f80932: Status 404 returned error can't find the container with id 87d72aa9a0bc8a0cb7461427396cbff351ee2a5724da93f7741a1756d9f80932 May 21 14:06:58.005708 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.005617 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:58.005708 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.005662 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:58.005708 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.005679 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:58.006256 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.006229 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58c66a6-c3a5-492d-993a-15e7c2a0c495-service-ca-bundle\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:58.007931 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.007910 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f822a75f-89b0-4a16-a6c0-c5862547b18a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-26gcr\" (UID: \"f822a75f-89b0-4a16-a6c0-c5862547b18a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:58.007931 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.007919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c58c66a6-c3a5-492d-993a-15e7c2a0c495-metrics-certs\") pod \"router-default-7885fd88f8-pb46v\" (UID: \"c58c66a6-c3a5-492d-993a-15e7c2a0c495\") " pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:58.259212 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.259141 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ngv49\"" May 21 14:06:58.264608 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.264587 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r6fvf\"" May 21 14:06:58.266586 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.266572 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" May 21 14:06:58.273237 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.273165 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:58.402826 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.402800 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr"] May 21 14:06:58.406317 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:58.406287 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf822a75f_89b0_4a16_a6c0_c5862547b18a.slice/crio-f82d99f00011f7398a77d3f9f8b7895e30f5ba54bbc67a396ed603128caa8dae WatchSource:0}: Error finding container f82d99f00011f7398a77d3f9f8b7895e30f5ba54bbc67a396ed603128caa8dae: Status 404 returned error can't find the container with id f82d99f00011f7398a77d3f9f8b7895e30f5ba54bbc67a396ed603128caa8dae May 21 14:06:58.428729 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.428706 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7885fd88f8-pb46v"] May 21 14:06:58.431075 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:06:58.431053 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58c66a6_c3a5_492d_993a_15e7c2a0c495.slice/crio-83842a9f498a31262b2b7063ecae063be897fb78113e5c4ed69fb5039706af8a WatchSource:0}: Error finding container 83842a9f498a31262b2b7063ecae063be897fb78113e5c4ed69fb5039706af8a: Status 404 returned error can't find the container with id 83842a9f498a31262b2b7063ecae063be897fb78113e5c4ed69fb5039706af8a May 21 14:06:58.658810 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.658779 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" event={"ID":"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1","Type":"ContainerStarted","Data":"87d72aa9a0bc8a0cb7461427396cbff351ee2a5724da93f7741a1756d9f80932"} May 21 14:06:58.659965 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.659938 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7885fd88f8-pb46v" event={"ID":"c58c66a6-c3a5-492d-993a-15e7c2a0c495","Type":"ContainerStarted","Data":"1f7ea4ddb5bd5cc67a597da7a5bdb8ada5b2ab6a97bd83bf5c0e99aaa3c62d93"} May 21 14:06:58.660094 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.659971 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7885fd88f8-pb46v" event={"ID":"c58c66a6-c3a5-492d-993a-15e7c2a0c495","Type":"ContainerStarted","Data":"83842a9f498a31262b2b7063ecae063be897fb78113e5c4ed69fb5039706af8a"} May 21 14:06:58.661068 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.661047 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" event={"ID":"f822a75f-89b0-4a16-a6c0-c5862547b18a","Type":"ContainerStarted","Data":"f82d99f00011f7398a77d3f9f8b7895e30f5ba54bbc67a396ed603128caa8dae"} May 21 14:06:58.686224 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:58.686185 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7885fd88f8-pb46v" podStartSLOduration=32.686171046 podStartE2EDuration="32.686171046s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:06:58.684017559 +0000 UTC m=+185.136331069" watchObservedRunningTime="2026-05-21 14:06:58.686171046 +0000 UTC m=+185.138484555" May 21 14:06:59.274064 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:59.274026 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:59.276911 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:59.276888 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:59.664662 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:59.664628 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:06:59.666004 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:06:59.665981 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7885fd88f8-pb46v" May 21 14:07:00.668213 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:00.668180 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" event={"ID":"d44a8e7b-179e-4bda-b78b-b2c6ca7039f1","Type":"ContainerStarted","Data":"7fa71d8f2b77844dc1ec773265e7ca419def6f7950a60ab71133758eedbf6add"} May 21 14:07:00.669443 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:00.669424 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" event={"ID":"f822a75f-89b0-4a16-a6c0-c5862547b18a","Type":"ContainerStarted","Data":"53921e80de13d6fa96479ff77abce5d01d52d111c051a25668939bb24c13b0f3"} May 21 14:07:00.693837 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:00.690646 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dvmz7" podStartSLOduration=33.640227223 podStartE2EDuration="35.690630173s" podCreationTimestamp="2026-05-21 14:06:25 +0000 UTC" firstStartedPulling="2026-05-21 14:06:57.854902561 +0000 UTC m=+184.307216048" lastFinishedPulling="2026-05-21 14:06:59.90530551 +0000 UTC m=+186.357618998" observedRunningTime="2026-05-21 14:07:00.690430164 +0000 UTC m=+187.142743674" watchObservedRunningTime="2026-05-21 14:07:00.690630173 +0000 UTC m=+187.142943683" May 21 14:07:00.727219 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:00.727183 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-26gcr" podStartSLOduration=33.230670754 podStartE2EDuration="34.72717068s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:58.408150516 +0000 UTC m=+184.860464004" lastFinishedPulling="2026-05-21 14:06:59.90465043 +0000 UTC m=+186.356963930" observedRunningTime="2026-05-21 14:07:00.726763776 +0000 UTC m=+187.179077285" watchObservedRunningTime="2026-05-21 14:07:00.72717068 +0000 UTC m=+187.179484188" May 21 14:07:03.461837 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.461803 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv"] May 21 14:07:03.464188 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.464172 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.467215 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.467194 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 14:07:03.467308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.467194 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 14:07:03.468356 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.468330 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nfvjv\"" May 21 14:07:03.468432 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.468412 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:07:03.476667 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.476649 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv"] May 21 14:07:03.550042 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.550018 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.550152 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.550064 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.550152 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.550139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.550222 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.550183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvdq\" (UniqueName: \"kubernetes.io/projected/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-kube-api-access-ltvdq\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.651087 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.651056 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.651227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.651125 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.651227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.651185 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvdq\" (UniqueName: \"kubernetes.io/projected/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-kube-api-access-ltvdq\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.651308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.651234 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.651861 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.651837 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.653633 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.653604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.653633 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.653617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.659241 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.659222 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvdq\" (UniqueName: \"kubernetes.io/projected/471f8eb1-dcc3-4cd0-a997-da17a7b921c4-kube-api-access-ltvdq\") pod \"prometheus-operator-7779bbdd78-6kmzv\" (UID: \"471f8eb1-dcc3-4cd0-a997-da17a7b921c4\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.773064 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.772992 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" May 21 14:07:03.890000 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:03.889970 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv"] May 21 14:07:03.892590 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:03.892551 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471f8eb1_dcc3_4cd0_a997_da17a7b921c4.slice/crio-8c9446a6608232002337a6fd4441bc4661efa4a845e0069e433e09cff7920e33 WatchSource:0}: Error finding container 8c9446a6608232002337a6fd4441bc4661efa4a845e0069e433e09cff7920e33: Status 404 returned error can't find the container with id 8c9446a6608232002337a6fd4441bc4661efa4a845e0069e433e09cff7920e33 May 21 14:07:04.682235 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:04.682198 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" event={"ID":"471f8eb1-dcc3-4cd0-a997-da17a7b921c4","Type":"ContainerStarted","Data":"8c9446a6608232002337a6fd4441bc4661efa4a845e0069e433e09cff7920e33"} May 21 14:07:05.686836 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:05.686801 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" event={"ID":"471f8eb1-dcc3-4cd0-a997-da17a7b921c4","Type":"ContainerStarted","Data":"6055548b2b01bf13fe74d7ab727ae719779082276e45d4504381589fb6168843"} May 21 14:07:05.686836 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:05.686839 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" event={"ID":"471f8eb1-dcc3-4cd0-a997-da17a7b921c4","Type":"ContainerStarted","Data":"4afe85af933716c488391b2334594860d5e05736165b188c9205a88655e1a235"} May 21 14:07:05.705369 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:05.705308 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6kmzv" podStartSLOduration=1.341749047 podStartE2EDuration="2.705294861s" podCreationTimestamp="2026-05-21 14:07:03 +0000 UTC" firstStartedPulling="2026-05-21 14:07:03.894418204 +0000 UTC m=+190.346731691" lastFinishedPulling="2026-05-21 14:07:05.257964017 +0000 UTC m=+191.710277505" observedRunningTime="2026-05-21 14:07:05.704666756 +0000 UTC m=+192.156980266" watchObservedRunningTime="2026-05-21 14:07:05.705294861 +0000 UTC m=+192.157608372" May 21 14:07:08.081135 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.081105 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mt24g"] May 21 14:07:08.083314 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.083298 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.088585 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.088560 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 14:07:08.089819 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.089797 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5bbhn\"" May 21 14:07:08.089925 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.089902 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 14:07:08.113800 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.113777 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mt24g"] May 21 14:07:08.130700 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.130679 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hpc9x"] May 21 14:07:08.132759 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.132746 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.137506 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.137477 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:07:08.137596 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.137538 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6lljt\"" May 21 14:07:08.137735 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.137722 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:07:08.138169 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.138154 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:07:08.187843 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.187820 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.187942 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.187849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58595eb1-c886-4b6c-8572-b2385b122d25-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.187942 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.187868 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76n89\" (UniqueName: \"kubernetes.io/projected/58595eb1-c886-4b6c-8572-b2385b122d25-kube-api-access-76n89\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.188029 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.187942 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.289238 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-sys\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.289377 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289253 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.289377 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289273 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rsq7\" (UniqueName: \"kubernetes.io/projected/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-kube-api-access-7rsq7\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.289377 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289292 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-textfile\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.289520 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289495 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-tls\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.289552 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289538 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.289606 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289591 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.289672 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289660 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58595eb1-c886-4b6c-8572-b2385b122d25-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.289713 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289684 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76n89\" (UniqueName: \"kubernetes.io/projected/58595eb1-c886-4b6c-8572-b2385b122d25-kube-api-access-76n89\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.289749 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.289737 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.290085 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.290056 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-root\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.290196 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.290141 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-wtmp\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.290251 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.290197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-metrics-client-ca\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.290951 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.290927 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58595eb1-c886-4b6c-8572-b2385b122d25-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.292145 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.292115 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.292767 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.292743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58595eb1-c886-4b6c-8572-b2385b122d25-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.298559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.298536 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76n89\" (UniqueName: \"kubernetes.io/projected/58595eb1-c886-4b6c-8572-b2385b122d25-kube-api-access-76n89\") pod \"openshift-state-metrics-9c959559f-mt24g\" (UID: \"58595eb1-c886-4b6c-8572-b2385b122d25\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.391559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391493 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-metrics-client-ca\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391531 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-sys\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391555 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rsq7\" (UniqueName: \"kubernetes.io/projected/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-kube-api-access-7rsq7\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391799 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391627 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-sys\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391799 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391676 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-textfile\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391799 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391753 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-tls\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.391799 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391781 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392007 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391872 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392007 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391898 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-root\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392007 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391936 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-wtmp\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392007 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.391983 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" May 21 14:07:08.392203 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.392061 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-textfile\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392203 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.392076 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-root\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392203 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.392092 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-wtmp\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392203 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.392166 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-metrics-client-ca\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.392398 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.392373 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.394742 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.394719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.394862 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.394839 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-node-exporter-tls\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.400385 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.400364 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rsq7\" (UniqueName: \"kubernetes.io/projected/6e917a90-6953-46c3-b5e5-886ed3a4c2b0-kube-api-access-7rsq7\") pod \"node-exporter-hpc9x\" (UID: \"6e917a90-6953-46c3-b5e5-886ed3a4c2b0\") " pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.441730 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.441697 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpc9x" May 21 14:07:08.453222 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:08.453186 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e917a90_6953_46c3_b5e5_886ed3a4c2b0.slice/crio-c892de1e2d5b162ad2a4551eab8256a35c1e62cc2ea767b0e6378b109d9d224b WatchSource:0}: Error finding container c892de1e2d5b162ad2a4551eab8256a35c1e62cc2ea767b0e6378b109d9d224b: Status 404 returned error can't find the container with id c892de1e2d5b162ad2a4551eab8256a35c1e62cc2ea767b0e6378b109d9d224b May 21 14:07:08.517548 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.517524 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-mt24g"] May 21 14:07:08.519583 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:08.519557 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58595eb1_c886_4b6c_8572_b2385b122d25.slice/crio-4087a988e44f7f37bd29d2f6f2d5e7bb392cde72ce61da61a87c603293d65dcb WatchSource:0}: Error finding container 4087a988e44f7f37bd29d2f6f2d5e7bb392cde72ce61da61a87c603293d65dcb: Status 404 returned error can't find the container with id 4087a988e44f7f37bd29d2f6f2d5e7bb392cde72ce61da61a87c603293d65dcb May 21 14:07:08.694107 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.694031 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpc9x" event={"ID":"6e917a90-6953-46c3-b5e5-886ed3a4c2b0","Type":"ContainerStarted","Data":"c892de1e2d5b162ad2a4551eab8256a35c1e62cc2ea767b0e6378b109d9d224b"} May 21 14:07:08.695541 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.695516 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" event={"ID":"58595eb1-c886-4b6c-8572-b2385b122d25","Type":"ContainerStarted","Data":"24806add7ce258fb673eb506df45c2d809934968eea80c6c01a0d0dd460e2007"} May 21 14:07:08.695541 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.695544 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" event={"ID":"58595eb1-c886-4b6c-8572-b2385b122d25","Type":"ContainerStarted","Data":"8490f9713df515f611630954fe513eec8896fdf43ade952f7d5308a8368dbd9c"} May 21 14:07:08.695683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:08.695554 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" event={"ID":"58595eb1-c886-4b6c-8572-b2385b122d25","Type":"ContainerStarted","Data":"4087a988e44f7f37bd29d2f6f2d5e7bb392cde72ce61da61a87c603293d65dcb"} May 21 14:07:09.171537 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.171507 2549 scope.go:117] "RemoveContainer" containerID="74f1c28f1329f93a317b5f2d470791ecc1d12d6d5751eec09e26a2f5e4d38dc4" May 21 14:07:09.703420 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.703392 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:07:09.703599 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.703501 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" event={"ID":"f8591746-6e8f-4d84-94fc-3b2383b42c94","Type":"ContainerStarted","Data":"5f74e791e206ad4ef71e19c0f72c5f7a18839b6a53d29d07f124da780537d340"} May 21 14:07:09.703828 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.703772 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:07:09.709995 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.709970 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" May 21 14:07:09.722967 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:09.722508 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-97fcr" podStartSLOduration=40.228545309 podStartE2EDuration="43.722493784s" podCreationTimestamp="2026-05-21 14:06:26 +0000 UTC" firstStartedPulling="2026-05-21 14:06:26.704093963 +0000 UTC m=+153.156407464" lastFinishedPulling="2026-05-21 14:06:30.198042438 +0000 UTC m=+156.650355939" observedRunningTime="2026-05-21 14:07:09.721023135 +0000 UTC m=+196.173336638" watchObservedRunningTime="2026-05-21 14:07:09.722493784 +0000 UTC m=+196.174807295" May 21 14:07:10.097553 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.097524 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6969c758f-8r9gm"] May 21 14:07:10.100019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.100002 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.102750 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.102729 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 14:07:10.102750 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.102747 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 14:07:10.102926 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.102813 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 14:07:10.102926 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.102896 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 14:07:10.103043 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.103024 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hc89x\"" May 21 14:07:10.103112 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.103086 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8k9hcu3plgai8\"" May 21 14:07:10.103177 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.103120 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 14:07:10.112091 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.112073 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6969c758f-8r9gm"] May 21 14:07:10.207019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.206989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207025 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207046 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7gdq\" (UniqueName: \"kubernetes.io/projected/822e4bc1-b71a-4ff8-8099-ff52f496437f-kube-api-access-h7gdq\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207192 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-grpc-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.207334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.207219 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822e4bc1-b71a-4ff8-8099-ff52f496437f-metrics-client-ca\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.307908 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.307844 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.307908 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.307872 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-grpc-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.307908 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.307898 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822e4bc1-b71a-4ff8-8099-ff52f496437f-metrics-client-ca\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308128 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308110 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308191 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308153 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308191 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308181 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308289 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308214 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7gdq\" (UniqueName: \"kubernetes.io/projected/822e4bc1-b71a-4ff8-8099-ff52f496437f-kube-api-access-h7gdq\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308879 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308374 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.308879 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.308777 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/822e4bc1-b71a-4ff8-8099-ff52f496437f-metrics-client-ca\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.310629 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.310604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.310910 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.310886 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.310999 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.310927 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.311062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.311023 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.311247 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.311229 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.311415 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.311396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/822e4bc1-b71a-4ff8-8099-ff52f496437f-secret-grpc-tls\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.316523 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.316503 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7gdq\" (UniqueName: \"kubernetes.io/projected/822e4bc1-b71a-4ff8-8099-ff52f496437f-kube-api-access-h7gdq\") pod \"thanos-querier-6969c758f-8r9gm\" (UID: \"822e4bc1-b71a-4ff8-8099-ff52f496437f\") " pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.408964 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.408943 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:10.537828 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.537803 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6969c758f-8r9gm"] May 21 14:07:10.541053 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:10.541022 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822e4bc1_b71a_4ff8_8099_ff52f496437f.slice/crio-3f3ea9dc24eb814be33b2d5b49491d0105b8136f431b8d555676fbe00152e4af WatchSource:0}: Error finding container 3f3ea9dc24eb814be33b2d5b49491d0105b8136f431b8d555676fbe00152e4af: Status 404 returned error can't find the container with id 3f3ea9dc24eb814be33b2d5b49491d0105b8136f431b8d555676fbe00152e4af May 21 14:07:10.710522 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.710478 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"3f3ea9dc24eb814be33b2d5b49491d0105b8136f431b8d555676fbe00152e4af"} May 21 14:07:10.711967 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.711943 2549 generic.go:358] "Generic (PLEG): container finished" podID="6e917a90-6953-46c3-b5e5-886ed3a4c2b0" containerID="73a85c6d5b04f8bc11d94bcbdea76432ce6babc97a03a8c4cea6baf63a0cd4fc" exitCode=0 May 21 14:07:10.712062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.712002 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpc9x" event={"ID":"6e917a90-6953-46c3-b5e5-886ed3a4c2b0","Type":"ContainerDied","Data":"73a85c6d5b04f8bc11d94bcbdea76432ce6babc97a03a8c4cea6baf63a0cd4fc"} May 21 14:07:10.713946 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.713922 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" event={"ID":"58595eb1-c886-4b6c-8572-b2385b122d25","Type":"ContainerStarted","Data":"5575a37cdc1695a483902c8cac0428af91453fd2c4da11852fd0793c29898c34"} May 21 14:07:10.754811 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:10.754776 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-mt24g" podStartSLOduration=1.530434809 podStartE2EDuration="2.7547623s" podCreationTimestamp="2026-05-21 14:07:08 +0000 UTC" firstStartedPulling="2026-05-21 14:07:08.618979592 +0000 UTC m=+195.071293082" lastFinishedPulling="2026-05-21 14:07:09.843307077 +0000 UTC m=+196.295620573" observedRunningTime="2026-05-21 14:07:10.753790896 +0000 UTC m=+197.206104398" watchObservedRunningTime="2026-05-21 14:07:10.7547623 +0000 UTC m=+197.207075828" May 21 14:07:11.718487 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:11.718442 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpc9x" event={"ID":"6e917a90-6953-46c3-b5e5-886ed3a4c2b0","Type":"ContainerStarted","Data":"d5e9c484fa26f8d70b7f5e733b4300ddde92024d627f7817e73599e24494741f"} May 21 14:07:11.718487 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:11.718490 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpc9x" event={"ID":"6e917a90-6953-46c3-b5e5-886ed3a4c2b0","Type":"ContainerStarted","Data":"cf930bbf8196ee85e57d375d7a715d44303bc45a5d8061070bd1ad10f192166d"} May 21 14:07:11.741677 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:11.741611 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hpc9x" podStartSLOduration=2.354519305 podStartE2EDuration="3.741595599s" podCreationTimestamp="2026-05-21 14:07:08 +0000 UTC" firstStartedPulling="2026-05-21 14:07:08.455030848 +0000 UTC m=+194.907344354" lastFinishedPulling="2026-05-21 14:07:09.84210716 +0000 UTC m=+196.294420648" observedRunningTime="2026-05-21 14:07:11.739296266 +0000 UTC m=+198.191609778" watchObservedRunningTime="2026-05-21 14:07:11.741595599 +0000 UTC m=+198.193909111" May 21 14:07:12.723987 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:12.723950 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"65d234d4f8e927a80db49d948898d6a4f8f3691dbbf62664b53687ede0d21271"} May 21 14:07:12.723987 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:12.723996 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"38a7697ebef695472ce6be3f793745aa0f42adfe3ceea207eba791dcae5c3af4"} May 21 14:07:12.724486 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:12.724009 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"5cae9ac69af97cc766eefa34f19366e3ae9ca7dc46971787b7e0ec1c28b37323"} May 21 14:07:13.727854 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:13.727829 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"9c38202a1d05071366a4efec3dca0132b2dc81a9e663662f4aa31f0380937aa1"} May 21 14:07:14.733109 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:14.733070 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"3b8045f3ac6f86d08c32eaf541a04114979d4ffd0160a43ef558ea727ebe2a00"} May 21 14:07:14.733109 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:14.733108 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" event={"ID":"822e4bc1-b71a-4ff8-8099-ff52f496437f","Type":"ContainerStarted","Data":"fe1131ce48347b720e7e2e178fd603d69b8af8f909a472492ab2d73ad427878b"} May 21 14:07:14.733563 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:14.733280 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:14.765993 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:14.765941 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" podStartSLOduration=1.63525674 podStartE2EDuration="4.7659283s" podCreationTimestamp="2026-05-21 14:07:10 +0000 UTC" firstStartedPulling="2026-05-21 14:07:10.543055745 +0000 UTC m=+196.995369232" lastFinishedPulling="2026-05-21 14:07:13.6737273 +0000 UTC m=+200.126040792" observedRunningTime="2026-05-21 14:07:14.763123068 +0000 UTC m=+201.215436577" watchObservedRunningTime="2026-05-21 14:07:14.7659283 +0000 UTC m=+201.218241808" May 21 14:07:15.921210 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:15.921177 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77df66cc9b-hwdfr"] May 21 14:07:15.921602 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:07:15.921392 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" podUID="ffea9fd2-7a74-42cb-9310-44d4c869f745" May 21 14:07:16.738532 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.738499 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:07:16.742587 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.742567 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:07:16.766019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.765996 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766043 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8bnw\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766090 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766121 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766295 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766218 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:07:16.766295 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766263 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766432 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766314 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766432 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766369 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration\") pod \"ffea9fd2-7a74-42cb-9310-44d4c869f745\" (UID: \"ffea9fd2-7a74-42cb-9310-44d4c869f745\") " May 21 14:07:16.766636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766604 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:07:16.766636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766616 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:07:16.766767 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766709 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-trusted-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.766767 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766731 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-certificates\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.766767 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.766746 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffea9fd2-7a74-42cb-9310-44d4c869f745-ca-trust-extracted\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.768501 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.768478 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:07:16.768603 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.768538 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw" (OuterVolumeSpecName: "kube-api-access-j8bnw") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "kube-api-access-j8bnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:07:16.768603 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.768557 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:07:16.768690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.768607 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ffea9fd2-7a74-42cb-9310-44d4c869f745" (UID: "ffea9fd2-7a74-42cb-9310-44d4c869f745"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:07:16.867648 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.867621 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-installation-pull-secrets\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.867648 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.867644 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-bound-sa-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.867648 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.867654 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffea9fd2-7a74-42cb-9310-44d4c869f745-image-registry-private-configuration\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:16.867844 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:16.867664 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8bnw\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-kube-api-access-j8bnw\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:17.741292 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:17.741259 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77df66cc9b-hwdfr" May 21 14:07:17.797765 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:17.797728 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77df66cc9b-hwdfr"] May 21 14:07:17.802104 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:17.802080 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77df66cc9b-hwdfr"] May 21 14:07:17.877248 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:17.877220 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffea9fd2-7a74-42cb-9310-44d4c869f745-registry-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:07:18.175314 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:18.175284 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffea9fd2-7a74-42cb-9310-44d4c869f745" path="/var/lib/kubelet/pods/ffea9fd2-7a74-42cb-9310-44d4c869f745/volumes" May 21 14:07:19.802810 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.802779 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:07:19.805958 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.805937 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.809775 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809751 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 14:07:19.809883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809780 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c8mvf\"" May 21 14:07:19.809883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809752 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 14:07:19.809883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809825 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 14:07:19.809883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809752 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 14:07:19.810088 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809754 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 14:07:19.810088 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809794 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 14:07:19.810088 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.809752 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 14:07:19.814967 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.814947 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:07:19.894742 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894712 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8wf\" (UniqueName: \"kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.894878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894750 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.894878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894794 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.894878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894814 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.894878 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894840 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.895008 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.894914 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995241 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995213 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995262 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995292 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995329 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995519 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995409 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995519 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995459 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8wf\" (UniqueName: \"kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.995998 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.995973 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.996095 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.996075 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.996165 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.996075 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.997712 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.997685 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:19.997712 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:19.997699 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:20.004066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:20.004042 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8wf\" (UniqueName: \"kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf\") pod \"console-f67c85985-js26q\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " pod="openshift-console/console-f67c85985-js26q" May 21 14:07:20.115274 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:20.115245 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:20.243234 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:20.243153 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:07:20.245706 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:20.245681 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b94d2a_db29_46b8_9dc6_7e303e56ba37.slice/crio-cdcc9a09913d2ccd617b2adca3c9851f60f1846d7f6308810071f0e5fd17b70b WatchSource:0}: Error finding container cdcc9a09913d2ccd617b2adca3c9851f60f1846d7f6308810071f0e5fd17b70b: Status 404 returned error can't find the container with id cdcc9a09913d2ccd617b2adca3c9851f60f1846d7f6308810071f0e5fd17b70b May 21 14:07:20.741277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:20.741250 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6969c758f-8r9gm" May 21 14:07:20.750756 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:20.750735 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67c85985-js26q" event={"ID":"54b94d2a-db29-46b8-9dc6-7e303e56ba37","Type":"ContainerStarted","Data":"cdcc9a09913d2ccd617b2adca3c9851f60f1846d7f6308810071f0e5fd17b70b"} May 21 14:07:23.761259 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:23.761216 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67c85985-js26q" event={"ID":"54b94d2a-db29-46b8-9dc6-7e303e56ba37","Type":"ContainerStarted","Data":"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481"} May 21 14:07:23.781721 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:23.781671 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f67c85985-js26q" podStartSLOduration=1.8149946369999999 podStartE2EDuration="4.781658717s" podCreationTimestamp="2026-05-21 14:07:19 +0000 UTC" firstStartedPulling="2026-05-21 14:07:20.247650191 +0000 UTC m=+206.699963677" lastFinishedPulling="2026-05-21 14:07:23.21431427 +0000 UTC m=+209.666627757" observedRunningTime="2026-05-21 14:07:23.780075617 +0000 UTC m=+210.232389124" watchObservedRunningTime="2026-05-21 14:07:23.781658717 +0000 UTC m=+210.233972226" May 21 14:07:27.291985 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.291952 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:07:27.296453 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.296429 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.305119 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.305089 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 14:07:27.305643 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.305623 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:07:27.362044 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362022 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362044 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362051 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362233 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362090 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362233 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362160 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362233 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362404 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362237 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnsqt\" (UniqueName: \"kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.362404 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.362281 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463436 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463409 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463444 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463493 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463537 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463563 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463786 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463602 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnsqt\" (UniqueName: \"kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.463786 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.463640 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.464363 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.464322 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.464444 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.464372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.464444 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.464395 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.464625 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.464603 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.465978 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.465958 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.466060 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.466033 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.471695 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.471666 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnsqt\" (UniqueName: \"kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt\") pod \"console-6cc9fb8955-fn2vn\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.604992 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.604970 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:27.730846 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.730803 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:07:27.735562 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:07:27.735533 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e02d06d_f475_4cb8_8cc4_d3a0d5cdc4d8.slice/crio-e84f9f0dc3398ec2b8f0d0cc98ea9b2b7a3f24b5b8bf1298f11a0927455845c4 WatchSource:0}: Error finding container e84f9f0dc3398ec2b8f0d0cc98ea9b2b7a3f24b5b8bf1298f11a0927455845c4: Status 404 returned error can't find the container with id e84f9f0dc3398ec2b8f0d0cc98ea9b2b7a3f24b5b8bf1298f11a0927455845c4 May 21 14:07:27.772957 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:27.772925 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9fb8955-fn2vn" event={"ID":"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8","Type":"ContainerStarted","Data":"e84f9f0dc3398ec2b8f0d0cc98ea9b2b7a3f24b5b8bf1298f11a0927455845c4"} May 21 14:07:28.776529 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:28.776494 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9fb8955-fn2vn" event={"ID":"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8","Type":"ContainerStarted","Data":"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad"} May 21 14:07:28.796830 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:28.796789 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cc9fb8955-fn2vn" podStartSLOduration=1.796775615 podStartE2EDuration="1.796775615s" podCreationTimestamp="2026-05-21 14:07:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:07:28.796033598 +0000 UTC m=+215.248347108" watchObservedRunningTime="2026-05-21 14:07:28.796775615 +0000 UTC m=+215.249089124" May 21 14:07:30.116015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:30.115985 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:30.116015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:30.116021 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:30.120439 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:30.120419 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:30.789104 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:30.789072 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f67c85985-js26q" May 21 14:07:37.605912 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:37.605872 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:37.605912 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:37.605913 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:37.610450 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:37.610428 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:37.803148 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:37.803115 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:07:37.855827 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:37.855799 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:07:41.811180 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:41.811153 2549 generic.go:358] "Generic (PLEG): container finished" podID="e1f2f9bd-2087-4b70-b59f-afeefd9342b2" containerID="31921bdb469722b305af858509080ba67666cc663c693f02ae79396052aef0e4" exitCode=0 May 21 14:07:41.811572 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:41.811228 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" event={"ID":"e1f2f9bd-2087-4b70-b59f-afeefd9342b2","Type":"ContainerDied","Data":"31921bdb469722b305af858509080ba67666cc663c693f02ae79396052aef0e4"} May 21 14:07:41.811615 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:41.811571 2549 scope.go:117] "RemoveContainer" containerID="31921bdb469722b305af858509080ba67666cc663c693f02ae79396052aef0e4" May 21 14:07:42.815089 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:42.815057 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-th89d" event={"ID":"e1f2f9bd-2087-4b70-b59f-afeefd9342b2","Type":"ContainerStarted","Data":"ddbcda1f8b408385346deded60845a739edaab283cad80169615b2409bc2a3ad"} May 21 14:07:45.824742 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:45.824708 2549 generic.go:358] "Generic (PLEG): container finished" podID="5c3f1127-374c-4018-afe2-b23038b41b91" containerID="46de19174c71d49e3ce6403c8ceaad14341cabb48b56c81bbdc75f4ee6004e11" exitCode=0 May 21 14:07:45.825093 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:45.824785 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" event={"ID":"5c3f1127-374c-4018-afe2-b23038b41b91","Type":"ContainerDied","Data":"46de19174c71d49e3ce6403c8ceaad14341cabb48b56c81bbdc75f4ee6004e11"} May 21 14:07:45.825141 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:45.825098 2549 scope.go:117] "RemoveContainer" containerID="46de19174c71d49e3ce6403c8ceaad14341cabb48b56c81bbdc75f4ee6004e11" May 21 14:07:46.828646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:46.828612 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j5hvp" event={"ID":"5c3f1127-374c-4018-afe2-b23038b41b91","Type":"ContainerStarted","Data":"00b73025ada8be9cd749faa12fb48cfc575c530b25346ba419701a139bd1c27e"} May 21 14:07:51.843571 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:51.843541 2549 generic.go:358] "Generic (PLEG): container finished" podID="27621f7a-7951-44d1-b630-bc7eb98f6237" containerID="c09ce83508f4e9517220e059482fda696d7bcecfe5573dc0bbe9f537da41aae9" exitCode=0 May 21 14:07:51.843963 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:51.843613 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" event={"ID":"27621f7a-7951-44d1-b630-bc7eb98f6237","Type":"ContainerDied","Data":"c09ce83508f4e9517220e059482fda696d7bcecfe5573dc0bbe9f537da41aae9"} May 21 14:07:51.843963 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:51.843946 2549 scope.go:117] "RemoveContainer" containerID="c09ce83508f4e9517220e059482fda696d7bcecfe5573dc0bbe9f537da41aae9" May 21 14:07:52.849071 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:07:52.849036 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7h8s7" event={"ID":"27621f7a-7951-44d1-b630-bc7eb98f6237","Type":"ContainerStarted","Data":"30d0297358c00c7793a7705c8266c6c855cebd04bece61c34d654372199ab252"} May 21 14:08:02.875768 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:02.875727 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f67c85985-js26q" podUID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" containerName="console" containerID="cri-o://809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481" gracePeriod=15 May 21 14:08:03.118267 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.118243 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f67c85985-js26q_54b94d2a-db29-46b8-9dc6-7e303e56ba37/console/0.log" May 21 14:08:03.118411 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.118308 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67c85985-js26q" May 21 14:08:03.157762 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157680 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl8wf\" (UniqueName: \"kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.157762 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157711 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.157762 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157737 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.158019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157853 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.158019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157874 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.158019 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.157890 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config\") pod \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\" (UID: \"54b94d2a-db29-46b8-9dc6-7e303e56ba37\") " May 21 14:08:03.158217 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.158169 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca" (OuterVolumeSpecName: "service-ca") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:03.158374 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.158320 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:03.158542 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.158505 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config" (OuterVolumeSpecName: "console-config") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:08:03.160207 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.160181 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf" (OuterVolumeSpecName: "kube-api-access-rl8wf") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "kube-api-access-rl8wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:08:03.160406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.160385 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:03.160540 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.160511 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54b94d2a-db29-46b8-9dc6-7e303e56ba37" (UID: "54b94d2a-db29-46b8-9dc6-7e303e56ba37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:08:03.258826 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258794 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.258826 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258821 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.259031 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258836 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.259031 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258850 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl8wf\" (UniqueName: \"kubernetes.io/projected/54b94d2a-db29-46b8-9dc6-7e303e56ba37-kube-api-access-rl8wf\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.259031 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258865 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b94d2a-db29-46b8-9dc6-7e303e56ba37-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.259031 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.258879 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54b94d2a-db29-46b8-9dc6-7e303e56ba37-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:08:03.880506 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880479 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f67c85985-js26q_54b94d2a-db29-46b8-9dc6-7e303e56ba37/console/0.log" May 21 14:08:03.881075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880519 2549 generic.go:358] "Generic (PLEG): container finished" podID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" containerID="809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481" exitCode=2 May 21 14:08:03.881075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880577 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67c85985-js26q" event={"ID":"54b94d2a-db29-46b8-9dc6-7e303e56ba37","Type":"ContainerDied","Data":"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481"} May 21 14:08:03.881075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880586 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67c85985-js26q" May 21 14:08:03.881075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880603 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67c85985-js26q" event={"ID":"54b94d2a-db29-46b8-9dc6-7e303e56ba37","Type":"ContainerDied","Data":"cdcc9a09913d2ccd617b2adca3c9851f60f1846d7f6308810071f0e5fd17b70b"} May 21 14:08:03.881075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.880617 2549 scope.go:117] "RemoveContainer" containerID="809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481" May 21 14:08:03.888052 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.888033 2549 scope.go:117] "RemoveContainer" containerID="809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481" May 21 14:08:03.888310 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:08:03.888288 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481\": container with ID starting with 809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481 not found: ID does not exist" containerID="809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481" May 21 14:08:03.888396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.888318 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481"} err="failed to get container status \"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481\": rpc error: code = NotFound desc = could not find container \"809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481\": container with ID starting with 809e7c0545022bed19d6590c2f5f5d59ede6b47a556654404f3fb08ca3d40481 not found: ID does not exist" May 21 14:08:03.908075 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.908052 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:08:03.914661 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:03.914636 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f67c85985-js26q"] May 21 14:08:04.175292 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:04.175213 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" path="/var/lib/kubelet/pods/54b94d2a-db29-46b8-9dc6-7e303e56ba37/volumes" May 21 14:08:05.886244 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:05.886197 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:08:05.888526 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:05.888503 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea332b5e-87f3-42b5-a260-1b87a27af6b8-metrics-certs\") pod \"network-metrics-daemon-fdpbx\" (UID: \"ea332b5e-87f3-42b5-a260-1b87a27af6b8\") " pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:08:06.076690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:06.076602 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2rcd\"" May 21 14:08:06.084872 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:06.084383 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdpbx" May 21 14:08:06.247946 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:06.244031 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdpbx"] May 21 14:08:06.251826 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:08:06.251799 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea332b5e_87f3_42b5_a260_1b87a27af6b8.slice/crio-b565229645495eb1d11d5b4ca6ca654ea4e5d47c5c4441dc94a10eb9b28b9754 WatchSource:0}: Error finding container b565229645495eb1d11d5b4ca6ca654ea4e5d47c5c4441dc94a10eb9b28b9754: Status 404 returned error can't find the container with id b565229645495eb1d11d5b4ca6ca654ea4e5d47c5c4441dc94a10eb9b28b9754 May 21 14:08:06.893520 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:06.893484 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdpbx" event={"ID":"ea332b5e-87f3-42b5-a260-1b87a27af6b8","Type":"ContainerStarted","Data":"b565229645495eb1d11d5b4ca6ca654ea4e5d47c5c4441dc94a10eb9b28b9754"} May 21 14:08:07.897589 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:07.897554 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdpbx" event={"ID":"ea332b5e-87f3-42b5-a260-1b87a27af6b8","Type":"ContainerStarted","Data":"7c268c03e2a0a26df6a2fdaf03b2e0859ce7a0299d93f00a67c34369d6f4bb59"} May 21 14:08:07.897589 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:07.897592 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdpbx" event={"ID":"ea332b5e-87f3-42b5-a260-1b87a27af6b8","Type":"ContainerStarted","Data":"beadb0996e67d629bf1e2802a27e48e74a5e82022a3e24d205d2665566d25284"} May 21 14:08:07.925188 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:07.925139 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdpbx" podStartSLOduration=252.970506456 podStartE2EDuration="4m13.925124036s" podCreationTimestamp="2026-05-21 14:03:54 +0000 UTC" firstStartedPulling="2026-05-21 14:08:06.253760768 +0000 UTC m=+252.706074255" lastFinishedPulling="2026-05-21 14:08:07.208378345 +0000 UTC m=+253.660691835" observedRunningTime="2026-05-21 14:08:07.924500689 +0000 UTC m=+254.376814209" watchObservedRunningTime="2026-05-21 14:08:07.925124036 +0000 UTC m=+254.377437598" May 21 14:08:24.401522 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.401490 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:08:24.402080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.401840 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" containerName="console" May 21 14:08:24.402080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.401853 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" containerName="console" May 21 14:08:24.402080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.401906 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b94d2a-db29-46b8-9dc6-7e303e56ba37" containerName="console" May 21 14:08:24.405971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.405952 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.427779 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.424894 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:08:24.544180 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544144 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544319 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544214 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544319 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544233 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwq7\" (UniqueName: \"kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544319 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544249 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544451 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544317 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544451 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.544517 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.544453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644766 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644738 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644766 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644766 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644785 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644809 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644854 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644869 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwq7\" (UniqueName: \"kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.644972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.644894 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.645534 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.645510 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.645534 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.645522 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.645672 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.645614 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.645785 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.645768 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.647838 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.647801 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.647941 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.647918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.653994 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.653946 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwq7\" (UniqueName: \"kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7\") pod \"console-59b64598c9-sgt5g\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.715601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.715580 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:24.847200 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.847174 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:08:24.849676 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:08:24.849648 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906353b4_00ae_4d23_828d_28a04bc1ab56.slice/crio-96e4112758f3d35ecc100eb196f3a947dcaac6f1d48057b929faa1fb100fa82f WatchSource:0}: Error finding container 96e4112758f3d35ecc100eb196f3a947dcaac6f1d48057b929faa1fb100fa82f: Status 404 returned error can't find the container with id 96e4112758f3d35ecc100eb196f3a947dcaac6f1d48057b929faa1fb100fa82f May 21 14:08:24.944214 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.944144 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b64598c9-sgt5g" event={"ID":"906353b4-00ae-4d23-828d-28a04bc1ab56","Type":"ContainerStarted","Data":"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f"} May 21 14:08:24.944214 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.944178 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b64598c9-sgt5g" event={"ID":"906353b4-00ae-4d23-828d-28a04bc1ab56","Type":"ContainerStarted","Data":"96e4112758f3d35ecc100eb196f3a947dcaac6f1d48057b929faa1fb100fa82f"} May 21 14:08:24.964043 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:24.964000 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59b64598c9-sgt5g" podStartSLOduration=0.963985782 podStartE2EDuration="963.985782ms" podCreationTimestamp="2026-05-21 14:08:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:08:24.962054819 +0000 UTC m=+271.414368328" watchObservedRunningTime="2026-05-21 14:08:24.963985782 +0000 UTC m=+271.416299290" May 21 14:08:34.585503 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:08:34.585463 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8rm2" podUID="a1d0a36f-a6fd-4ae9-916e-f20bb556293f" May 21 14:08:34.716236 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:34.716206 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:34.716407 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:34.716244 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:34.720834 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:34.720812 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:34.972509 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:34.972428 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8rm2" May 21 14:08:34.976311 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:34.976289 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:08:35.025766 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:35.025743 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:08:37.956678 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.956644 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:08:37.957157 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.956691 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:08:37.959032 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.959004 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1d0a36f-a6fd-4ae9-916e-f20bb556293f-metrics-tls\") pod \"dns-default-f8rm2\" (UID: \"a1d0a36f-a6fd-4ae9-916e-f20bb556293f\") " pod="openshift-dns/dns-default-f8rm2" May 21 14:08:37.959135 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.959046 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02500ec9-9b90-4e4d-8409-415f4ee0894f-cert\") pod \"ingress-canary-fswvs\" (UID: \"02500ec9-9b90-4e4d-8409-415f4ee0894f\") " pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:08:37.976236 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.976211 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8szvz\"" May 21 14:08:37.977367 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.977353 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v7ff7\"" May 21 14:08:37.983086 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.983070 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fswvs" May 21 14:08:37.983916 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:37.983646 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8rm2" May 21 14:08:38.120321 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:38.120298 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8rm2"] May 21 14:08:38.122255 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:08:38.122231 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d0a36f_a6fd_4ae9_916e_f20bb556293f.slice/crio-1b59934557ebc452e9e8a03666277acfbe5e97405fea260d7516c799bb86b166 WatchSource:0}: Error finding container 1b59934557ebc452e9e8a03666277acfbe5e97405fea260d7516c799bb86b166: Status 404 returned error can't find the container with id 1b59934557ebc452e9e8a03666277acfbe5e97405fea260d7516c799bb86b166 May 21 14:08:38.136590 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:38.136564 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fswvs"] May 21 14:08:38.163088 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:08:38.163065 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02500ec9_9b90_4e4d_8409_415f4ee0894f.slice/crio-cbdd9e4e2a95b5e9892e2ae14628d7b0b231b394036dc1cbff419dca7246b545 WatchSource:0}: Error finding container cbdd9e4e2a95b5e9892e2ae14628d7b0b231b394036dc1cbff419dca7246b545: Status 404 returned error can't find the container with id cbdd9e4e2a95b5e9892e2ae14628d7b0b231b394036dc1cbff419dca7246b545 May 21 14:08:38.984470 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:38.984431 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8rm2" event={"ID":"a1d0a36f-a6fd-4ae9-916e-f20bb556293f","Type":"ContainerStarted","Data":"1b59934557ebc452e9e8a03666277acfbe5e97405fea260d7516c799bb86b166"} May 21 14:08:38.985972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:38.985932 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fswvs" event={"ID":"02500ec9-9b90-4e4d-8409-415f4ee0894f","Type":"ContainerStarted","Data":"cbdd9e4e2a95b5e9892e2ae14628d7b0b231b394036dc1cbff419dca7246b545"} May 21 14:08:39.991392 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:39.991336 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8rm2" event={"ID":"a1d0a36f-a6fd-4ae9-916e-f20bb556293f","Type":"ContainerStarted","Data":"c13c4d1c8c2b5cdd35a3e34bf0bad5334b59a074365d876956992610fec683fa"} May 21 14:08:40.995652 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:40.995616 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8rm2" event={"ID":"a1d0a36f-a6fd-4ae9-916e-f20bb556293f","Type":"ContainerStarted","Data":"ca8f9aa03c0964d5c71de1d3ef28f7986f46e1f016c86f9524f51219265bd943"} May 21 14:08:40.996088 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:40.995734 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8rm2" May 21 14:08:40.996916 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:40.996892 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fswvs" event={"ID":"02500ec9-9b90-4e4d-8409-415f4ee0894f","Type":"ContainerStarted","Data":"7cf188f0ce927d3fe8a40011d4c87108eaa96068d9fff3a263fac51da67fab6a"} May 21 14:08:41.015608 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:41.015570 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-f8rm2" podStartSLOduration=252.310685686 podStartE2EDuration="4m14.01555933s" podCreationTimestamp="2026-05-21 14:04:27 +0000 UTC" firstStartedPulling="2026-05-21 14:08:38.12392553 +0000 UTC m=+284.576239018" lastFinishedPulling="2026-05-21 14:08:39.828799174 +0000 UTC m=+286.281112662" observedRunningTime="2026-05-21 14:08:41.013399545 +0000 UTC m=+287.465713053" watchObservedRunningTime="2026-05-21 14:08:41.01555933 +0000 UTC m=+287.467872839" May 21 14:08:41.033300 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:41.033257 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fswvs" podStartSLOduration=251.799097011 podStartE2EDuration="4m14.033247869s" podCreationTimestamp="2026-05-21 14:04:27 +0000 UTC" firstStartedPulling="2026-05-21 14:08:38.164805371 +0000 UTC m=+284.617118862" lastFinishedPulling="2026-05-21 14:08:40.398956218 +0000 UTC m=+286.851269720" observedRunningTime="2026-05-21 14:08:41.03207376 +0000 UTC m=+287.484387269" watchObservedRunningTime="2026-05-21 14:08:41.033247869 +0000 UTC m=+287.485561375" May 21 14:08:51.002183 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:51.002158 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8rm2" May 21 14:08:54.046355 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:54.046308 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:08:54.046788 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:54.046392 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:08:54.053964 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:54.053941 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:08:54.054246 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:54.054225 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:08:54.057743 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:08:54.057723 2549 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:09:00.051326 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.051292 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cc9fb8955-fn2vn" podUID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" containerName="console" containerID="cri-o://e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad" gracePeriod=15 May 21 14:09:00.293390 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.293369 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cc9fb8955-fn2vn_5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8/console/0.log" May 21 14:09:00.293495 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.293434 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:09:00.328190 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328165 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328303 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328208 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnsqt\" (UniqueName: \"kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328303 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328247 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328303 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328266 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328312 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328529 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328474 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328529 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328511 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert\") pod \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\" (UID: \"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8\") " May 21 14:09:00.328782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328714 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:09:00.328782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328749 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:09:00.329022 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328798 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.329022 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328928 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config" (OuterVolumeSpecName: "console-config") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:09:00.329022 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.328987 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:09:00.330515 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.330492 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:09:00.330515 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.330503 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:09:00.330762 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.330748 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt" (OuterVolumeSpecName: "kube-api-access-gnsqt") pod "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" (UID: "5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8"). InnerVolumeSpecName "kube-api-access-gnsqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:09:00.429594 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429570 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.429594 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429592 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.429740 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429601 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.429740 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429610 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnsqt\" (UniqueName: \"kubernetes.io/projected/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-kube-api-access-gnsqt\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.429740 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429619 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:00.429740 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:00.429628 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8-trusted-ca-bundle\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:09:01.055226 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055200 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cc9fb8955-fn2vn_5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8/console/0.log" May 21 14:09:01.055646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055239 2549 generic.go:358] "Generic (PLEG): container finished" podID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" containerID="e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad" exitCode=2 May 21 14:09:01.055646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055271 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9fb8955-fn2vn" event={"ID":"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8","Type":"ContainerDied","Data":"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad"} May 21 14:09:01.055646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055293 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9fb8955-fn2vn" event={"ID":"5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8","Type":"ContainerDied","Data":"e84f9f0dc3398ec2b8f0d0cc98ea9b2b7a3f24b5b8bf1298f11a0927455845c4"} May 21 14:09:01.055646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055307 2549 scope.go:117] "RemoveContainer" containerID="e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad" May 21 14:09:01.055646 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.055334 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9fb8955-fn2vn" May 21 14:09:01.063857 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.063839 2549 scope.go:117] "RemoveContainer" containerID="e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad" May 21 14:09:01.064096 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:09:01.064079 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad\": container with ID starting with e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad not found: ID does not exist" containerID="e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad" May 21 14:09:01.064139 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.064104 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad"} err="failed to get container status \"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad\": rpc error: code = NotFound desc = could not find container \"e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad\": container with ID starting with e2b5b35ed694cebeac45c3e0b305b1ec36ee78e2a02c9af3c6cde279ce156cad not found: ID does not exist" May 21 14:09:01.076789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.076762 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:09:01.079966 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:01.079947 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc9fb8955-fn2vn"] May 21 14:09:02.175785 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:02.175746 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" path="/var/lib/kubelet/pods/5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8/volumes" May 21 14:09:50.397478 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.397407 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c"] May 21 14:09:50.397884 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.397732 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" containerName="console" May 21 14:09:50.397884 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.397746 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" containerName="console" May 21 14:09:50.397884 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.397805 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e02d06d-f475-4cb8-8cc4-d3a0d5cdc4d8" containerName="console" May 21 14:09:50.399598 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.399584 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.402639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.402620 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xxvzr\"" May 21 14:09:50.403091 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.403074 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 14:09:50.403175 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.403094 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 14:09:50.420203 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.420182 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c"] May 21 14:09:50.518322 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.518296 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763343e8-b140-4816-b309-4c1b1f24e367-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.518461 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.518331 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5bmz\" (UniqueName: \"kubernetes.io/projected/763343e8-b140-4816-b309-4c1b1f24e367-kube-api-access-c5bmz\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.619650 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.619621 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763343e8-b140-4816-b309-4c1b1f24e367-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.619757 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.619657 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5bmz\" (UniqueName: \"kubernetes.io/projected/763343e8-b140-4816-b309-4c1b1f24e367-kube-api-access-c5bmz\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.620012 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.619996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763343e8-b140-4816-b309-4c1b1f24e367-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.629905 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.629884 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5bmz\" (UniqueName: \"kubernetes.io/projected/763343e8-b140-4816-b309-4c1b1f24e367-kube-api-access-c5bmz\") pod \"cert-manager-operator-controller-manager-54b9655956-gv77c\" (UID: \"763343e8-b140-4816-b309-4c1b1f24e367\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.707858 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.707801 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" May 21 14:09:50.839647 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.839620 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c"] May 21 14:09:50.841756 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:09:50.841731 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763343e8_b140_4816_b309_4c1b1f24e367.slice/crio-4cb20596e33ba776c1c1dbc8acf957ba09d8726fb3c70e7fe1f2742b441bfb41 WatchSource:0}: Error finding container 4cb20596e33ba776c1c1dbc8acf957ba09d8726fb3c70e7fe1f2742b441bfb41: Status 404 returned error can't find the container with id 4cb20596e33ba776c1c1dbc8acf957ba09d8726fb3c70e7fe1f2742b441bfb41 May 21 14:09:50.844799 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:50.844784 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:09:51.200935 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:51.200903 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" event={"ID":"763343e8-b140-4816-b309-4c1b1f24e367","Type":"ContainerStarted","Data":"4cb20596e33ba776c1c1dbc8acf957ba09d8726fb3c70e7fe1f2742b441bfb41"} May 21 14:09:55.216726 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:55.216688 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" event={"ID":"763343e8-b140-4816-b309-4c1b1f24e367","Type":"ContainerStarted","Data":"bf72fb722728afad1e265eee3e5cb0cb038c35898bd4eda9c960ca77fa8c78e3"} May 21 14:09:55.240005 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:55.239944 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-gv77c" podStartSLOduration=1.381045754 podStartE2EDuration="5.239926136s" podCreationTimestamp="2026-05-21 14:09:50 +0000 UTC" firstStartedPulling="2026-05-21 14:09:50.844910433 +0000 UTC m=+357.297223920" lastFinishedPulling="2026-05-21 14:09:54.703790815 +0000 UTC m=+361.156104302" observedRunningTime="2026-05-21 14:09:55.23843977 +0000 UTC m=+361.690753279" watchObservedRunningTime="2026-05-21 14:09:55.239926136 +0000 UTC m=+361.692239646" May 21 14:09:58.723725 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.723691 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-plhr8"] May 21 14:09:58.725899 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.725884 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.729768 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.729749 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 14:09:58.730887 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.730873 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 14:09:58.731573 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.731555 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-njpzt\"" May 21 14:09:58.738536 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.738516 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-plhr8"] May 21 14:09:58.780284 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.780258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkc7c\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-kube-api-access-zkc7c\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.780426 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.780316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.881218 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.881190 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.881324 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.881271 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkc7c\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-kube-api-access-zkc7c\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.892318 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.892284 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkc7c\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-kube-api-access-zkc7c\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:58.893418 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:58.893399 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/101526b7-cf17-4d20-ab7d-306f82b07140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-plhr8\" (UID: \"101526b7-cf17-4d20-ab7d-306f82b07140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:59.048921 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:59.048847 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" May 21 14:09:59.174513 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:59.174490 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-plhr8"] May 21 14:09:59.177065 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:09:59.177038 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101526b7_cf17_4d20_ab7d_306f82b07140.slice/crio-501170ab2a55d8cddb9021dbbeb204697b064fad67225d68c5d3ceb9fb16a7bf WatchSource:0}: Error finding container 501170ab2a55d8cddb9021dbbeb204697b064fad67225d68c5d3ceb9fb16a7bf: Status 404 returned error can't find the container with id 501170ab2a55d8cddb9021dbbeb204697b064fad67225d68c5d3ceb9fb16a7bf May 21 14:09:59.230719 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:09:59.230690 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" event={"ID":"101526b7-cf17-4d20-ab7d-306f82b07140","Type":"ContainerStarted","Data":"501170ab2a55d8cddb9021dbbeb204697b064fad67225d68c5d3ceb9fb16a7bf"} May 21 14:10:02.240883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:02.240847 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" event={"ID":"101526b7-cf17-4d20-ab7d-306f82b07140","Type":"ContainerStarted","Data":"c0d20d38049493e3aa57d6c9674612ae2c577b00013e8506d9e796cd63215e0c"} May 21 14:10:02.257904 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:02.257864 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-plhr8" podStartSLOduration=1.7610877440000001 podStartE2EDuration="4.257851981s" podCreationTimestamp="2026-05-21 14:09:58 +0000 UTC" firstStartedPulling="2026-05-21 14:09:59.179242074 +0000 UTC m=+365.631555561" lastFinishedPulling="2026-05-21 14:10:01.676006309 +0000 UTC m=+368.128319798" observedRunningTime="2026-05-21 14:10:02.256264694 +0000 UTC m=+368.708578203" watchObservedRunningTime="2026-05-21 14:10:02.257851981 +0000 UTC m=+368.710165490" May 21 14:10:03.417269 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.417235 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-hz8cq"] May 21 14:10:03.419365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.419330 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.421870 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.421854 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-djvbl\"" May 21 14:10:03.429692 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.429670 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-hz8cq"] May 21 14:10:03.520434 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.520409 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.520563 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.520439 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpb5\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-kube-api-access-5kpb5\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.621781 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.621747 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.621920 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.621792 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpb5\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-kube-api-access-5kpb5\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.630691 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.630671 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.630774 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.630760 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpb5\" (UniqueName: \"kubernetes.io/projected/f3b66c90-1810-460a-9329-598231fb35b4-kube-api-access-5kpb5\") pod \"cert-manager-webhook-587ccfb98-hz8cq\" (UID: \"f3b66c90-1810-460a-9329-598231fb35b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.728666 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.728600 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:03.864822 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:03.864793 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-hz8cq"] May 21 14:10:03.867553 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:10:03.867520 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b66c90_1810_460a_9329_598231fb35b4.slice/crio-fdf34febec3012d89ec83746bcdca8443464fc54205ed8fd5d3b47792fc2972a WatchSource:0}: Error finding container fdf34febec3012d89ec83746bcdca8443464fc54205ed8fd5d3b47792fc2972a: Status 404 returned error can't find the container with id fdf34febec3012d89ec83746bcdca8443464fc54205ed8fd5d3b47792fc2972a May 21 14:10:04.248185 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:04.248150 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" event={"ID":"f3b66c90-1810-460a-9329-598231fb35b4","Type":"ContainerStarted","Data":"cc285449ed14efcda173ced8ecfd31b58b833d6f4ab18aa891153b848568741f"} May 21 14:10:04.248185 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:04.248183 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" event={"ID":"f3b66c90-1810-460a-9329-598231fb35b4","Type":"ContainerStarted","Data":"fdf34febec3012d89ec83746bcdca8443464fc54205ed8fd5d3b47792fc2972a"} May 21 14:10:04.248417 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:04.248294 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:04.264057 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:04.263998 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" podStartSLOduration=1.263986243 podStartE2EDuration="1.263986243s" podCreationTimestamp="2026-05-21 14:10:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:10:04.263210262 +0000 UTC m=+370.715523770" watchObservedRunningTime="2026-05-21 14:10:04.263986243 +0000 UTC m=+370.716299752" May 21 14:10:10.253853 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:10.253827 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-hz8cq" May 21 14:10:16.300051 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.300022 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xzqj2"] May 21 14:10:16.302232 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.302216 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.304967 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.304946 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gxlmn\"" May 21 14:10:16.311779 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.311759 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xzqj2"] May 21 14:10:16.428599 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.428570 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-bound-sa-token\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.428599 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.428601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7gj\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-kube-api-access-bh7gj\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.529610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.529585 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-bound-sa-token\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.529707 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.529614 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7gj\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-kube-api-access-bh7gj\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.538613 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.538589 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-bound-sa-token\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.538819 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.538801 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7gj\" (UniqueName: \"kubernetes.io/projected/ad03db35-a541-49b2-9798-6a71434fbb04-kube-api-access-bh7gj\") pod \"cert-manager-79c8d999ff-xzqj2\" (UID: \"ad03db35-a541-49b2-9798-6a71434fbb04\") " pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.611310 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.611288 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xzqj2" May 21 14:10:16.742478 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:16.742449 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xzqj2"] May 21 14:10:16.745585 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:10:16.745553 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad03db35_a541_49b2_9798_6a71434fbb04.slice/crio-c220dffa978dd2941e7e0c0b333971048fd6956bd20454909c1b2f06d44193cf WatchSource:0}: Error finding container c220dffa978dd2941e7e0c0b333971048fd6956bd20454909c1b2f06d44193cf: Status 404 returned error can't find the container with id c220dffa978dd2941e7e0c0b333971048fd6956bd20454909c1b2f06d44193cf May 21 14:10:17.287829 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:17.287778 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xzqj2" event={"ID":"ad03db35-a541-49b2-9798-6a71434fbb04","Type":"ContainerStarted","Data":"620af75338308610c88528bf1c087af6ea76012e63f54d37f27a144e23bc20eb"} May 21 14:10:17.287829 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:17.287826 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xzqj2" event={"ID":"ad03db35-a541-49b2-9798-6a71434fbb04","Type":"ContainerStarted","Data":"c220dffa978dd2941e7e0c0b333971048fd6956bd20454909c1b2f06d44193cf"} May 21 14:10:17.309736 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:17.309689 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-xzqj2" podStartSLOduration=1.309676391 podStartE2EDuration="1.309676391s" podCreationTimestamp="2026-05-21 14:10:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:10:17.307266913 +0000 UTC m=+383.759580421" watchObservedRunningTime="2026-05-21 14:10:17.309676391 +0000 UTC m=+383.761989900" May 21 14:10:28.274235 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.274206 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb"] May 21 14:10:28.318643 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.318612 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb"] May 21 14:10:28.318795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.318738 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.326354 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.326074 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:10:28.326354 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.326173 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:10:28.326491 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.326399 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qmb4z\"" May 21 14:10:28.326698 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.326684 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:10:28.326819 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.326801 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:10:28.424591 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.424558 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.424591 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.424589 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.424770 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.424610 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzkjg\" (UniqueName: \"kubernetes.io/projected/44dff7a3-c758-48c7-bb29-73637e417d15-kube-api-access-gzkjg\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.525643 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.525578 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.525643 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.525608 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.525777 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.525650 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzkjg\" (UniqueName: \"kubernetes.io/projected/44dff7a3-c758-48c7-bb29-73637e417d15-kube-api-access-gzkjg\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.528060 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.528038 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.528149 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.528083 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44dff7a3-c758-48c7-bb29-73637e417d15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.540288 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.540260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzkjg\" (UniqueName: \"kubernetes.io/projected/44dff7a3-c758-48c7-bb29-73637e417d15-kube-api-access-gzkjg\") pod \"opendatahub-operator-controller-manager-7c7bd478c6-5d4bb\" (UID: \"44dff7a3-c758-48c7-bb29-73637e417d15\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.629454 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.629418 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:28.818571 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:28.818479 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb"] May 21 14:10:28.821068 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:10:28.821039 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dff7a3_c758_48c7_bb29_73637e417d15.slice/crio-643ab6c55848030905d5e0d62e700cc67f36a59a807c9d7cc21600c3b3483269 WatchSource:0}: Error finding container 643ab6c55848030905d5e0d62e700cc67f36a59a807c9d7cc21600c3b3483269: Status 404 returned error can't find the container with id 643ab6c55848030905d5e0d62e700cc67f36a59a807c9d7cc21600c3b3483269 May 21 14:10:29.327533 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:29.327503 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" event={"ID":"44dff7a3-c758-48c7-bb29-73637e417d15","Type":"ContainerStarted","Data":"643ab6c55848030905d5e0d62e700cc67f36a59a807c9d7cc21600c3b3483269"} May 21 14:10:32.339975 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:32.339938 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" event={"ID":"44dff7a3-c758-48c7-bb29-73637e417d15","Type":"ContainerStarted","Data":"c1c7084234b8fbb2bbd688bf254ab94edd2415b3dfe2f759143e59d5b415f536"} May 21 14:10:32.340383 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:32.340006 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:32.388149 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:32.388099 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" podStartSLOduration=1.802902027 podStartE2EDuration="4.388085739s" podCreationTimestamp="2026-05-21 14:10:28 +0000 UTC" firstStartedPulling="2026-05-21 14:10:28.822992198 +0000 UTC m=+395.275305686" lastFinishedPulling="2026-05-21 14:10:31.408175911 +0000 UTC m=+397.860489398" observedRunningTime="2026-05-21 14:10:32.386037364 +0000 UTC m=+398.838350885" watchObservedRunningTime="2026-05-21 14:10:32.388085739 +0000 UTC m=+398.840399248" May 21 14:10:43.345099 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:43.345071 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd478c6-5d4bb" May 21 14:10:49.731592 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.731550 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-j4tp4"] May 21 14:10:49.735046 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.735027 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:49.738574 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.738550 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kw2qr\"" May 21 14:10:49.738685 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.738554 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 14:10:49.745456 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.745412 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-j4tp4"] May 21 14:10:49.894179 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.894142 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:49.894365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.894247 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-495zf\" (UniqueName: \"kubernetes.io/projected/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-kube-api-access-495zf\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:49.995456 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.995368 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:49.995595 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:49.995478 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-495zf\" (UniqueName: \"kubernetes.io/projected/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-kube-api-access-495zf\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:49.995595 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:10:49.995515 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 14:10:49.995664 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:10:49.995600 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert podName:3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38 nodeName:}" failed. No retries permitted until 2026-05-21 14:10:50.495583723 +0000 UTC m=+416.947897210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert") pod "odh-model-controller-858dbf95b8-j4tp4" (UID: "3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38") : secret "odh-model-controller-webhook-cert" not found May 21 14:10:50.012880 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:50.012856 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-495zf\" (UniqueName: \"kubernetes.io/projected/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-kube-api-access-495zf\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:50.499441 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:50.499409 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:50.501728 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:50.501709 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38-cert\") pod \"odh-model-controller-858dbf95b8-j4tp4\" (UID: \"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38\") " pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:50.648923 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:50.648889 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:10:50.777865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:50.777835 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-j4tp4"] May 21 14:10:50.780307 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:10:50.780272 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3547a1ec_0cf4_4e26_84c4_7c20f0cc0a38.slice/crio-e0188ac540538e66602a1acb60bd433f82608c30a081fea897a08796a1f6731e WatchSource:0}: Error finding container e0188ac540538e66602a1acb60bd433f82608c30a081fea897a08796a1f6731e: Status 404 returned error can't find the container with id e0188ac540538e66602a1acb60bd433f82608c30a081fea897a08796a1f6731e May 21 14:10:51.402760 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:51.402722 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" event={"ID":"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38","Type":"ContainerStarted","Data":"e0188ac540538e66602a1acb60bd433f82608c30a081fea897a08796a1f6731e"} May 21 14:10:52.050875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.050840 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q"] May 21 14:10:52.054110 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.054089 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.063727 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.063706 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 14:10:52.063854 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.063727 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 14:10:52.063854 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.063735 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 14:10:52.064889 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.064871 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 14:10:52.064961 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.064871 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w58zt\"" May 21 14:10:52.065017 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.064965 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 14:10:52.099008 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.098976 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q"] May 21 14:10:52.213398 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.213360 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-metrics-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.213569 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.213482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0493d9fc-a32f-41ca-872b-a71adfabed0f-manager-config\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.213569 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.213534 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.213662 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.213565 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkll\" (UniqueName: \"kubernetes.io/projected/0493d9fc-a32f-41ca-872b-a71adfabed0f-kube-api-access-ntkll\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.314100 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.314072 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0493d9fc-a32f-41ca-872b-a71adfabed0f-manager-config\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.314281 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.314259 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.314375 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.314291 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkll\" (UniqueName: \"kubernetes.io/projected/0493d9fc-a32f-41ca-872b-a71adfabed0f-kube-api-access-ntkll\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.314459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.314439 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-metrics-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.314915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.314889 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0493d9fc-a32f-41ca-872b-a71adfabed0f-manager-config\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.316606 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.316580 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.316717 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.316695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0493d9fc-a32f-41ca-872b-a71adfabed0f-metrics-cert\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.328879 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.328856 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkll\" (UniqueName: \"kubernetes.io/projected/0493d9fc-a32f-41ca-872b-a71adfabed0f-kube-api-access-ntkll\") pod \"lws-controller-manager-7454667d6f-dnb8q\" (UID: \"0493d9fc-a32f-41ca-872b-a71adfabed0f\") " pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.363440 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.363400 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:52.531263 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:52.531226 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q"] May 21 14:10:52.533493 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:10:52.533463 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0493d9fc_a32f_41ca_872b_a71adfabed0f.slice/crio-5b92207aeb0150a707424b0b617fd6f0edcc11269c279e924fe5c6fc5c787f1e WatchSource:0}: Error finding container 5b92207aeb0150a707424b0b617fd6f0edcc11269c279e924fe5c6fc5c787f1e: Status 404 returned error can't find the container with id 5b92207aeb0150a707424b0b617fd6f0edcc11269c279e924fe5c6fc5c787f1e May 21 14:10:53.411005 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:53.410970 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" event={"ID":"0493d9fc-a32f-41ca-872b-a71adfabed0f","Type":"ContainerStarted","Data":"5b92207aeb0150a707424b0b617fd6f0edcc11269c279e924fe5c6fc5c787f1e"} May 21 14:10:54.417445 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:54.417408 2549 generic.go:358] "Generic (PLEG): container finished" podID="3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38" containerID="3233b0f7d125a419c6261a22bbe6257b15dde6ba6e3bd668354e118698d98f5e" exitCode=1 May 21 14:10:54.417840 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:54.417483 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" event={"ID":"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38","Type":"ContainerDied","Data":"3233b0f7d125a419c6261a22bbe6257b15dde6ba6e3bd668354e118698d98f5e"} May 21 14:10:54.417840 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:54.417736 2549 scope.go:117] "RemoveContainer" containerID="3233b0f7d125a419c6261a22bbe6257b15dde6ba6e3bd668354e118698d98f5e" May 21 14:10:56.426294 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.426249 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" event={"ID":"0493d9fc-a32f-41ca-872b-a71adfabed0f","Type":"ContainerStarted","Data":"fed08ea001474c817e6bf8b1f6449fc081d21a0e81eb899be776f1bccae346f3"} May 21 14:10:56.426798 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.426402 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:10:56.427904 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.427878 2549 generic.go:358] "Generic (PLEG): container finished" podID="3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38" containerID="e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a" exitCode=1 May 21 14:10:56.428001 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.427951 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" event={"ID":"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38","Type":"ContainerDied","Data":"e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a"} May 21 14:10:56.428001 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.427977 2549 scope.go:117] "RemoveContainer" containerID="3233b0f7d125a419c6261a22bbe6257b15dde6ba6e3bd668354e118698d98f5e" May 21 14:10:56.428330 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.428192 2549 scope.go:117] "RemoveContainer" containerID="e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a" May 21 14:10:56.428430 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:10:56.428411 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-j4tp4_opendatahub(3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" podUID="3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38" May 21 14:10:56.452674 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:56.452631 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" podStartSLOduration=1.273131164 podStartE2EDuration="4.452621031s" podCreationTimestamp="2026-05-21 14:10:52 +0000 UTC" firstStartedPulling="2026-05-21 14:10:52.535708893 +0000 UTC m=+418.988022385" lastFinishedPulling="2026-05-21 14:10:55.715198765 +0000 UTC m=+422.167512252" observedRunningTime="2026-05-21 14:10:56.449998086 +0000 UTC m=+422.902311593" watchObservedRunningTime="2026-05-21 14:10:56.452621031 +0000 UTC m=+422.904934539" May 21 14:10:57.433063 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:10:57.433031 2549 scope.go:117] "RemoveContainer" containerID="e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a" May 21 14:10:57.433438 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:10:57.433201 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-j4tp4_opendatahub(3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" podUID="3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38" May 21 14:11:00.649201 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:00.649161 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:11:00.649607 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:00.649508 2549 scope.go:117] "RemoveContainer" containerID="e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a" May 21 14:11:00.649680 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:11:00.649664 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-j4tp4_opendatahub(3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38)\"" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" podUID="3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38" May 21 14:11:07.435915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:07.435825 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7454667d6f-dnb8q" May 21 14:11:10.649689 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:10.649657 2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:11:10.650059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:10.650041 2549 scope.go:117] "RemoveContainer" containerID="e77c25736300fbd0df978096e3a5772bae4cf2df8bf28398257a62cf9b2bcf5a" May 21 14:11:11.478789 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:11.478759 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" event={"ID":"3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38","Type":"ContainerStarted","Data":"de14ed5bdac4f5a99819f00f7d1c3c5fe5ac26830234a030160f53e737717dab"} May 21 14:11:11.479081 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:11.479061 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:11:11.509776 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:11.509733 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" podStartSLOduration=2.398389208 podStartE2EDuration="22.509721833s" podCreationTimestamp="2026-05-21 14:10:49 +0000 UTC" firstStartedPulling="2026-05-21 14:10:50.781548875 +0000 UTC m=+417.233862362" lastFinishedPulling="2026-05-21 14:11:10.892881491 +0000 UTC m=+437.345194987" observedRunningTime="2026-05-21 14:11:11.508822505 +0000 UTC m=+437.961136014" watchObservedRunningTime="2026-05-21 14:11:11.509721833 +0000 UTC m=+437.962035339" May 21 14:11:22.485686 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:22.485650 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-j4tp4" May 21 14:11:27.387029 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.386995 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:27.454182 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.454155 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:27.454365 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.454266 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.457124 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.457106 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ddsqh\"" May 21 14:11:27.457200 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.457106 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 14:11:27.522063 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522039 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522173 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522080 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522173 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522098 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522173 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522114 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvcx8\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522333 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522177 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522333 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522257 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522333 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522296 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522514 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522335 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.522514 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.522390 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623176 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623141 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623176 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623176 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623260 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623304 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623323 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623360 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcx8\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623412 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623388 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623666 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623429 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623666 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623456 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623792 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623768 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623883 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623855 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623997 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623954 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.623997 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.623966 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.624150 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.624132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.625606 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.625583 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.625694 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.625677 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.637434 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.637386 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.637512 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.637462 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvcx8\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44t6knp\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.764099 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.764068 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:27.899526 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:27.899500 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:27.901433 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:11:27.901398 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66ec1e9_624b_41a8_be6c_9214c9484511.slice/crio-d18bf7e381c818bf019e0bafc2c8001a7487f0f585588e1311f57fa9c0106cb1 WatchSource:0}: Error finding container d18bf7e381c818bf019e0bafc2c8001a7487f0f585588e1311f57fa9c0106cb1: Status 404 returned error can't find the container with id d18bf7e381c818bf019e0bafc2c8001a7487f0f585588e1311f57fa9c0106cb1 May 21 14:11:28.544018 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:28.543987 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" event={"ID":"d66ec1e9-624b-41a8-be6c-9214c9484511","Type":"ContainerStarted","Data":"d18bf7e381c818bf019e0bafc2c8001a7487f0f585588e1311f57fa9c0106cb1"} May 21 14:11:31.182995 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.182936 2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 14:11:31.183223 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.183037 2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 14:11:31.183223 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.183067 2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 21 14:11:31.556460 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.556378 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" event={"ID":"d66ec1e9-624b-41a8-be6c-9214c9484511","Type":"ContainerStarted","Data":"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3"} May 21 14:11:31.578078 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.578025 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podStartSLOduration=1.298805613 podStartE2EDuration="4.578007951s" podCreationTimestamp="2026-05-21 14:11:27 +0000 UTC" firstStartedPulling="2026-05-21 14:11:27.903460854 +0000 UTC m=+454.355774341" lastFinishedPulling="2026-05-21 14:11:31.182663187 +0000 UTC m=+457.634976679" observedRunningTime="2026-05-21 14:11:31.575268014 +0000 UTC m=+458.027581522" watchObservedRunningTime="2026-05-21 14:11:31.578007951 +0000 UTC m=+458.030321462" May 21 14:11:31.764872 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:31.764838 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:32.765699 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:32.765666 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:32.766036 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:32.765719 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:33.764350 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:33.764316 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:33.764512 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:33.764391 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:34.765002 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:34.764968 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:34.765390 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:34.765017 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:35.764693 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:35.764656 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:35.764898 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:35.764723 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:36.764392 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:36.764361 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:36.764738 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:36.764414 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:37.764536 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:37.764491 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:37.765009 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:37.764553 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:38.764484 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:38.764447 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:38.764656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:38.764502 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:39.765226 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:39.765192 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:39.765618 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:39.765253 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:40.764983 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:40.764949 2549 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= May 21 14:11:40.765155 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:40.765011 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" May 21 14:11:41.249086 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:41.249048 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:41.249449 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:41.249286 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" containerID="cri-o://525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3" gracePeriod=30 May 21 14:11:42.764592 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:42.764563 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:46.488465 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.488441 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:46.587076 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587047 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587076 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587079 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvcx8\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587108 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587140 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587178 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587222 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587277 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587245 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587581 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587285 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587581 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587328 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo\") pod \"d66ec1e9-624b-41a8-be6c-9214c9484511\" (UID: \"d66ec1e9-624b-41a8-be6c-9214c9484511\") " May 21 14:11:46.587683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587325 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data" (OuterVolumeSpecName: "istio-data") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:11:46.587683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587368 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:11:46.587683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587424 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:11:46.587683 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587519 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:11:46.587897 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.587692 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:11:46.589645 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.589608 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:11:46.589751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.589685 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" May 21 14:11:46.589751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.589698 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token" (OuterVolumeSpecName: "istio-token") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:11:46.589751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.589726 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8" (OuterVolumeSpecName: "kube-api-access-kvcx8") pod "d66ec1e9-624b-41a8-be6c-9214c9484511" (UID: "d66ec1e9-624b-41a8-be6c-9214c9484511"). InnerVolumeSpecName "kube-api-access-kvcx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:11:46.604782 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.604756 2549 generic.go:358] "Generic (PLEG): container finished" podID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerID="525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3" exitCode=0 May 21 14:11:46.604874 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.604815 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" May 21 14:11:46.604874 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.604827 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" event={"ID":"d66ec1e9-624b-41a8-be6c-9214c9484511","Type":"ContainerDied","Data":"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3"} May 21 14:11:46.604874 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.604860 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp" event={"ID":"d66ec1e9-624b-41a8-be6c-9214c9484511","Type":"ContainerDied","Data":"d18bf7e381c818bf019e0bafc2c8001a7487f0f585588e1311f57fa9c0106cb1"} May 21 14:11:46.604975 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.604877 2549 scope.go:117] "RemoveContainer" containerID="525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3" May 21 14:11:46.613698 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.613682 2549 scope.go:117] "RemoveContainer" containerID="525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3" May 21 14:11:46.613931 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:11:46.613916 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3\": container with ID starting with 525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3 not found: ID does not exist" containerID="525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3" May 21 14:11:46.613978 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.613938 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3"} err="failed to get container status \"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3\": rpc error: code = NotFound desc = could not find container \"525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3\": container with ID starting with 525ec294bc350ade0c349f3768d26fb41fc4f97a0b92387e32355ab885b7dea3 not found: ID does not exist" May 21 14:11:46.627154 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.627134 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:46.633458 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.633438 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44t6knp"] May 21 14:11:46.688000 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.687977 2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66ec1e9-624b-41a8-be6c-9214c9484511-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688000 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.687996 2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688005 2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688016 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvcx8\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-kube-api-access-kvcx8\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688027 2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688035 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688043 2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688051 2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.688130 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.688060 2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66ec1e9-624b-41a8-be6c-9214c9484511-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:46.726206 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.726185 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:46.726540 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.726527 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" May 21 14:11:46.726593 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.726544 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" May 21 14:11:46.726632 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.726607 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" containerName="istio-proxy" May 21 14:11:46.729386 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.729369 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:46.732025 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.732006 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:11:46.732141 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.732064 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:11:46.732350 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.732320 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cslgt\"" May 21 14:11:46.737992 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.737967 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:46.890097 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.890014 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv6t\" (UniqueName: \"kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t\") pod \"kuadrant-operator-catalog-7fphg\" (UID: \"2ece2c01-179b-42b2-a54d-58e6788a2700\") " pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:46.991041 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.990998 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv6t\" (UniqueName: \"kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t\") pod \"kuadrant-operator-catalog-7fphg\" (UID: \"2ece2c01-179b-42b2-a54d-58e6788a2700\") " pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:46.999476 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:46.999455 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv6t\" (UniqueName: \"kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t\") pod \"kuadrant-operator-catalog-7fphg\" (UID: \"2ece2c01-179b-42b2-a54d-58e6788a2700\") " pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:47.039534 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.039506 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:47.097089 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.097059 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:47.169484 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.169460 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:47.170404 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:11:47.170377 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ece2c01_179b_42b2_a54d_58e6788a2700.slice/crio-c715888463cb7bece740de44b59c8bdf17b844372e579dd38603e2d8bf16cdd6 WatchSource:0}: Error finding container c715888463cb7bece740de44b59c8bdf17b844372e579dd38603e2d8bf16cdd6: Status 404 returned error can't find the container with id c715888463cb7bece740de44b59c8bdf17b844372e579dd38603e2d8bf16cdd6 May 21 14:11:47.303535 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.303506 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdsdf"] May 21 14:11:47.306373 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.306359 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:47.316072 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.316051 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdsdf"] May 21 14:11:47.393615 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.393588 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swkb7\" (UniqueName: \"kubernetes.io/projected/4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2-kube-api-access-swkb7\") pod \"kuadrant-operator-catalog-qdsdf\" (UID: \"4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2\") " pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:47.494937 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.494851 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swkb7\" (UniqueName: \"kubernetes.io/projected/4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2-kube-api-access-swkb7\") pod \"kuadrant-operator-catalog-qdsdf\" (UID: \"4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2\") " pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:47.502944 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.502920 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swkb7\" (UniqueName: \"kubernetes.io/projected/4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2-kube-api-access-swkb7\") pod \"kuadrant-operator-catalog-qdsdf\" (UID: \"4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2\") " pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:47.608776 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.608740 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" event={"ID":"2ece2c01-179b-42b2-a54d-58e6788a2700","Type":"ContainerStarted","Data":"c715888463cb7bece740de44b59c8bdf17b844372e579dd38603e2d8bf16cdd6"} May 21 14:11:47.615640 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.615618 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:47.759024 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:47.758995 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qdsdf"] May 21 14:11:47.761265 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:11:47.761238 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d55e793_edd4_4f2f_a8a4_6a7240bf1ee2.slice/crio-a0acaeeb7bb22bbf14c9291daa2465e91fadc3be1c721acefbf049e68e18e2c2 WatchSource:0}: Error finding container a0acaeeb7bb22bbf14c9291daa2465e91fadc3be1c721acefbf049e68e18e2c2: Status 404 returned error can't find the container with id a0acaeeb7bb22bbf14c9291daa2465e91fadc3be1c721acefbf049e68e18e2c2 May 21 14:11:48.176679 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:48.176639 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66ec1e9-624b-41a8-be6c-9214c9484511" path="/var/lib/kubelet/pods/d66ec1e9-624b-41a8-be6c-9214c9484511/volumes" May 21 14:11:48.614928 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:48.614890 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" event={"ID":"4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2","Type":"ContainerStarted","Data":"a0acaeeb7bb22bbf14c9291daa2465e91fadc3be1c721acefbf049e68e18e2c2"} May 21 14:11:50.626360 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.626303 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" event={"ID":"2ece2c01-179b-42b2-a54d-58e6788a2700","Type":"ContainerStarted","Data":"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e"} May 21 14:11:50.626845 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.626427 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" podUID="2ece2c01-179b-42b2-a54d-58e6788a2700" containerName="registry-server" containerID="cri-o://a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e" gracePeriod=2 May 21 14:11:50.627772 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.627747 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" event={"ID":"4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2","Type":"ContainerStarted","Data":"8bf923cf18b1c98fa8eb44bf05a64db83cd7294f2f4fd045a5f48b4c8009e7ef"} May 21 14:11:50.643468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.643432 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" podStartSLOduration=2.019216673 podStartE2EDuration="4.64342075s" podCreationTimestamp="2026-05-21 14:11:46 +0000 UTC" firstStartedPulling="2026-05-21 14:11:47.171705651 +0000 UTC m=+473.624019138" lastFinishedPulling="2026-05-21 14:11:49.795909729 +0000 UTC m=+476.248223215" observedRunningTime="2026-05-21 14:11:50.64146519 +0000 UTC m=+477.093778699" watchObservedRunningTime="2026-05-21 14:11:50.64342075 +0000 UTC m=+477.095734258" May 21 14:11:50.663580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.663544 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" podStartSLOduration=1.633924111 podStartE2EDuration="3.663533979s" podCreationTimestamp="2026-05-21 14:11:47 +0000 UTC" firstStartedPulling="2026-05-21 14:11:47.762779237 +0000 UTC m=+474.215092728" lastFinishedPulling="2026-05-21 14:11:49.792389108 +0000 UTC m=+476.244702596" observedRunningTime="2026-05-21 14:11:50.66351093 +0000 UTC m=+477.115824440" watchObservedRunningTime="2026-05-21 14:11:50.663533979 +0000 UTC m=+477.115847488" May 21 14:11:50.868248 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.868227 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:50.923453 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.923386 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzv6t\" (UniqueName: \"kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t\") pod \"2ece2c01-179b-42b2-a54d-58e6788a2700\" (UID: \"2ece2c01-179b-42b2-a54d-58e6788a2700\") " May 21 14:11:50.925476 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:50.925456 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t" (OuterVolumeSpecName: "kube-api-access-kzv6t") pod "2ece2c01-179b-42b2-a54d-58e6788a2700" (UID: "2ece2c01-179b-42b2-a54d-58e6788a2700"). InnerVolumeSpecName "kube-api-access-kzv6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:11:51.024863 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.024838 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzv6t\" (UniqueName: \"kubernetes.io/projected/2ece2c01-179b-42b2-a54d-58e6788a2700-kube-api-access-kzv6t\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:11:51.632521 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.632486 2549 generic.go:358] "Generic (PLEG): container finished" podID="2ece2c01-179b-42b2-a54d-58e6788a2700" containerID="a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e" exitCode=0 May 21 14:11:51.632945 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.632543 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" May 21 14:11:51.632945 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.632551 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" event={"ID":"2ece2c01-179b-42b2-a54d-58e6788a2700","Type":"ContainerDied","Data":"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e"} May 21 14:11:51.632945 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.632589 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7fphg" event={"ID":"2ece2c01-179b-42b2-a54d-58e6788a2700","Type":"ContainerDied","Data":"c715888463cb7bece740de44b59c8bdf17b844372e579dd38603e2d8bf16cdd6"} May 21 14:11:51.632945 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.632606 2549 scope.go:117] "RemoveContainer" containerID="a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e" May 21 14:11:51.641656 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.641641 2549 scope.go:117] "RemoveContainer" containerID="a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e" May 21 14:11:51.641896 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:11:51.641879 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e\": container with ID starting with a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e not found: ID does not exist" containerID="a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e" May 21 14:11:51.641945 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.641905 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e"} err="failed to get container status \"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e\": rpc error: code = NotFound desc = could not find container \"a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e\": container with ID starting with a03a6c2d7556cecf62730fea48d850b55e30ba812c9aebb282090ec749984e1e not found: ID does not exist" May 21 14:11:51.654179 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.654155 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:51.657727 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:51.657704 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7fphg"] May 21 14:11:52.175647 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:52.175620 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ece2c01-179b-42b2-a54d-58e6788a2700" path="/var/lib/kubelet/pods/2ece2c01-179b-42b2-a54d-58e6788a2700/volumes" May 21 14:11:57.616278 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:57.616245 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:57.616278 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:57.616286 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:57.637877 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:57.637854 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:11:57.672221 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:11:57.672198 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qdsdf" May 21 14:12:12.912563 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.912509 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk"] May 21 14:12:12.913080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.913060 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ece2c01-179b-42b2-a54d-58e6788a2700" containerName="registry-server" May 21 14:12:12.913154 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.913084 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ece2c01-179b-42b2-a54d-58e6788a2700" containerName="registry-server" May 21 14:12:12.913205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.913164 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ece2c01-179b-42b2-a54d-58e6788a2700" containerName="registry-server" May 21 14:12:12.915159 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.915140 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:12.917733 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.917714 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 14:12:12.918151 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.918134 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lw6lf\"" May 21 14:12:12.928517 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:12.928497 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk"] May 21 14:12:13.018915 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.018884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb6wx\" (UniqueName: \"kubernetes.io/projected/4e073eba-a829-4051-8cbe-21b5e0b620da-kube-api-access-sb6wx\") pod \"dns-operator-controller-manager-648d5c98bc-k76qk\" (UID: \"4e073eba-a829-4051-8cbe-21b5e0b620da\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:13.120025 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.119991 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sb6wx\" (UniqueName: \"kubernetes.io/projected/4e073eba-a829-4051-8cbe-21b5e0b620da-kube-api-access-sb6wx\") pod \"dns-operator-controller-manager-648d5c98bc-k76qk\" (UID: \"4e073eba-a829-4051-8cbe-21b5e0b620da\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:13.128548 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.128518 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb6wx\" (UniqueName: \"kubernetes.io/projected/4e073eba-a829-4051-8cbe-21b5e0b620da-kube-api-access-sb6wx\") pod \"dns-operator-controller-manager-648d5c98bc-k76qk\" (UID: \"4e073eba-a829-4051-8cbe-21b5e0b620da\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:13.225190 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.225090 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:13.360078 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.360053 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk"] May 21 14:12:13.362563 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:13.362525 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e073eba_a829_4051_8cbe_21b5e0b620da.slice/crio-4b16ba16d8c808342e4406a827e7bbf0c4f8aa23b3d9b7d3c95fc702d2bc3096 WatchSource:0}: Error finding container 4b16ba16d8c808342e4406a827e7bbf0c4f8aa23b3d9b7d3c95fc702d2bc3096: Status 404 returned error can't find the container with id 4b16ba16d8c808342e4406a827e7bbf0c4f8aa23b3d9b7d3c95fc702d2bc3096 May 21 14:12:13.705901 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:13.705865 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" event={"ID":"4e073eba-a829-4051-8cbe-21b5e0b620da","Type":"ContainerStarted","Data":"4b16ba16d8c808342e4406a827e7bbf0c4f8aa23b3d9b7d3c95fc702d2bc3096"} May 21 14:12:16.719525 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.719486 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" event={"ID":"4e073eba-a829-4051-8cbe-21b5e0b620da","Type":"ContainerStarted","Data":"acd07af9d727210fceb0686e8afb339e43210030bce1f270c3978e54697f2127"} May 21 14:12:16.719921 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.719614 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:16.737870 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.737822 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" podStartSLOduration=2.304074931 podStartE2EDuration="4.737811219s" podCreationTimestamp="2026-05-21 14:12:12 +0000 UTC" firstStartedPulling="2026-05-21 14:12:13.364524839 +0000 UTC m=+499.816838327" lastFinishedPulling="2026-05-21 14:12:15.798261125 +0000 UTC m=+502.250574615" observedRunningTime="2026-05-21 14:12:16.737083035 +0000 UTC m=+503.189396543" watchObservedRunningTime="2026-05-21 14:12:16.737811219 +0000 UTC m=+503.190124728" May 21 14:12:16.938078 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.938045 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv"] May 21 14:12:16.940449 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.940433 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:16.944459 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:16.944435 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tkzgj\"" May 21 14:12:17.017542 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.017475 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv"] May 21 14:12:17.057268 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.057240 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6pk5\" (UniqueName: \"kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5\") pod \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" (UID: \"d414181a-aaee-4077-aa18-f5cc0b46b35f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:17.158599 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.158563 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6pk5\" (UniqueName: \"kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5\") pod \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" (UID: \"d414181a-aaee-4077-aa18-f5cc0b46b35f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:17.169194 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.169167 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6pk5\" (UniqueName: \"kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5\") pod \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" (UID: \"d414181a-aaee-4077-aa18-f5cc0b46b35f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:17.252171 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.252133 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:17.381677 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.381651 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv"] May 21 14:12:17.383715 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:17.383685 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd414181a_aaee_4077_aa18_f5cc0b46b35f.slice/crio-8979b35686a32bd758101ae678092dc137bee8848ea682d3d78be1e91d7fdb78 WatchSource:0}: Error finding container 8979b35686a32bd758101ae678092dc137bee8848ea682d3d78be1e91d7fdb78: Status 404 returned error can't find the container with id 8979b35686a32bd758101ae678092dc137bee8848ea682d3d78be1e91d7fdb78 May 21 14:12:17.724366 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:17.724310 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" event={"ID":"d414181a-aaee-4077-aa18-f5cc0b46b35f","Type":"ContainerStarted","Data":"8979b35686a32bd758101ae678092dc137bee8848ea682d3d78be1e91d7fdb78"} May 21 14:12:19.734204 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:19.734166 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" event={"ID":"d414181a-aaee-4077-aa18-f5cc0b46b35f","Type":"ContainerStarted","Data":"cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a"} May 21 14:12:19.734591 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:19.734298 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:19.761794 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:19.761741 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" podStartSLOduration=1.8767173129999999 podStartE2EDuration="3.76172775s" podCreationTimestamp="2026-05-21 14:12:16 +0000 UTC" firstStartedPulling="2026-05-21 14:12:17.385580665 +0000 UTC m=+503.837894151" lastFinishedPulling="2026-05-21 14:12:19.270591101 +0000 UTC m=+505.722904588" observedRunningTime="2026-05-21 14:12:19.761324047 +0000 UTC m=+506.213637563" watchObservedRunningTime="2026-05-21 14:12:19.76172775 +0000 UTC m=+506.214041260" May 21 14:12:27.726795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:27.726766 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k76qk" May 21 14:12:30.743639 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:30.743614 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:31.027400 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.027317 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h"] May 21 14:12:31.033990 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.033974 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.036576 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.036557 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 14:12:31.036687 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.036560 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 14:12:31.036752 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.036686 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lll8n\"" May 21 14:12:31.041448 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.041165 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h"] May 21 14:12:31.081148 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.081120 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42wf\" (UniqueName: \"kubernetes.io/projected/f9feef40-9f4a-44da-9be3-3f971bbf7fff-kube-api-access-s42wf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.081245 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.081156 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9feef40-9f4a-44da-9be3-3f971bbf7fff-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.081305 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.081287 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.182144 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.182118 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.182253 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.182154 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s42wf\" (UniqueName: \"kubernetes.io/projected/f9feef40-9f4a-44da-9be3-3f971bbf7fff-kube-api-access-s42wf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.182253 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.182180 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9feef40-9f4a-44da-9be3-3f971bbf7fff-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.182327 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:12:31.182251 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 14:12:31.182327 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:12:31.182322 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert podName:f9feef40-9f4a-44da-9be3-3f971bbf7fff nodeName:}" failed. No retries permitted until 2026-05-21 14:12:31.682305781 +0000 UTC m=+518.134619268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-mlb5h" (UID: "f9feef40-9f4a-44da-9be3-3f971bbf7fff") : secret "plugin-serving-cert" not found May 21 14:12:31.182852 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.182835 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9feef40-9f4a-44da-9be3-3f971bbf7fff-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.195032 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.195009 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42wf\" (UniqueName: \"kubernetes.io/projected/f9feef40-9f4a-44da-9be3-3f971bbf7fff-kube-api-access-s42wf\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.685539 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.685499 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:31.685767 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:12:31.685709 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 14:12:31.685849 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:12:31.685790 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert podName:f9feef40-9f4a-44da-9be3-3f971bbf7fff nodeName:}" failed. No retries permitted until 2026-05-21 14:12:32.685767995 +0000 UTC m=+519.138081497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-mlb5h" (UID: "f9feef40-9f4a-44da-9be3-3f971bbf7fff") : secret "plugin-serving-cert" not found May 21 14:12:31.716313 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.716279 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f59c76d7f-7q9cj"] May 21 14:12:31.719764 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.719746 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.735104 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.735080 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f59c76d7f-7q9cj"] May 21 14:12:31.786066 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786032 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786104 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-service-ca\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786163 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-trusted-ca-bundle\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786190 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-oauth-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786215 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786252 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-oauth-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.786396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.786276 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bczm6\" (UniqueName: \"kubernetes.io/projected/7c2d4420-9cd9-42eb-96ea-6df8e540f609-kube-api-access-bczm6\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886670 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886638 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-trusted-ca-bundle\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886670 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886670 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-oauth-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886891 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886690 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886891 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886722 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-oauth-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886891 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886758 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bczm6\" (UniqueName: \"kubernetes.io/projected/7c2d4420-9cd9-42eb-96ea-6df8e540f609-kube-api-access-bczm6\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886891 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886781 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.886891 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.886828 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-service-ca\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.887572 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.887546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-service-ca\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.887690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.887574 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-oauth-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.887690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.887600 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-trusted-ca-bundle\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.887690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.887640 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.889675 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.889648 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-oauth-config\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.889885 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.889865 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c2d4420-9cd9-42eb-96ea-6df8e540f609-console-serving-cert\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:31.901810 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:31.901792 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bczm6\" (UniqueName: \"kubernetes.io/projected/7c2d4420-9cd9-42eb-96ea-6df8e540f609-kube-api-access-bczm6\") pod \"console-5f59c76d7f-7q9cj\" (UID: \"7c2d4420-9cd9-42eb-96ea-6df8e540f609\") " pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:32.029741 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.029668 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:32.167189 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.167162 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f59c76d7f-7q9cj"] May 21 14:12:32.168877 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:32.168856 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2d4420_9cd9_42eb_96ea_6df8e540f609.slice/crio-4bf74dbbed268ae1c72cf347baab7357d4ceb7025d86e805fc567161a22d1071 WatchSource:0}: Error finding container 4bf74dbbed268ae1c72cf347baab7357d4ceb7025d86e805fc567161a22d1071: Status 404 returned error can't find the container with id 4bf74dbbed268ae1c72cf347baab7357d4ceb7025d86e805fc567161a22d1071 May 21 14:12:32.694261 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.694226 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:32.696771 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.696746 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9feef40-9f4a-44da-9be3-3f971bbf7fff-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-mlb5h\" (UID: \"f9feef40-9f4a-44da-9be3-3f971bbf7fff\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:32.784509 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.784472 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f59c76d7f-7q9cj" event={"ID":"7c2d4420-9cd9-42eb-96ea-6df8e540f609","Type":"ContainerStarted","Data":"cf875eeec1e04e456cf69100c6cb85aafe2bb49f6fb16a8543f8b81be50cd75f"} May 21 14:12:32.784682 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.784515 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f59c76d7f-7q9cj" event={"ID":"7c2d4420-9cd9-42eb-96ea-6df8e540f609","Type":"ContainerStarted","Data":"4bf74dbbed268ae1c72cf347baab7357d4ceb7025d86e805fc567161a22d1071"} May 21 14:12:32.806010 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.805968 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f59c76d7f-7q9cj" podStartSLOduration=1.805953946 podStartE2EDuration="1.805953946s" podCreationTimestamp="2026-05-21 14:12:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:12:32.804475289 +0000 UTC m=+519.256788802" watchObservedRunningTime="2026-05-21 14:12:32.805953946 +0000 UTC m=+519.258267455" May 21 14:12:32.844468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.844440 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" May 21 14:12:32.976424 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:32.976379 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h"] May 21 14:12:32.978824 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:32.978792 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9feef40_9f4a_44da_9be3_3f971bbf7fff.slice/crio-1555e10bedfe9d2ba79a9e9c66d6b2c20480758532a18da1776771454e8d1658 WatchSource:0}: Error finding container 1555e10bedfe9d2ba79a9e9c66d6b2c20480758532a18da1776771454e8d1658: Status 404 returned error can't find the container with id 1555e10bedfe9d2ba79a9e9c66d6b2c20480758532a18da1776771454e8d1658 May 21 14:12:33.790132 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:33.790092 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" event={"ID":"f9feef40-9f4a-44da-9be3-3f971bbf7fff","Type":"ContainerStarted","Data":"1555e10bedfe9d2ba79a9e9c66d6b2c20480758532a18da1776771454e8d1658"} May 21 14:12:41.114927 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.114850 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv"] May 21 14:12:41.115366 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.115106 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" containerName="manager" containerID="cri-o://cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a" gracePeriod=2 May 21 14:12:41.135384 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.135358 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv"] May 21 14:12:41.151558 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.151529 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6"] May 21 14:12:41.152054 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.152033 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" containerName="manager" May 21 14:12:41.152054 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.152054 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" containerName="manager" May 21 14:12:41.152244 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.152139 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" containerName="manager" May 21 14:12:41.155415 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.155395 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.171859 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.171834 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6"] May 21 14:12:41.197619 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.197586 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:41.272965 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.272934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqsq\" (UniqueName: \"kubernetes.io/projected/0b3833ed-14bc-4ccf-ad91-7f32e7702881-kube-api-access-tzqsq\") pod \"limitador-operator-controller-manager-85c4996f8c-v4vk6\" (UID: \"0b3833ed-14bc-4ccf-ad91-7f32e7702881\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.353769 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.353744 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:41.356319 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.356286 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:41.373682 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.373622 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6pk5\" (UniqueName: \"kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5\") pod \"d414181a-aaee-4077-aa18-f5cc0b46b35f\" (UID: \"d414181a-aaee-4077-aa18-f5cc0b46b35f\") " May 21 14:12:41.373820 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.373804 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqsq\" (UniqueName: \"kubernetes.io/projected/0b3833ed-14bc-4ccf-ad91-7f32e7702881-kube-api-access-tzqsq\") pod \"limitador-operator-controller-manager-85c4996f8c-v4vk6\" (UID: \"0b3833ed-14bc-4ccf-ad91-7f32e7702881\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.375843 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.375810 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5" (OuterVolumeSpecName: "kube-api-access-c6pk5") pod "d414181a-aaee-4077-aa18-f5cc0b46b35f" (UID: "d414181a-aaee-4077-aa18-f5cc0b46b35f"). InnerVolumeSpecName "kube-api-access-c6pk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:12:41.386971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.386951 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqsq\" (UniqueName: \"kubernetes.io/projected/0b3833ed-14bc-4ccf-ad91-7f32e7702881-kube-api-access-tzqsq\") pod \"limitador-operator-controller-manager-85c4996f8c-v4vk6\" (UID: \"0b3833ed-14bc-4ccf-ad91-7f32e7702881\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.475202 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.475171 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6pk5\" (UniqueName: \"kubernetes.io/projected/d414181a-aaee-4077-aa18-f5cc0b46b35f-kube-api-access-c6pk5\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:12:41.506555 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.506526 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.655966 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.655939 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6"] May 21 14:12:41.658415 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:41.658388 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3833ed_14bc_4ccf_ad91_7f32e7702881.slice/crio-74dbebb8c242c6c2400ce523d838e6a62b10e77da55c927914df676a9367eb75 WatchSource:0}: Error finding container 74dbebb8c242c6c2400ce523d838e6a62b10e77da55c927914df676a9367eb75: Status 404 returned error can't find the container with id 74dbebb8c242c6c2400ce523d838e6a62b10e77da55c927914df676a9367eb75 May 21 14:12:41.828710 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.828660 2549 generic.go:358] "Generic (PLEG): container finished" podID="d414181a-aaee-4077-aa18-f5cc0b46b35f" containerID="cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a" exitCode=0 May 21 14:12:41.829447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.828745 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" May 21 14:12:41.829447 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.828780 2549 scope.go:117] "RemoveContainer" containerID="cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a" May 21 14:12:41.830708 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.830681 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" event={"ID":"0b3833ed-14bc-4ccf-ad91-7f32e7702881","Type":"ContainerStarted","Data":"159ce9ea0ec92aa86a735ef88975f7ab4f6ff4abf6537dc7acba9bfedd8ee85d"} May 21 14:12:41.830833 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.830720 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" event={"ID":"0b3833ed-14bc-4ccf-ad91-7f32e7702881","Type":"ContainerStarted","Data":"74dbebb8c242c6c2400ce523d838e6a62b10e77da55c927914df676a9367eb75"} May 21 14:12:41.830905 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.830826 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:41.833059 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.833031 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:41.838591 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.835370 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:41.841180 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.841149 2549 scope.go:117] "RemoveContainer" containerID="cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a" May 21 14:12:41.841456 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:12:41.841427 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a\": container with ID starting with cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a not found: ID does not exist" containerID="cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a" May 21 14:12:41.841537 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.841457 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a"} err="failed to get container status \"cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a\": rpc error: code = NotFound desc = could not find container \"cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a\": container with ID starting with cb1f9b1d45d812c2064b71f8a3ad47841244b6e82e2ed7d34e5a5eb68dcbdd6a not found: ID does not exist" May 21 14:12:41.863051 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.863010 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" podStartSLOduration=0.862997473 podStartE2EDuration="862.997473ms" podCreationTimestamp="2026-05-21 14:12:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:12:41.861058818 +0000 UTC m=+528.313372321" watchObservedRunningTime="2026-05-21 14:12:41.862997473 +0000 UTC m=+528.315310983" May 21 14:12:41.864860 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:41.864829 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:42.030232 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.030149 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:42.030406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.030251 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:42.035482 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.035455 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:42.037888 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.037861 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:42.048993 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.048964 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:12:42.054029 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.054009 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.056791 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.056770 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6vps4\"" May 21 14:12:42.069069 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.069025 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:12:42.070273 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.070217 2549 status_manager.go:895] "Failed to get status for pod" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4k8nv" err="pods \"limitador-operator-controller-manager-85c4996f8c-4k8nv\" is forbidden: User \"system:node:ip-10-0-143-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-189.ec2.internal' and this object" May 21 14:12:42.080948 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.080916 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctzz\" (UniqueName: \"kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.081142 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.081110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.177230 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.177191 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d414181a-aaee-4077-aa18-f5cc0b46b35f" path="/var/lib/kubelet/pods/d414181a-aaee-4077-aa18-f5cc0b46b35f/volumes" May 21 14:12:42.181829 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.181805 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.181923 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.181904 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rctzz\" (UniqueName: \"kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.182249 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.182225 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.197674 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.197650 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctzz\" (UniqueName: \"kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lng8k\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.366127 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.366101 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:42.511555 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.511526 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:12:42.513696 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:12:42.513669 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c358ba_4f05_4f72_9a0c_fc898e09c3ce.slice/crio-22c94802554a8aad1141690e835c545b42f83e17bc4cefd0e47022197c347459 WatchSource:0}: Error finding container 22c94802554a8aad1141690e835c545b42f83e17bc4cefd0e47022197c347459: Status 404 returned error can't find the container with id 22c94802554a8aad1141690e835c545b42f83e17bc4cefd0e47022197c347459 May 21 14:12:42.834684 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.834654 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" event={"ID":"97c358ba-4f05-4f72-9a0c-fc898e09c3ce","Type":"ContainerStarted","Data":"22c94802554a8aad1141690e835c545b42f83e17bc4cefd0e47022197c347459"} May 21 14:12:42.840817 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.840790 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f59c76d7f-7q9cj" May 21 14:12:42.911051 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:42.910997 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:12:52.837869 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:52.837838 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v4vk6" May 21 14:12:59.910936 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:59.910898 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" event={"ID":"f9feef40-9f4a-44da-9be3-3f971bbf7fff","Type":"ContainerStarted","Data":"c9f220ff136e93a8d524ca7ab21bded03b6c71df62e6b235d28607c641153c9e"} May 21 14:12:59.912240 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:59.912217 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" event={"ID":"97c358ba-4f05-4f72-9a0c-fc898e09c3ce","Type":"ContainerStarted","Data":"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419"} May 21 14:12:59.912334 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:59.912312 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:12:59.929469 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:59.929420 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-mlb5h" podStartSLOduration=2.599943408 podStartE2EDuration="28.929409187s" podCreationTimestamp="2026-05-21 14:12:31 +0000 UTC" firstStartedPulling="2026-05-21 14:12:32.980447501 +0000 UTC m=+519.432760987" lastFinishedPulling="2026-05-21 14:12:59.309913279 +0000 UTC m=+545.762226766" observedRunningTime="2026-05-21 14:12:59.927239766 +0000 UTC m=+546.379553275" watchObservedRunningTime="2026-05-21 14:12:59.929409187 +0000 UTC m=+546.381722697" May 21 14:12:59.948717 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:12:59.948672 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" podStartSLOduration=1.174650705 podStartE2EDuration="17.948658336s" podCreationTimestamp="2026-05-21 14:12:42 +0000 UTC" firstStartedPulling="2026-05-21 14:12:42.516667242 +0000 UTC m=+528.968980740" lastFinishedPulling="2026-05-21 14:12:59.290674881 +0000 UTC m=+545.742988371" observedRunningTime="2026-05-21 14:12:59.945668804 +0000 UTC m=+546.397982313" watchObservedRunningTime="2026-05-21 14:12:59.948658336 +0000 UTC m=+546.400971844" May 21 14:13:07.938798 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:07.938755 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59b64598c9-sgt5g" podUID="906353b4-00ae-4d23-828d-28a04bc1ab56" containerName="console" containerID="cri-o://4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f" gracePeriod=15 May 21 14:13:08.200032 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.199974 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59b64598c9-sgt5g_906353b4-00ae-4d23-828d-28a04bc1ab56/console/0.log" May 21 14:13:08.200131 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.200032 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:13:08.319166 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319136 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319307 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319206 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319307 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319241 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319307 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319292 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319493 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319360 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319493 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319398 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmwq7\" (UniqueName: \"kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319493 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319444 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config\") pod \"906353b4-00ae-4d23-828d-28a04bc1ab56\" (UID: \"906353b4-00ae-4d23-828d-28a04bc1ab56\") " May 21 14:13:08.319645 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319524 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:13:08.319729 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319701 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config" (OuterVolumeSpecName: "console-config") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:13:08.319812 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319729 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca" (OuterVolumeSpecName: "service-ca") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:13:08.319873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319834 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.319873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319856 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.320014 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.319988 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:13:08.321608 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.321582 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:13:08.321727 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.321649 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7" (OuterVolumeSpecName: "kube-api-access-nmwq7") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "kube-api-access-nmwq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:13:08.321727 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.321682 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "906353b4-00ae-4d23-828d-28a04bc1ab56" (UID: "906353b4-00ae-4d23-828d-28a04bc1ab56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:13:08.421107 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.421080 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.421107 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.421104 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.421258 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.421114 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906353b4-00ae-4d23-828d-28a04bc1ab56-trusted-ca-bundle\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.421258 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.421124 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmwq7\" (UniqueName: \"kubernetes.io/projected/906353b4-00ae-4d23-828d-28a04bc1ab56-kube-api-access-nmwq7\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.421258 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.421132 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/906353b4-00ae-4d23-828d-28a04bc1ab56-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:13:08.943356 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943318 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59b64598c9-sgt5g_906353b4-00ae-4d23-828d-28a04bc1ab56/console/0.log" May 21 14:13:08.943748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943387 2549 generic.go:358] "Generic (PLEG): container finished" podID="906353b4-00ae-4d23-828d-28a04bc1ab56" containerID="4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f" exitCode=2 May 21 14:13:08.943748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943453 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b64598c9-sgt5g" May 21 14:13:08.943748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943458 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b64598c9-sgt5g" event={"ID":"906353b4-00ae-4d23-828d-28a04bc1ab56","Type":"ContainerDied","Data":"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f"} May 21 14:13:08.943748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943496 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b64598c9-sgt5g" event={"ID":"906353b4-00ae-4d23-828d-28a04bc1ab56","Type":"ContainerDied","Data":"96e4112758f3d35ecc100eb196f3a947dcaac6f1d48057b929faa1fb100fa82f"} May 21 14:13:08.943748 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.943511 2549 scope.go:117] "RemoveContainer" containerID="4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f" May 21 14:13:08.954185 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.954169 2549 scope.go:117] "RemoveContainer" containerID="4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f" May 21 14:13:08.954472 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:13:08.954454 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f\": container with ID starting with 4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f not found: ID does not exist" containerID="4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f" May 21 14:13:08.954523 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.954481 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f"} err="failed to get container status \"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f\": rpc error: code = NotFound desc = could not find container \"4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f\": container with ID starting with 4ad32c972b4baa856777cd6644c51eba726e3b0446990c13b3c9dd8a3cc5296f not found: ID does not exist" May 21 14:13:08.968122 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.968099 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:13:08.971367 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:08.971333 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b64598c9-sgt5g"] May 21 14:13:10.175960 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:10.175926 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="906353b4-00ae-4d23-828d-28a04bc1ab56" path="/var/lib/kubelet/pods/906353b4-00ae-4d23-828d-28a04bc1ab56/volumes" May 21 14:13:10.917738 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:10.917705 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:13:32.576494 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.576451 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:13:32.576943 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.576862 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="906353b4-00ae-4d23-828d-28a04bc1ab56" containerName="console" May 21 14:13:32.576943 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.576875 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="906353b4-00ae-4d23-828d-28a04bc1ab56" containerName="console" May 21 14:13:32.577042 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.576947 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="906353b4-00ae-4d23-828d-28a04bc1ab56" containerName="console" May 21 14:13:32.615468 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.615441 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:13:32.615610 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.615567 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.618752 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.618729 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 14:13:32.627257 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.627237 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:13:32.727098 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.727068 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2112e14-443b-4412-989d-af92b57d1b8f-config-file\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.727231 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.727119 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5tqt\" (UniqueName: \"kubernetes.io/projected/a2112e14-443b-4412-989d-af92b57d1b8f-kube-api-access-q5tqt\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.828635 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.828563 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2112e14-443b-4412-989d-af92b57d1b8f-config-file\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.828635 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.828614 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5tqt\" (UniqueName: \"kubernetes.io/projected/a2112e14-443b-4412-989d-af92b57d1b8f-kube-api-access-q5tqt\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.829152 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.829132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a2112e14-443b-4412-989d-af92b57d1b8f-config-file\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.842681 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.842654 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5tqt\" (UniqueName: \"kubernetes.io/projected/a2112e14-443b-4412-989d-af92b57d1b8f-kube-api-access-q5tqt\") pod \"limitador-limitador-78c99df468-64x8k\" (UID: \"a2112e14-443b-4412-989d-af92b57d1b8f\") " pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:32.927555 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:32.927528 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:33.078601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:33.078579 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:13:33.080146 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:13:33.080072 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2112e14_443b_4412_989d_af92b57d1b8f.slice/crio-dd3f168c8107129218e5ba5c8fdc6d9a7b72bef360d65a23a8fd46dff3eddd69 WatchSource:0}: Error finding container dd3f168c8107129218e5ba5c8fdc6d9a7b72bef360d65a23a8fd46dff3eddd69: Status 404 returned error can't find the container with id dd3f168c8107129218e5ba5c8fdc6d9a7b72bef360d65a23a8fd46dff3eddd69 May 21 14:13:34.033208 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:34.033169 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" event={"ID":"a2112e14-443b-4412-989d-af92b57d1b8f","Type":"ContainerStarted","Data":"dd3f168c8107129218e5ba5c8fdc6d9a7b72bef360d65a23a8fd46dff3eddd69"} May 21 14:13:36.040952 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:36.040859 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" event={"ID":"a2112e14-443b-4412-989d-af92b57d1b8f","Type":"ContainerStarted","Data":"c255c3920350ee28321aa4cf1b6cb1c39a4fde522f04d8879d225304dc352016"} May 21 14:13:36.041315 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:36.041015 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:36.063857 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:36.063809 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" podStartSLOduration=1.529043471 podStartE2EDuration="4.063797976s" podCreationTimestamp="2026-05-21 14:13:32 +0000 UTC" firstStartedPulling="2026-05-21 14:13:33.081728548 +0000 UTC m=+579.534042035" lastFinishedPulling="2026-05-21 14:13:35.616483052 +0000 UTC m=+582.068796540" observedRunningTime="2026-05-21 14:13:36.063601519 +0000 UTC m=+582.515915027" watchObservedRunningTime="2026-05-21 14:13:36.063797976 +0000 UTC m=+582.516111484" May 21 14:13:47.045643 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:47.045615 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-64x8k" May 21 14:13:54.073565 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:54.073535 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:13:54.073971 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:54.073686 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:13:54.079387 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:54.079363 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:13:54.079731 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:13:54.079715 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:14:44.957082 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:14:44.957037 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:15:05.398602 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:15:05.398563 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:15:23.491400 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:15:23.491363 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:15:29.604125 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:15:29.604088 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:15:40.200790 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:15:40.200719 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:16:11.002812 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:16:11.002775 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:16:26.998259 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:16:26.998217 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:16:36.802585 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:16:36.802549 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:16:45.604115 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:16:45.604083 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:16:56.095286 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:16:56.095252 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:17:04.899872 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:17:04.899836 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:17:14.903205 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:17:14.903128 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:18:28.391149 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:28.391108 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:18:43.894852 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:43.894772 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:18:54.099148 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:54.099114 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:18:54.099793 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:54.099762 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:18:54.105295 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:54.105273 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:18:54.105986 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:18:54.105965 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:19:22.290427 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:19:22.290392 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:19:40.194803 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:19:40.194769 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:19:54.095259 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:19:54.095225 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:20:09.690302 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:20:09.690212 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:20:37.695011 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:20:37.694975 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:20:41.911754 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:20:41.911719 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:21:05.101927 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:21:05.101885 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:21:13.113554 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:21:13.113519 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:21:30.520237 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:21:30.520207 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:21:39.705297 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:21:39.705212 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:21:55.536374 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:21:55.536301 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:22:03.815758 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:22:03.815722 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:22:37.022606 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:22:37.022575 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:22:45.415736 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:22:45.415696 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:22:48.931126 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:22:48.931092 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:22:53.415116 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:22:53.415083 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:23:02.604992 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:02.604956 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:23:10.841413 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:10.841323 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:23:27.722195 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:27.722162 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:23:38.609569 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:38.609538 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:23:54.124404 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:54.124313 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:23:54.126614 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:54.126593 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:23:54.130135 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:54.130117 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:23:54.132379 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:23:54.132363 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:24:29.812298 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:24:29.812264 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:24:34.625930 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:24:34.625900 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:24:42.607522 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:24:42.607442 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:24:51.005697 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:24:51.005656 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:00.803133 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:00.803099 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:08.705462 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:08.705428 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:18.699564 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:18.699530 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:26.602955 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:26.602922 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:35.196692 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:35.196654 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:44.193007 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:44.192973 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:25:52.903969 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:25:52.903937 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:01.209133 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:01.209100 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:11.406084 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:11.406006 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:19.195988 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:19.195948 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:27.900805 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:27.900767 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:36.888687 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:36.888649 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:45.490899 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:45.490865 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:26:53.430115 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:26:53.430080 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:27:45.479962 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.479867 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:27:45.480458 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.480104 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" podUID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" containerName="manager" containerID="cri-o://714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419" gracePeriod=10 May 21 14:27:45.818601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.818573 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:27:45.925100 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.925070 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume\") pod \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " May 21 14:27:45.925241 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.925142 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rctzz\" (UniqueName: \"kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz\") pod \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\" (UID: \"97c358ba-4f05-4f72-9a0c-fc898e09c3ce\") " May 21 14:27:45.925470 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.925445 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97c358ba-4f05-4f72-9a0c-fc898e09c3ce" (UID: "97c358ba-4f05-4f72-9a0c-fc898e09c3ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:27:45.927021 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:45.926995 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz" (OuterVolumeSpecName: "kube-api-access-rctzz") pod "97c358ba-4f05-4f72-9a0c-fc898e09c3ce" (UID: "97c358ba-4f05-4f72-9a0c-fc898e09c3ce"). InnerVolumeSpecName "kube-api-access-rctzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:27:46.008690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.008612 2549 generic.go:358] "Generic (PLEG): container finished" podID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" containerID="714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419" exitCode=0 May 21 14:27:46.008690 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.008668 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" event={"ID":"97c358ba-4f05-4f72-9a0c-fc898e09c3ce","Type":"ContainerDied","Data":"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419"} May 21 14:27:46.008875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.008708 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" event={"ID":"97c358ba-4f05-4f72-9a0c-fc898e09c3ce","Type":"ContainerDied","Data":"22c94802554a8aad1141690e835c545b42f83e17bc4cefd0e47022197c347459"} May 21 14:27:46.008875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.008676 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k" May 21 14:27:46.008875 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.008729 2549 scope.go:117] "RemoveContainer" containerID="714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419" May 21 14:27:46.017717 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.017701 2549 scope.go:117] "RemoveContainer" containerID="714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419" May 21 14:27:46.017944 ip-10-0-143-189 kubenswrapper[2549]: E0521 14:27:46.017926 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419\": container with ID starting with 714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419 not found: ID does not exist" containerID="714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419" May 21 14:27:46.018003 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.017958 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419"} err="failed to get container status \"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419\": rpc error: code = NotFound desc = could not find container \"714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419\": container with ID starting with 714f04a7684d690d2cae96eb027a5fd92990e8ed8a96a9768bcc3cbb9424d419 not found: ID does not exist" May 21 14:27:46.026098 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.026080 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rctzz\" (UniqueName: \"kubernetes.io/projected/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-kube-api-access-rctzz\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:27:46.026098 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.026099 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c358ba-4f05-4f72-9a0c-fc898e09c3ce-extensions-socket-volume\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:27:46.034314 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.034287 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:27:46.038873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.038854 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lng8k"] May 21 14:27:46.175838 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:27:46.175813 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" path="/var/lib/kubelet/pods/97c358ba-4f05-4f72-9a0c-fc898e09c3ce/volumes" May 21 14:28:51.565738 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.565700 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c"] May 21 14:28:51.566193 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.566054 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" containerName="manager" May 21 14:28:51.566193 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.566064 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" containerName="manager" May 21 14:28:51.566193 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.566120 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="97c358ba-4f05-4f72-9a0c-fc898e09c3ce" containerName="manager" May 21 14:28:51.568994 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.568977 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.572001 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.571983 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6vps4\"" May 21 14:28:51.586265 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.586245 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c"] May 21 14:28:51.660742 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.660719 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv2gm\" (UniqueName: \"kubernetes.io/projected/1a97b753-5c66-4ee3-9253-ee6ea9610049-kube-api-access-nv2gm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.660855 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.660753 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a97b753-5c66-4ee3-9253-ee6ea9610049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.761751 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.761721 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv2gm\" (UniqueName: \"kubernetes.io/projected/1a97b753-5c66-4ee3-9253-ee6ea9610049-kube-api-access-nv2gm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.761886 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.761770 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a97b753-5c66-4ee3-9253-ee6ea9610049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.762071 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.762055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a97b753-5c66-4ee3-9253-ee6ea9610049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.774308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.774288 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv2gm\" (UniqueName: \"kubernetes.io/projected/1a97b753-5c66-4ee3-9253-ee6ea9610049-kube-api-access-nv2gm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m7w7c\" (UID: \"1a97b753-5c66-4ee3-9253-ee6ea9610049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:51.879710 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:51.879648 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:52.009838 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.009813 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c"] May 21 14:28:52.012195 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:28:52.012162 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a97b753_5c66_4ee3_9253_ee6ea9610049.slice/crio-6798655f49a7f18877b7c4d2636299b81e01997cc7693feaf1292f3da2fb60e8 WatchSource:0}: Error finding container 6798655f49a7f18877b7c4d2636299b81e01997cc7693feaf1292f3da2fb60e8: Status 404 returned error can't find the container with id 6798655f49a7f18877b7c4d2636299b81e01997cc7693feaf1292f3da2fb60e8 May 21 14:28:52.014550 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.014534 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:28:52.239544 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.239465 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" event={"ID":"1a97b753-5c66-4ee3-9253-ee6ea9610049","Type":"ContainerStarted","Data":"ef293210b3c24bfa1e40868e4d156df880dc8ab1e7b5c4f460c47cd3f141a74c"} May 21 14:28:52.239544 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.239502 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" event={"ID":"1a97b753-5c66-4ee3-9253-ee6ea9610049","Type":"ContainerStarted","Data":"6798655f49a7f18877b7c4d2636299b81e01997cc7693feaf1292f3da2fb60e8"} May 21 14:28:52.239720 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.239629 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:28:52.270382 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:52.270322 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" podStartSLOduration=1.270308637 podStartE2EDuration="1.270308637s" podCreationTimestamp="2026-05-21 14:28:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:28:52.266948886 +0000 UTC m=+1498.719262396" watchObservedRunningTime="2026-05-21 14:28:52.270308637 +0000 UTC m=+1498.722622145" May 21 14:28:54.148895 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:54.148868 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:28:54.151509 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:54.151479 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:28:54.155189 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:54.155169 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:28:54.157663 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:28:54.157646 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:29:03.245644 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:03.245613 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m7w7c" May 21 14:29:10.792104 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:10.792027 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:29:15.893601 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:15.893565 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:29:41.700860 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:41.700821 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:29:48.898825 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:48.898792 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:29:58.417353 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:29:58.417315 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:00.139689 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.139650 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656230-kxlt4"] May 21 14:30:00.143738 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.143707 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:00.146436 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.146374 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gmx9h\"" May 21 14:30:00.149257 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.149225 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656230-kxlt4"] May 21 14:30:00.229664 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.229630 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjhs\" (UniqueName: \"kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs\") pod \"maas-api-key-cleanup-29656230-kxlt4\" (UID: \"99109977-63ee-4895-a7ab-7cfca7c90325\") " pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:00.331038 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.331003 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjhs\" (UniqueName: \"kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs\") pod \"maas-api-key-cleanup-29656230-kxlt4\" (UID: \"99109977-63ee-4895-a7ab-7cfca7c90325\") " pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:00.340963 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.340931 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjhs\" (UniqueName: \"kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs\") pod \"maas-api-key-cleanup-29656230-kxlt4\" (UID: \"99109977-63ee-4895-a7ab-7cfca7c90325\") " pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:00.455088 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.455027 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:00.583600 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:00.583573 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656230-kxlt4"] May 21 14:30:00.585551 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:30:00.585521 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99109977_63ee_4895_a7ab_7cfca7c90325.slice/crio-1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb WatchSource:0}: Error finding container 1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb: Status 404 returned error can't find the container with id 1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb May 21 14:30:01.476117 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:01.476082 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" event={"ID":"99109977-63ee-4895-a7ab-7cfca7c90325","Type":"ContainerStarted","Data":"1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb"} May 21 14:30:04.488176 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:04.488139 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" event={"ID":"99109977-63ee-4895-a7ab-7cfca7c90325","Type":"ContainerStarted","Data":"77c45fee16641befc321b582d1cfca13ecf3c09a49911f3c9cdef4c53cbcc873"} May 21 14:30:04.508854 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:04.508763 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" podStartSLOduration=1.160222573 podStartE2EDuration="4.508745471s" podCreationTimestamp="2026-05-21 14:30:00 +0000 UTC" firstStartedPulling="2026-05-21 14:30:00.587278557 +0000 UTC m=+1567.039592045" lastFinishedPulling="2026-05-21 14:30:03.935801434 +0000 UTC m=+1570.388114943" observedRunningTime="2026-05-21 14:30:04.50756546 +0000 UTC m=+1570.959878970" watchObservedRunningTime="2026-05-21 14:30:04.508745471 +0000 UTC m=+1570.961058983" May 21 14:30:05.492490 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:05.492457 2549 generic.go:358] "Generic (PLEG): container finished" podID="99109977-63ee-4895-a7ab-7cfca7c90325" containerID="77c45fee16641befc321b582d1cfca13ecf3c09a49911f3c9cdef4c53cbcc873" exitCode=0 May 21 14:30:05.492864 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:05.492533 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" event={"ID":"99109977-63ee-4895-a7ab-7cfca7c90325","Type":"ContainerDied","Data":"77c45fee16641befc321b582d1cfca13ecf3c09a49911f3c9cdef4c53cbcc873"} May 21 14:30:06.629695 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:06.629670 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:06.698839 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:06.698802 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwjhs\" (UniqueName: \"kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs\") pod \"99109977-63ee-4895-a7ab-7cfca7c90325\" (UID: \"99109977-63ee-4895-a7ab-7cfca7c90325\") " May 21 14:30:06.700968 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:06.700945 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs" (OuterVolumeSpecName: "kube-api-access-nwjhs") pod "99109977-63ee-4895-a7ab-7cfca7c90325" (UID: "99109977-63ee-4895-a7ab-7cfca7c90325"). InnerVolumeSpecName "kube-api-access-nwjhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:30:06.799736 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:06.799650 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwjhs\" (UniqueName: \"kubernetes.io/projected/99109977-63ee-4895-a7ab-7cfca7c90325-kube-api-access-nwjhs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\"" May 21 14:30:07.500787 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:07.500756 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" event={"ID":"99109977-63ee-4895-a7ab-7cfca7c90325","Type":"ContainerDied","Data":"1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb"} May 21 14:30:07.500787 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:07.500787 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d1c715d3be8a5f418f0accfe1eeb369e1781b66537972704674619273866bbb" May 21 14:30:07.501033 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:07.500801 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656230-kxlt4" May 21 14:30:08.335024 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:08.333192 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:17.825837 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:17.825800 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:28.706867 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:28.706837 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:37.397559 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:37.397474 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:47.898497 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:47.898463 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:30:55.894526 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:30:55.894496 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:31:06.498532 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:31:06.498495 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:31:16.093738 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:31:16.093704 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:31:48.702331 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:31:48.702293 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:32:31.398843 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:32:31.398809 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:32:40.294384 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:32:40.293801 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:32:49.201582 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:32:49.201542 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:32:57.396172 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:32:57.396137 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:06.398586 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:06.398555 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:19.394219 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:19.394183 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:28.227972 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:28.227941 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:34.327648 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:34.327607 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:39.714703 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:39.714628 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:43.999175 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:43.999138 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:52.098813 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:52.098730 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:33:54.174674 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:54.174647 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:33:54.178497 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:54.178475 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:33:54.181550 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:54.181531 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:33:54.184636 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:33:54.184616 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:34:00.798396 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:00.798354 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:34:11.794367 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:11.794322 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:34:29.290827 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:29.290789 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:34:37.496564 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:37.496527 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:34:46.502472 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:46.502436 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:34:54.604478 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:34:54.604437 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:11.890455 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:11.890368 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:19.816299 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:19.816269 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:28.893940 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:28.893903 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:37.189149 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:37.189112 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:45.893078 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:45.893043 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:35:54.405153 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:35:54.405120 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:03.889498 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:03.889465 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:17.127865 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:17.127825 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:25.818406 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:25.818370 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:37.397270 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:37.397192 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:46.834282 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:46.834245 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:36:53.119116 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:36:53.119080 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:04.097613 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:04.097578 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:09.610580 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:09.610545 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:15.200477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:15.200437 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:27.597557 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:27.597522 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:35.506324 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:35.506285 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:44.513801 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:44.513769 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:37:53.403705 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:37:53.403670 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:38:16.495015 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:16.494937 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:38:28.694753 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:28.694719 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-64x8k"] May 21 14:38:37.525959 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:37.525934 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656230-kxlt4_99109977-63ee-4895-a7ab-7cfca7c90325/cleanup/0.log" May 21 14:38:37.765589 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:37.765547 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-j4tp4_3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38/manager/2.log" May 21 14:38:37.991122 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:37.991095 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd478c6-5d4bb_44dff7a3-c758-48c7-bb29-73637e417d15/manager/0.log" May 21 14:38:39.692266 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:39.692229 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-k76qk_4e073eba-a829-4051-8cbe-21b5e0b620da/manager/0.log" May 21 14:38:39.796857 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:39.796828 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-mlb5h_f9feef40-9f4a-44da-9be3-3f971bbf7fff/kuadrant-console-plugin/0.log" May 21 14:38:39.922951 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:39.922924 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qdsdf_4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2/registry-server/0.log" May 21 14:38:40.040420 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:40.040332 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m7w7c_1a97b753-5c66-4ee3-9253-ee6ea9610049/manager/0.log" May 21 14:38:40.164488 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:40.164462 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-64x8k_a2112e14-443b-4412-989d-af92b57d1b8f/limitador/0.log" May 21 14:38:40.274834 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:40.274805 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-v4vk6_0b3833ed-14bc-4ccf-ad91-7f32e7702881/manager/0.log" May 21 14:38:41.317174 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:41.317144 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7885fd88f8-pb46v_c58c66a6-c3a5-492d-993a-15e7c2a0c495/router/0.log" May 21 14:38:45.968943 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.968905 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dwhp/must-gather-vjvmn"] May 21 14:38:45.969318 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.969304 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99109977-63ee-4895-a7ab-7cfca7c90325" containerName="cleanup" May 21 14:38:45.969383 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.969320 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="99109977-63ee-4895-a7ab-7cfca7c90325" containerName="cleanup" May 21 14:38:45.969422 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.969392 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="99109977-63ee-4895-a7ab-7cfca7c90325" containerName="cleanup" May 21 14:38:45.972476 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.972459 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:45.975147 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.975120 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dwhp\"/\"openshift-service-ca.crt\"" May 21 14:38:45.975147 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.975138 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dwhp\"/\"default-dockercfg-hczc4\"" May 21 14:38:45.976315 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.976296 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dwhp\"/\"kube-root-ca.crt\"" May 21 14:38:45.996252 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:45.996229 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/must-gather-vjvmn"] May 21 14:38:46.039677 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.039649 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05d114c4-e201-492a-b181-5d7c4425c046-must-gather-output\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.039832 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.039679 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc69v\" (UniqueName: \"kubernetes.io/projected/05d114c4-e201-492a-b181-5d7c4425c046-kube-api-access-vc69v\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.141234 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.141209 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05d114c4-e201-492a-b181-5d7c4425c046-must-gather-output\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.141234 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.141239 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc69v\" (UniqueName: \"kubernetes.io/projected/05d114c4-e201-492a-b181-5d7c4425c046-kube-api-access-vc69v\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.141686 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.141662 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/05d114c4-e201-492a-b181-5d7c4425c046-must-gather-output\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.163526 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.163496 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc69v\" (UniqueName: \"kubernetes.io/projected/05d114c4-e201-492a-b181-5d7c4425c046-kube-api-access-vc69v\") pod \"must-gather-vjvmn\" (UID: \"05d114c4-e201-492a-b181-5d7c4425c046\") " pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.281783 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.281706 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" May 21 14:38:46.412062 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.412028 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/must-gather-vjvmn"] May 21 14:38:46.414995 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:38:46.414967 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05d114c4_e201_492a_b181_5d7c4425c046.slice/crio-11952cf1426270728946181d20fe7f9fc83f2b4e60220565c088da70fb7fb017 WatchSource:0}: Error finding container 11952cf1426270728946181d20fe7f9fc83f2b4e60220565c088da70fb7fb017: Status 404 returned error can't find the container with id 11952cf1426270728946181d20fe7f9fc83f2b4e60220565c088da70fb7fb017 May 21 14:38:46.416825 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:46.416800 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:38:47.350428 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:47.350380 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" event={"ID":"05d114c4-e201-492a-b181-5d7c4425c046","Type":"ContainerStarted","Data":"11952cf1426270728946181d20fe7f9fc83f2b4e60220565c088da70fb7fb017"} May 21 14:38:48.356781 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:48.356713 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" event={"ID":"05d114c4-e201-492a-b181-5d7c4425c046","Type":"ContainerStarted","Data":"5cacdca4735fa0ef5e23c5b5dcbc14acb0e84ba5466886f395da81b40a1a82b0"} May 21 14:38:48.356781 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:48.356761 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" event={"ID":"05d114c4-e201-492a-b181-5d7c4425c046","Type":"ContainerStarted","Data":"9a1ca6b6dce146f0246a4b179ac64444e9aebee0727ec567892d70fd07f13dfb"} May 21 14:38:48.374679 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:48.374621 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dwhp/must-gather-vjvmn" podStartSLOduration=2.336124991 podStartE2EDuration="3.37459721s" podCreationTimestamp="2026-05-21 14:38:45 +0000 UTC" firstStartedPulling="2026-05-21 14:38:46.416922006 +0000 UTC m=+2092.869235493" lastFinishedPulling="2026-05-21 14:38:47.455394011 +0000 UTC m=+2093.907707712" observedRunningTime="2026-05-21 14:38:48.371787933 +0000 UTC m=+2094.824101441" watchObservedRunningTime="2026-05-21 14:38:48.37459721 +0000 UTC m=+2094.826910719" May 21 14:38:49.090899 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:49.090845 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kxtsg_848e94cd-29f4-44de-b724-678e50be6c28/global-pull-secret-syncer/0.log" May 21 14:38:49.193409 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:49.193281 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4bpt8_9777a5e6-ec1f-4994-bf7e-b04d4bae250c/konnectivity-agent/0.log" May 21 14:38:49.373186 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:49.373101 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-189.ec2.internal_ac4112976232576c5a9014be7a6a9c4a/haproxy/0.log" May 21 14:38:53.338795 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.338764 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-k76qk_4e073eba-a829-4051-8cbe-21b5e0b620da/manager/0.log" May 21 14:38:53.369796 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.369768 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-mlb5h_f9feef40-9f4a-44da-9be3-3f971bbf7fff/kuadrant-console-plugin/0.log" May 21 14:38:53.416697 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.416666 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qdsdf_4d55e793-edd4-4f2f-a8a4-6a7240bf1ee2/registry-server/0.log" May 21 14:38:53.495180 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.495145 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m7w7c_1a97b753-5c66-4ee3-9253-ee6ea9610049/manager/0.log" May 21 14:38:53.515949 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.515924 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-64x8k_a2112e14-443b-4412-989d-af92b57d1b8f/limitador/0.log" May 21 14:38:53.591216 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:53.591142 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-v4vk6_0b3833ed-14bc-4ccf-ad91-7f32e7702881/manager/0.log" May 21 14:38:54.211906 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:54.211876 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:38:54.217407 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:54.217383 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:38:54.221095 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:54.221077 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:38:54.226109 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:54.226092 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6n977_d559b3b6-a134-4e79-b36e-1306db610a88/ovn-acl-logging/0.log" May 21 14:38:55.047873 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.047830 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-dvmz7_d44a8e7b-179e-4bda-b78b-b2c6ca7039f1/cluster-monitoring-operator/0.log" May 21 14:38:55.473274 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.473241 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpc9x_6e917a90-6953-46c3-b5e5-886ed3a4c2b0/node-exporter/0.log" May 21 14:38:55.497515 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.497482 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpc9x_6e917a90-6953-46c3-b5e5-886ed3a4c2b0/kube-rbac-proxy/0.log" May 21 14:38:55.521292 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.521267 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpc9x_6e917a90-6953-46c3-b5e5-886ed3a4c2b0/init-textfile/0.log" May 21 14:38:55.561113 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.561073 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mt24g_58595eb1-c886-4b6c-8572-b2385b122d25/kube-rbac-proxy-main/0.log" May 21 14:38:55.586474 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.586448 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mt24g_58595eb1-c886-4b6c-8572-b2385b122d25/kube-rbac-proxy-self/0.log" May 21 14:38:55.612441 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.612411 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-mt24g_58595eb1-c886-4b6c-8572-b2385b122d25/openshift-state-metrics/0.log" May 21 14:38:55.890566 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.890529 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-6kmzv_471f8eb1-dcc3-4cd0-a997-da17a7b921c4/prometheus-operator/0.log" May 21 14:38:55.974871 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:55.974830 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-6kmzv_471f8eb1-dcc3-4cd0-a997-da17a7b921c4/kube-rbac-proxy/0.log" May 21 14:38:56.241080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.241004 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/thanos-query/0.log" May 21 14:38:56.270090 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.270062 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/kube-rbac-proxy-web/0.log" May 21 14:38:56.303516 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.303490 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/kube-rbac-proxy/0.log" May 21 14:38:56.366308 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.366278 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/prom-label-proxy/0.log" May 21 14:38:56.418899 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.418863 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/kube-rbac-proxy-rules/0.log" May 21 14:38:56.464194 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:56.464162 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6969c758f-8r9gm_822e4bc1-b71a-4ff8-8099-ff52f496437f/kube-rbac-proxy-metrics/0.log" May 21 14:38:57.613214 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.613187 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-26gcr_f822a75f-89b0-4a16-a6c0-c5862547b18a/networking-console-plugin/0.log" May 21 14:38:57.672951 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.672917 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2"] May 21 14:38:57.678686 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.678654 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.699675 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.699649 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2"] May 21 14:38:57.876295 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.876213 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-lib-modules\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.876496 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.876403 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-sys\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.876496 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.876436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-podres\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.876496 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.876474 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-proc\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.876659 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.876506 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrq49\" (UniqueName: \"kubernetes.io/projected/f425122a-f3e6-43c5-a428-e2ae1e123a75-kube-api-access-zrq49\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.977821 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977774 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-lib-modules\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978013 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977896 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-sys\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978013 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977923 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-podres\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978013 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977955 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-proc\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978013 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977974 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-lib-modules\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.977986 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrq49\" (UniqueName: \"kubernetes.io/projected/f425122a-f3e6-43c5-a428-e2ae1e123a75-kube-api-access-zrq49\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.978085 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-podres\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.978136 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-proc\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.978227 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.978172 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f425122a-f3e6-43c5-a428-e2ae1e123a75-sys\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.987198 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.987174 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrq49\" (UniqueName: \"kubernetes.io/projected/f425122a-f3e6-43c5-a428-e2ae1e123a75-kube-api-access-zrq49\") pod \"perf-node-gather-daemonset-c5bf2\" (UID: \"f425122a-f3e6-43c5-a428-e2ae1e123a75\") " pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:57.993477 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:57.993068 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:58.158189 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.158106 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2"] May 21 14:38:58.164908 ip-10-0-143-189 kubenswrapper[2549]: W0521 14:38:58.164159 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf425122a_f3e6_43c5_a428_e2ae1e123a75.slice/crio-c3ca3bc755eb0435a72ef37771e160813c78788230ef3b331b273d103369f33c WatchSource:0}: Error finding container c3ca3bc755eb0435a72ef37771e160813c78788230ef3b331b273d103369f33c: Status 404 returned error can't find the container with id c3ca3bc755eb0435a72ef37771e160813c78788230ef3b331b273d103369f33c May 21 14:38:58.369304 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.369278 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/2.log" May 21 14:38:58.374054 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.374026 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-97fcr_f8591746-6e8f-4d84-94fc-3b2383b42c94/console-operator/3.log" May 21 14:38:58.447914 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.447811 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" event={"ID":"f425122a-f3e6-43c5-a428-e2ae1e123a75","Type":"ContainerStarted","Data":"bd63ea310d0337139d252482ce28e6c79d11c17a4d819a8bccd861dd38dacf93"} May 21 14:38:58.447914 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.447860 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" event={"ID":"f425122a-f3e6-43c5-a428-e2ae1e123a75","Type":"ContainerStarted","Data":"c3ca3bc755eb0435a72ef37771e160813c78788230ef3b331b273d103369f33c"} May 21 14:38:58.448298 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.448270 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:38:58.478074 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.478010 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" podStartSLOduration=1.477989355 podStartE2EDuration="1.477989355s" podCreationTimestamp="2026-05-21 14:38:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:58.475732343 +0000 UTC m=+2104.928045852" watchObservedRunningTime="2026-05-21 14:38:58.477989355 +0000 UTC m=+2104.930302865" May 21 14:38:58.885359 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:38:58.885311 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f59c76d7f-7q9cj_7c2d4420-9cd9-42eb-96ea-6df8e540f609/console/0.log" May 21 14:39:00.221297 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:00.221271 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8rm2_a1d0a36f-a6fd-4ae9-916e-f20bb556293f/dns/0.log" May 21 14:39:00.251080 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:00.251057 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8rm2_a1d0a36f-a6fd-4ae9-916e-f20bb556293f/kube-rbac-proxy/0.log" May 21 14:39:00.457332 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:00.457304 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbdtg_02c1944f-0919-4765-8643-dfc19df42810/dns-node-resolver/0.log" May 21 14:39:01.179678 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:01.179650 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jnlc_426dfaa0-fbb1-4ebc-849f-00efd86eb480/node-ca/0.log" May 21 14:39:03.028322 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:03.028293 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7885fd88f8-pb46v_c58c66a6-c3a5-492d-993a-15e7c2a0c495/router/0.log" May 21 14:39:03.719793 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:03.719758 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fswvs_02500ec9-9b90-4e4d-8409-415f4ee0894f/serve-healthcheck-canary/0.log" May 21 14:39:04.336050 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.336019 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7h8s7_27621f7a-7951-44d1-b630-bc7eb98f6237/insights-operator/1.log" May 21 14:39:04.336455 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.336122 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7h8s7_27621f7a-7951-44d1-b630-bc7eb98f6237/insights-operator/0.log" May 21 14:39:04.382208 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.382180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ntqk_1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8/kube-rbac-proxy/0.log" May 21 14:39:04.438531 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.438499 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ntqk_1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8/exporter/0.log" May 21 14:39:04.463593 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.463568 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dwhp/perf-node-gather-daemonset-c5bf2" May 21 14:39:04.482668 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:04.482641 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ntqk_1f8b6fce-2455-4d34-83a8-0bc04f9a1bc8/extractor/0.log" May 21 14:39:07.404703 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:07.404617 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656230-kxlt4_99109977-63ee-4895-a7ab-7cfca7c90325/cleanup/0.log" May 21 14:39:07.617087 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:07.617036 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-j4tp4_3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38/manager/1.log" May 21 14:39:07.631087 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:07.631053 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-j4tp4_3547a1ec-0cf4-4e26-84c4-7c20f0cc0a38/manager/2.log" May 21 14:39:07.768728 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:07.768700 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd478c6-5d4bb_44dff7a3-c758-48c7-bb29-73637e417d15/manager/0.log" May 21 14:39:09.367708 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:09.367678 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7454667d6f-dnb8q_0493d9fc-a32f-41ca-872b-a71adfabed0f/manager/0.log" May 21 14:39:14.914485 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:14.914448 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j5hvp_5c3f1127-374c-4018-afe2-b23038b41b91/kube-storage-version-migrator-operator/1.log" May 21 14:39:14.915644 ip-10-0-143-189 kubenswrapper[2549]: I0521 14:39:14.915617 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j5hvp_5c3f1127-374c-4018-afe2-b23038b41b91/kube-storage-version-migrator-operator/0.log"