Jun 14 15:11:27.727508 ip-10-0-141-194 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 15:11:27.727521 ip-10-0-141-194 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 15:11:27.727531 ip-10-0-141-194 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 15:11:27.727854 ip-10-0-141-194 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 15:11:37.834975 ip-10-0-141-194 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 14 15:11:37.834990 ip-10-0-141-194 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8c43e81347044fa7b17e77f83be1124a -- Jun 14 15:13:38.942865 ip-10-0-141-194 systemd[1]: Starting Kubernetes Kubelet... Jun 14 15:13:39.398775 ip-10-0-141-194 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:13:39.398775 ip-10-0-141-194 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 15:13:39.398775 ip-10-0-141-194 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:13:39.398775 ip-10-0-141-194 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 15:13:39.398775 ip-10-0-141-194 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:13:39.401732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.401633 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 15:13:39.406673 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406654 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.406673 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406674 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406678 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406681 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406684 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406687 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406690 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406693 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406695 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406698 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406701 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406706 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406709 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406717 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406720 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406723 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406725 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406728 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406730 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406733 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406736 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.406740 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406738 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406741 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406744 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406747 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406750 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406753 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406756 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406760 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406764 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406767 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406770 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406772 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406775 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406777 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406780 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406782 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406784 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406788 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406792 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.407251 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406796 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406799 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406803 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406806 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406809 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406811 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406814 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406818 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406820 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406823 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406825 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406828 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406830 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406833 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406835 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406838 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406841 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406844 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406847 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406849 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.407726 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406852 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406854 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406857 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406859 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406862 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406865 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406867 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406870 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406872 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406875 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406878 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406882 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406885 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406887 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406890 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406892 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406894 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406897 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406901 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406904 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.408209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406906 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406909 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406911 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406914 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406916 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406919 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406921 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406925 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406927 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406930 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406933 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406935 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406938 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406940 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406942 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406945 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406947 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406950 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.406952 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408688 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.408704 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408696 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408700 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408702 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408706 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408708 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408716 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408719 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408722 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408725 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408727 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408730 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408733 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408736 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408739 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408741 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408744 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408746 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408749 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408751 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.409209 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408754 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408756 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408759 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408761 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408764 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408767 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408769 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408772 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408774 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408777 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408779 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408782 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408785 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408787 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408790 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408793 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408796 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408799 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408801 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408806 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.409998 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408810 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408813 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408815 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408818 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408821 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408824 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408833 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408837 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408840 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408843 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408846 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408849 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408852 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408855 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408857 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408860 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408863 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408867 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408870 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408873 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.410608 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408876 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408878 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408881 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408884 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408886 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408889 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408892 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408895 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408898 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408900 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408903 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408906 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408909 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408912 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408914 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408917 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408919 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408923 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408927 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408931 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.411120 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408934 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408936 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408939 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408941 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408944 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408946 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408949 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408951 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408954 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408958 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408961 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408964 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408967 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408970 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408972 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408975 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408977 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408980 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.408983 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.411624 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410679 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410803 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410807 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410811 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410813 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410816 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410819 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410821 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410824 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410827 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410829 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410833 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410835 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410838 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410840 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410843 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410848 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410853 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410856 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410859 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.412092 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410861 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410864 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410867 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410870 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410872 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410875 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410877 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410880 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410883 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410885 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410888 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410894 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410897 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410901 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410904 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410906 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410909 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410911 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410915 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410917 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.412586 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410920 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410922 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410925 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410928 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410930 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410933 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410935 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410938 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410945 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410950 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410952 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410955 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410958 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410960 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410963 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410965 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410968 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410970 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410973 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410975 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.413090 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410978 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410980 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410983 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410986 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410988 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410992 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410995 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.410999 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411003 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411006 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411009 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411012 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411014 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411017 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411020 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411022 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411025 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411027 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411032 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.413590 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411036 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411039 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411042 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411044 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411047 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411050 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411052 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411055 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411057 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411060 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411062 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411065 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411068 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411070 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411075 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411078 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411080 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411084 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411087 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.414130 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411160 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411167 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411174 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411179 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411183 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411187 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411191 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411195 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411198 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411201 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411205 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411208 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411211 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411214 2567 flags.go:64] FLAG: --cgroup-root="" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411217 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411220 2567 flags.go:64] FLAG: --client-ca-file="" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411223 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411227 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411231 2567 flags.go:64] FLAG: --cluster-domain="" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411234 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411237 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411240 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411244 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411247 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 15:13:39.414640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411250 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411253 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411256 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411259 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411262 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411265 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411270 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411273 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411277 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411280 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411283 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411286 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411289 2567 flags.go:64] FLAG: --enable-server="true" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411292 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411298 2567 flags.go:64] FLAG: --event-burst="100" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411301 2567 flags.go:64] FLAG: --event-qps="50" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411304 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411307 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411310 2567 flags.go:64] FLAG: --eviction-hard="" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411314 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411317 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411320 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411323 2567 flags.go:64] FLAG: --eviction-soft="" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411326 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411328 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 15:13:39.415236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411331 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411335 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411338 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411341 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411344 2567 flags.go:64] FLAG: --feature-gates="" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411347 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411350 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411353 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411356 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411360 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411362 2567 flags.go:64] FLAG: --help="false" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411365 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411368 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411372 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411375 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411378 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411381 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411384 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411387 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411390 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411393 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411396 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411399 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411401 2567 flags.go:64] FLAG: --kube-reserved="" Jun 14 15:13:39.415884 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411404 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411407 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411410 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411413 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411416 2567 flags.go:64] FLAG: --lock-file="" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411419 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411422 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411425 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411430 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411432 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411437 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411439 2567 flags.go:64] FLAG: --logging-format="text" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411442 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411445 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411448 2567 flags.go:64] FLAG: --manifest-url="" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411451 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411455 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411459 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411463 2567 flags.go:64] FLAG: --max-pods="110" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411466 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411469 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411472 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411475 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411478 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411481 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 15:13:39.416484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411484 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411493 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411496 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411499 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411502 2567 flags.go:64] FLAG: --pod-cidr="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411505 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411510 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411513 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411531 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411534 2567 flags.go:64] FLAG: --port="10250" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411537 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411539 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03898129c9918fbc6" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411543 2567 flags.go:64] FLAG: --qos-reserved="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411546 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411548 2567 flags.go:64] FLAG: --register-node="true" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411551 2567 flags.go:64] FLAG: --register-with-taints="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411558 2567 flags.go:64] FLAG: --registry-burst="10" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411561 2567 flags.go:64] FLAG: --registry-qps="5" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411564 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411567 2567 flags.go:64] FLAG: --reserved-memory="" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411576 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411580 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411583 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411585 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411588 2567 flags.go:64] FLAG: --runonce="false" Jun 14 15:13:39.417114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411591 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411594 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411597 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411600 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411603 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411606 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411609 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411612 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411615 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411618 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411620 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411623 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411626 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411629 2567 flags.go:64] FLAG: --system-cgroups="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411632 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411638 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411641 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411643 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411648 2567 flags.go:64] FLAG: --tls-min-version="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411651 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411654 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411656 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411659 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411662 2567 flags.go:64] FLAG: --v="2" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411666 2567 flags.go:64] FLAG: --version="false" Jun 14 15:13:39.417761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411670 2567 flags.go:64] FLAG: --vmodule="" Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411676 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.411680 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411795 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411798 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411802 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411805 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411807 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411810 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411812 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411815 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411818 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411820 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411823 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411825 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411828 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411830 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411833 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411836 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411838 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.418364 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411841 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411843 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411846 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411848 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411851 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411853 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411855 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411858 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411862 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411866 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411871 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411873 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411876 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411879 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411886 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411889 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411891 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411894 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411896 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.418889 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411899 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411901 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411904 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411907 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411909 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411912 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411915 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411917 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411920 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411922 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411925 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411928 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411931 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411933 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411936 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411940 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411943 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411946 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411949 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.419349 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411953 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411956 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411959 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411963 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411967 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411970 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411973 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411976 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411980 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411983 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411986 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411989 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411992 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411995 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.411997 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412000 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412007 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412010 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412013 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412016 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.419839 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412018 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412021 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412023 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412026 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412029 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412032 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412034 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412037 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412040 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412042 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412045 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412047 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412050 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412052 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412055 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412058 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412065 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412068 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412070 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.420328 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412077 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412079 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412083 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.412086 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.413458 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.420711 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.420726 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.420745 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.420751 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420806 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420811 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420815 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420818 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420821 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420823 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.420852 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420834 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420838 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420841 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420844 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420847 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420850 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420852 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420857 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420861 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420864 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420868 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420871 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420873 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420876 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420879 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420881 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420884 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420887 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420890 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420893 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.421233 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420896 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420899 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420901 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420905 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420909 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420911 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420915 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420917 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420920 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420923 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420926 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420929 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420931 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420933 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420937 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420940 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420943 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420945 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420948 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.421894 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420951 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420953 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420956 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420959 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420961 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420964 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420967 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420969 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420972 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420974 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420977 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420980 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420982 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420986 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420989 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420991 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420993 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420996 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.420999 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.422357 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421003 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421006 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421008 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421011 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421014 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421016 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421019 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421021 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421024 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421027 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421030 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421032 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421035 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421038 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421040 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421043 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421045 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421048 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421050 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421053 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.422826 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421055 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421058 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421060 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421063 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421065 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421068 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421070 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421074 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421078 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421080 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421084 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421086 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421089 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421092 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421094 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.423308 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.421099 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421211 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421216 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421220 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421224 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421229 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421232 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421235 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421238 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421241 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421244 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421246 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421249 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421251 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421254 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421256 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421259 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421262 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421264 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:13:39.423681 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421267 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421269 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421272 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421274 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421277 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421280 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421283 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421285 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421288 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421290 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421293 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421296 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421299 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421301 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421303 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421306 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421308 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421311 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421315 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:13:39.424147 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421318 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421321 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421323 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421326 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421328 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421331 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421333 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421336 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421338 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421341 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421343 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421345 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421348 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421350 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421353 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421355 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421358 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421360 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421363 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421365 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:13:39.424674 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421368 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421371 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421373 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421376 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421379 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421382 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421384 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421387 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421389 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421392 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421395 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421397 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421399 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421402 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421405 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421407 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421410 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421412 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421414 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421417 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:13:39.425164 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421419 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421422 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421424 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421427 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421429 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421432 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421434 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421437 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421439 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421442 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421444 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421446 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421449 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421452 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421454 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421457 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421460 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421462 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421465 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421467 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:13:39.425708 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421470 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:39.421473 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.421477 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.421595 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.423954 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.425566 2567 server.go:1019] "Starting client certificate rotation" Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.425664 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:13:39.426184 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.425693 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:13:39.428370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.428356 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:13:39.429667 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.429650 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:13:39.438554 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.438540 2567 log.go:25] "Validated CRI v1 runtime API" Jun 14 15:13:39.442809 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.442785 2567 log.go:25] "Validated CRI v1 image API" Jun 14 15:13:39.443647 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.443627 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 15:13:39.446212 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.446193 2567 fs.go:135] Filesystem UUIDs: map[6ef6fe1e-69df-4946-a01d-63894c26e7f1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 929abefb-589e-45dc-a052-6f849232c7b7:/dev/nvme0n1p3] Jun 14 15:13:39.446283 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.446211 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 15:13:39.452469 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.452360 2567 manager.go:216] Machine: {Timestamp:2026-06-14 15:13:39.450994621 +0000 UTC m=+0.375676541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100186 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24ef2fd8074c0c8f7411a54f4cc1c8 SystemUUID:ec24ef2f-d807-4c0c-8f74-11a54f4cc1c8 BootID:8c43e813-4704-4fa7-b17e-77f83be1124a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:88:16:46:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:88:16:46:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:d7:93:4c:da:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 15:13:39.452469 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.452458 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 15:13:39.452623 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.452575 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 15:13:39.453047 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.453029 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:13:39.455962 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.455936 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 15:13:39.456116 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.455967 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-194.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 15:13:39.456837 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.456819 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 15:13:39.456898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.456844 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 15:13:39.456898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.456854 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:13:39.456898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.456875 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:13:39.458785 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.458773 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 15:13:39.463547 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463533 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:13:39.463673 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463662 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 15:13:39.463727 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463702 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 14 15:13:39.463727 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463716 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 15:13:39.463808 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463734 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 15:13:39.463808 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463748 2567 kubelet.go:398] "Adding apiserver pod source" Jun 14 15:13:39.463808 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.463761 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 15:13:39.464125 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.464111 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:13:39.464192 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.464134 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:13:39.467374 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.467360 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 15:13:39.469107 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469093 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 15:13:39.469170 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469123 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 15:13:39.469339 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469328 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 15:13:39.469371 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469344 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 15:13:39.469371 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469349 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 15:13:39.469371 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469356 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 15:13:39.469371 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469368 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 15:13:39.469470 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469377 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 15:13:39.469948 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469939 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 15:13:39.469948 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469948 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 15:13:39.470009 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469955 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 15:13:39.470009 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469962 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 15:13:39.470009 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469977 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 15:13:39.470009 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.469985 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 15:13:39.470919 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.470909 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 15:13:39.470919 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.470918 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 15:13:39.473346 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.473144 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-194.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 15:13:39.473422 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.473176 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 15:13:39.473422 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.473204 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 15:13:39.474355 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.474342 2567 server.go:1268] "Started kubelet" Jun 14 15:13:39.474433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.474407 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 15:13:39.475066 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.475011 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 15:13:39.475135 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.475087 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 15:13:39.475301 ip-10-0-141-194 systemd[1]: Started Kubernetes Kubelet. Jun 14 15:13:39.479169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.479138 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzbrq" Jun 14 15:13:39.479169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.479158 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 15:13:39.480284 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.480266 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 14 15:13:39.482654 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.482621 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 15:13:39.484014 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.482829 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-194.ec2.internal.18b8fb5aabe11c4d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-194.ec2.internal,UID:ip-10-0-141-194.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-194.ec2.internal,},FirstTimestamp:2026-06-14 15:13:39.474316365 +0000 UTC m=+0.398998284,LastTimestamp:2026-06-14 15:13:39.474316365 +0000 UTC m=+0.398998284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-194.ec2.internal,}" Jun 14 15:13:39.484100 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.484024 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzbrq" Jun 14 15:13:39.485330 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.485312 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 15:13:39.485969 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.485953 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 15:13:39.486125 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.486104 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.486794 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486696 2567 factory.go:55] Registering systemd factory Jun 14 15:13:39.486794 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486711 2567 factory.go:223] Registration of the systemd container factory successfully Jun 14 15:13:39.486794 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486784 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 15:13:39.486961 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486823 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 15:13:39.486961 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486835 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 15:13:39.486961 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486919 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 14 15:13:39.486961 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.486928 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 14 15:13:39.487233 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487152 2567 factory.go:153] Registering CRI-O factory Jun 14 15:13:39.487233 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487166 2567 factory.go:223] Registration of the crio container factory successfully Jun 14 15:13:39.487233 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487217 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 15:13:39.487353 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487243 2567 factory.go:103] Registering Raw factory Jun 14 15:13:39.487353 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487258 2567 manager.go:1196] Started watching for new ooms in manager Jun 14 15:13:39.487754 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.487741 2567 manager.go:349] Starting recovery of all containers Jun 14 15:13:39.493808 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.493773 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 15:13:39.493904 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.493860 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 15:13:39.499076 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.499060 2567 manager.go:354] Recovery completed Jun 14 15:13:39.503484 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.503469 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.505266 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.505246 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.505347 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.505282 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.505591 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.505573 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.506425 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.506407 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 15:13:39.506425 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.506425 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 15:13:39.506560 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.506443 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:13:39.506974 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.506930 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.507895 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.507878 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.507974 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.507911 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.507974 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.507927 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.508614 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.508597 2567 policy_none.go:49] "None policy: Start" Jun 14 15:13:39.508614 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.508615 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 15:13:39.508719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.508625 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 15:13:39.510612 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.510601 2567 policy_none.go:47] "Start" Jun 14 15:13:39.549149 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549132 2567 manager.go:337] "Starting Device Plugin manager" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.549170 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549183 2567 server.go:87] "Starting device plugin registration server" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549451 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549464 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549585 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549690 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.549701 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.550329 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.550383 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.556555 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.557706 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.557739 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.557759 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.557793 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 15:13:39.569322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.559861 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:13:39.650151 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.650064 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.651297 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.651277 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.651394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.651312 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.651394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.651326 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.651394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.651349 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.657756 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.657740 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.657799 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.657763 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-194.ec2.internal\": node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.657864 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.657845 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal"] Jun 14 15:13:39.657919 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.657910 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.658735 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.658712 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.658837 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.658744 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.658837 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.658754 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.661082 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661066 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.661198 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.661241 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661214 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.661777 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661756 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.661777 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661771 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.661903 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661785 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.661903 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661793 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.661903 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661799 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.661903 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.661804 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.664179 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.664162 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.664239 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.664194 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:13:39.664949 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.664930 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:13:39.665031 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.664964 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:13:39.665031 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.664976 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:13:39.673691 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.673669 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.687209 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.687184 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-194.ec2.internal\" not found" node="ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.688075 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.688059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.688148 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.688087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.688148 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.688116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.691797 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.691784 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-194.ec2.internal\" not found" node="ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.773969 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.773942 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.788227 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.788320 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.788320 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.788320 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.788446 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a64a0089d96df9e7686766c7f0343b5c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-194.ec2.internal\" (UID: \"a64a0089d96df9e7686766c7f0343b5c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.788446 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.788338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6966a3b5ef7b3f02e3b85e0510d36f37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal\" (UID: \"6966a3b5ef7b3f02e3b85e0510d36f37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.874716 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.874670 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.975535 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:39.975493 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:39.989917 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.989891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:39.996352 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:39.996328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:40.076634 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.076600 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.177130 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.177102 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.277690 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.277663 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.378174 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.378144 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.424839 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.424809 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 15:13:40.425449 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.424964 2567 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.141.194:39064->44.209.31.64:6443: use of closed network connection" Jun 14 15:13:40.425449 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.425002 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 15:13:40.425449 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.425043 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.141.194:39064->44.209.31.64:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 15:13:40.478712 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.478685 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.491681 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.491649 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 15:08:39 +0000 UTC" deadline="2028-01-26 22:43:36.139561782 +0000 UTC" Jun 14 15:13:40.491681 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.491678 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14191h29m55.64788764s" Jun 14 15:13:40.542342 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:40.542126 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6966a3b5ef7b3f02e3b85e0510d36f37.slice/crio-25353680fa9421670c728e87c2027eee003ed8f75551face923382ea1dbc6f2f WatchSource:0}: Error finding container 25353680fa9421670c728e87c2027eee003ed8f75551face923382ea1dbc6f2f: Status 404 returned error can't find the container with id 25353680fa9421670c728e87c2027eee003ed8f75551face923382ea1dbc6f2f Jun 14 15:13:40.542613 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:40.542582 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64a0089d96df9e7686766c7f0343b5c.slice/crio-d12a315ed919b09dea2e48606a8a0dbda01c9a78ed279d4a6767b39c5ae23bd8 WatchSource:0}: Error finding container d12a315ed919b09dea2e48606a8a0dbda01c9a78ed279d4a6767b39c5ae23bd8: Status 404 returned error can't find the container with id d12a315ed919b09dea2e48606a8a0dbda01c9a78ed279d4a6767b39c5ae23bd8 Jun 14 15:13:40.547628 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.547612 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:13:40.561258 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.561220 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" event={"ID":"a64a0089d96df9e7686766c7f0343b5c","Type":"ContainerStarted","Data":"d12a315ed919b09dea2e48606a8a0dbda01c9a78ed279d4a6767b39c5ae23bd8"} Jun 14 15:13:40.562419 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.562401 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerStarted","Data":"25353680fa9421670c728e87c2027eee003ed8f75551face923382ea1dbc6f2f"} Jun 14 15:13:40.579614 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.579590 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.680190 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.680157 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.780660 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.780632 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.881302 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.881221 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:40.925424 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:40.925389 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:13:40.982006 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:40.981970 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-194.ec2.internal\" not found" Jun 14 15:13:41.030202 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.030173 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:13:41.086593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.086248 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" Jun 14 15:13:41.100547 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.100506 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:13:41.102688 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.102661 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" Jun 14 15:13:41.112428 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.112405 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:13:41.464811 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.464780 2567 apiserver.go:52] "Watching apiserver" Jun 14 15:13:41.472779 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.472750 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 15:13:41.474163 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.474124 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qwc5s","kube-system/konnectivity-agent-f2w5r","kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal","openshift-dns/node-resolver-tlm8j","openshift-multus/multus-hx8dm","openshift-network-diagnostics/network-check-target-48cl4","openshift-network-operator/iptables-alerter-nxhmb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr","openshift-cluster-node-tuning-operator/tuned-cfvg2","openshift-image-registry/node-ca-ghxxn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal","openshift-multus/multus-additional-cni-plugins-x7lmh","openshift-multus/network-metrics-daemon-d6hx4","openshift-ovn-kubernetes/ovnkube-node-sv5w2"] Jun 14 15:13:41.476635 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.476613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.478862 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.478838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.478958 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.478921 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:41.481121 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.481102 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.481658 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.481577 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.481658 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.481620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cm79m\"" Jun 14 15:13:41.481882 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.481865 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 15:13:41.483375 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.483356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.484010 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.483990 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 15:13:41.485041 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.484663 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.485041 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.484683 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 15:13:41.485152 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485086 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 15:13:41.485205 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485152 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.485259 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485224 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9kkrz\"" Jun 14 15:13:41.485339 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485325 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 15:13:41.485693 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.485951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.485677 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 15:13:41.486083 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.486073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.486203 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.486188 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8spcj\"" Jun 14 15:13:41.486889 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.486871 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.488539 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.488506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:41.488628 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.488591 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489369 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489506 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489764 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sc6zh\"" Jun 14 15:13:41.489909 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.489899 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.490973 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.490954 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.493255 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.493237 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.493350 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.493299 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:41.494139 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.494073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.494574 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.494536 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x475l\"" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.495845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-hostroot\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.495884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9dl5\" (UniqueName: \"kubernetes.io/projected/a1ff4dab-cd92-4afc-9190-57324cd003f1-kube-api-access-j9dl5\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.495911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.495942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.495972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-node-log\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-tmp-dir\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-bin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-conf-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbd7s\" (UniqueName: \"kubernetes.io/projected/5d76d205-e9e9-4161-b48a-aebb70401532-kube-api-access-fbd7s\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-host-slash\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-netd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-env-overrides\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-hosts-file\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7r4x\" (UniqueName: \"kubernetes.io/projected/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-kube-api-access-w7r4x\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.496433 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-systemd-units\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.497191 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-etc-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.497191 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.496339 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.497191 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.497079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.497191 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.497165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-k8s-cni-cncf-io\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.497373 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.497234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frxp\" (UniqueName: \"kubernetes.io/projected/30285260-6037-4126-8ef0-6989c385dffc-kube-api-access-6frxp\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.497373 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.497271 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-var-lib-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.497876 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.497301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-log-socket\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498065 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-os-release\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-daemon-config\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498099 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.498136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-netns\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498295 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498142 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-ovn\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498295 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-netns\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-multus\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-multus-certs\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-etc-kubernetes\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-iptables-alerter-script\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.498497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-config\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-cnibin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd6r7\" (UniqueName: \"kubernetes.io/projected/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-kube-api-access-hd6r7\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-systemd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-bin\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-script-lib\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-system-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.498740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-socket-dir-parent\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.499127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-kubelet\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.499127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-kubelet\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.499127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-slash\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.499127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76d205-e9e9-4161-b48a-aebb70401532-ovn-node-metrics-cert\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.499127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.498832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-cni-binary-copy\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.499924 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.499902 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.500574 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.500554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hbg8c\"" Jun 14 15:13:41.500809 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.500792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 15:13:41.501324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.501306 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 15:13:41.502368 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.502302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.504829 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.504802 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.505760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.505738 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.505853 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.505779 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 15:13:41.505853 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.505736 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.506140 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.506123 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 15:13:41.506216 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.506127 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 15:13:41.506216 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.506161 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-79klb\"" Jun 14 15:13:41.506707 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.506690 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 15:13:41.509674 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.509656 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 15:13:41.509674 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.509669 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 15:13:41.509862 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.509767 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-48cwd\"" Jun 14 15:13:41.510134 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.510111 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kcdj9\"" Jun 14 15:13:41.512238 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.512217 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:13:41.547224 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.547206 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq62c" Jun 14 15:13:41.552921 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.552902 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq62c" Jun 14 15:13:41.588343 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.588316 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 15:13:41.599151 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4bd\" (UniqueName: \"kubernetes.io/projected/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-kube-api-access-hk4bd\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-node-log\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-tmp-dir\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-conf-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-node-log\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-conf\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.599296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-systemd\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-lib-modules\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-var-lib-kubelet\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599438 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-env-overrides\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-hosts-file\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7r4x\" (UniqueName: \"kubernetes.io/projected/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-kube-api-access-w7r4x\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-tmp-dir\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-kubelet-config\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599561 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-hosts-file\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-host\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.599613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-systemd-units\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599634 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-systemd-units\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0051ccc-776e-4005-b943-3e86b4f7a5d7-host\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-conf-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cnibin\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frxp\" (UniqueName: \"kubernetes.io/projected/30285260-6037-4126-8ef0-6989c385dffc-kube-api-access-6frxp\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-var-lib-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-log-socket\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-var-lib-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f76af9f-f3a6-4b84-b942-91a3e27c0366-konnectivity-ca\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-log-socket\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-kubernetes\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-run\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-netns\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599969 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-env-overrides\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-ovn\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-netns\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.599979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-netns\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600027 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-ovn\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-multus\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-etc-kubernetes\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600065 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-netns\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-multus\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-etc-kubernetes\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-cnibin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-system-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-tuned\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600204 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-cnibin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-slash\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.600869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600256 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-slash\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-system-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76d205-e9e9-4161-b48a-aebb70401532-ovn-node-metrics-cert\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-hostroot\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600379 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-hostroot\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-bin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf9kf\" (UniqueName: \"kubernetes.io/projected/b0051ccc-776e-4005-b943-3e86b4f7a5d7-kube-api-access-bf9kf\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-device-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-os-release\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-cni-bin\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbd7s\" (UniqueName: \"kubernetes.io/projected/5d76d205-e9e9-4161-b48a-aebb70401532-kube-api-access-fbd7s\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-host-slash\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.600463 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-netd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-netd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.601742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-host-slash\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.600608 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:13:42.100568043 +0000 UTC m=+3.025249968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-k8s-cni-cncf-io\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600695 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-etc-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-cni-dir\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-k8s-cni-cncf-io\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-system-cni-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-etc-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-modprobe-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-os-release\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-daemon-config\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0051ccc-776e-4005-b943-3e86b4f7a5d7-serviceca\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-multus-certs\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.602545 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600972 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-os-release\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.600980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-tmp\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-run-multus-certs\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvhxw\" (UniqueName: \"kubernetes.io/projected/095aa08c-f837-4da9-925a-3bc9fdecd0c7-kube-api-access-bvhxw\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-iptables-alerter-script\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-config\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f76af9f-f3a6-4b84-b942-91a3e27c0366-agent-certs\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysconfig\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-openvswitch\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-sys\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd6r7\" (UniqueName: \"kubernetes.io/projected/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-kube-api-access-hd6r7\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-systemd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-bin\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-script-lib\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-socket-dir-parent\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-kubelet\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.603453 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-daemon-config\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-cni-bin\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9dl5\" (UniqueName: \"kubernetes.io/projected/a1ff4dab-cd92-4afc-9190-57324cd003f1-kube-api-access-j9dl5\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-iptables-alerter-script\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601704 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-run-systemd\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-multus-socket-dir-parent\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjk9\" (UniqueName: \"kubernetes.io/projected/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kube-api-access-dfjk9\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ff4dab-cd92-4afc-9190-57324cd003f1-host-var-lib-kubelet\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-kubelet\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601783 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-config\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-cni-binary-copy\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d76d205-e9e9-4161-b48a-aebb70401532-host-kubelet\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-dbus\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601919 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d76d205-e9e9-4161-b48a-aebb70401532-ovnkube-script-lib\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.604169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.601963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.604670 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.602187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ff4dab-cd92-4afc-9190-57324cd003f1-cni-binary-copy\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.604670 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.604288 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76d205-e9e9-4161-b48a-aebb70401532-ovn-node-metrics-cert\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.609768 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.609731 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:41.609768 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.609750 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:41.609768 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.609761 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:41.609996 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.609818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:13:42.109799535 +0000 UTC m=+3.034481442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:41.610702 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.610671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7r4x\" (UniqueName: \"kubernetes.io/projected/e9acbe3e-4217-473d-b1cd-0c0c561f9c4a-kube-api-access-w7r4x\") pod \"node-resolver-tlm8j\" (UID: \"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a\") " pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.611055 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.611023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frxp\" (UniqueName: \"kubernetes.io/projected/30285260-6037-4126-8ef0-6989c385dffc-kube-api-access-6frxp\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:41.612036 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.612010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9dl5\" (UniqueName: \"kubernetes.io/projected/a1ff4dab-cd92-4afc-9190-57324cd003f1-kube-api-access-j9dl5\") pod \"multus-hx8dm\" (UID: \"a1ff4dab-cd92-4afc-9190-57324cd003f1\") " pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.612036 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.612027 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbd7s\" (UniqueName: \"kubernetes.io/projected/5d76d205-e9e9-4161-b48a-aebb70401532-kube-api-access-fbd7s\") pod \"ovnkube-node-sv5w2\" (UID: \"5d76d205-e9e9-4161-b48a-aebb70401532\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.612412 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.612393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd6r7\" (UniqueName: \"kubernetes.io/projected/1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa-kube-api-access-hd6r7\") pod \"iptables-alerter-nxhmb\" (UID: \"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa\") " pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.702561 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-kubernetes\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-run\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-kubernetes\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-run\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.702716 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.702725 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-tuned\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:41.702787 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:13:42.202767694 +0000 UTC m=+3.127449602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-socket-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-registration-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf9kf\" (UniqueName: \"kubernetes.io/projected/b0051ccc-776e-4005-b943-3e86b4f7a5d7-kube-api-access-bf9kf\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-device-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-os-release\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-system-cni-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702982 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-device-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.702993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-os-release\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-modprobe-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703029 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-system-cni-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0051ccc-776e-4005-b943-3e86b4f7a5d7-serviceca\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-tmp\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvhxw\" (UniqueName: \"kubernetes.io/projected/095aa08c-f837-4da9-925a-3bc9fdecd0c7-kube-api-access-bvhxw\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-modprobe-d\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f76af9f-f3a6-4b84-b942-91a3e27c0366-agent-certs\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysconfig\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-sys\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703230 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjk9\" (UniqueName: \"kubernetes.io/projected/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kube-api-access-dfjk9\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-dbus\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703338 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4bd\" (UniqueName: \"kubernetes.io/projected/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-kube-api-access-hk4bd\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.703906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-conf\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-systemd\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-lib-modules\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-var-lib-kubelet\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-kubelet-config\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-host\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0051ccc-776e-4005-b943-3e86b4f7a5d7-serviceca\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0051ccc-776e-4005-b943-3e86b4f7a5d7-host\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703603 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cnibin\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0051ccc-776e-4005-b943-3e86b4f7a5d7-host\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-kubelet-config\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f76af9f-f3a6-4b84-b942-91a3e27c0366-konnectivity-ca\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysconfig\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-systemd\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-lib-modules\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-sys\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.704760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-var-lib-kubelet\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703913 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-host\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.703966 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-sysctl-conf\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b6d1a04-7c30-40ed-a03d-138acaf994c1-dbus\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-etc-selinux\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f76af9f-f3a6-4b84-b942-91a3e27c0366-konnectivity-ca\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704350 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cnibin\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-sys-fs\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.704667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.705744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.705497 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-etc-tuned\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.706492 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.706463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f76af9f-f3a6-4b84-b942-91a3e27c0366-agent-certs\") pod \"konnectivity-agent-f2w5r\" (UID: \"1f76af9f-f3a6-4b84-b942-91a3e27c0366\") " pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.706595 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.706569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/095aa08c-f837-4da9-925a-3bc9fdecd0c7-tmp\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.713144 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.713122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf9kf\" (UniqueName: \"kubernetes.io/projected/b0051ccc-776e-4005-b943-3e86b4f7a5d7-kube-api-access-bf9kf\") pod \"node-ca-ghxxn\" (UID: \"b0051ccc-776e-4005-b943-3e86b4f7a5d7\") " pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.714094 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.714070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjk9\" (UniqueName: \"kubernetes.io/projected/f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7-kube-api-access-dfjk9\") pod \"aws-ebs-csi-driver-node-zqmgr\" (UID: \"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.714939 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.714875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvhxw\" (UniqueName: \"kubernetes.io/projected/095aa08c-f837-4da9-925a-3bc9fdecd0c7-kube-api-access-bvhxw\") pod \"tuned-cfvg2\" (UID: \"095aa08c-f837-4da9-925a-3bc9fdecd0c7\") " pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.715591 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.715569 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4bd\" (UniqueName: \"kubernetes.io/projected/faf314e6-4e69-4158-af2e-dd2df5ab0cf1-kube-api-access-hk4bd\") pod \"multus-additional-cni-plugins-x7lmh\" (UID: \"faf314e6-4e69-4158-af2e-dd2df5ab0cf1\") " pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:41.789766 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.789730 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxhmb" Jun 14 15:13:41.800092 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.800070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:13:41.808194 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.808172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tlm8j" Jun 14 15:13:41.816024 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.816006 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hx8dm" Jun 14 15:13:41.822273 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.822251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" Jun 14 15:13:41.825722 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.825705 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:13:41.829881 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.829861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:13:41.835747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.835728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghxxn" Jun 14 15:13:41.841472 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.841452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" Jun 14 15:13:41.846391 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:41.846370 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" Jun 14 15:13:42.105991 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.105954 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:42.106165 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.106091 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:42.106212 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.106166 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:13:43.106143996 +0000 UTC m=+4.030825905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:42.126869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.126842 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:13:42.206657 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.206610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:42.206841 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.206683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:42.206841 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206782 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:42.206841 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206800 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:42.206841 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206825 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:42.206841 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206840 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:42.207108 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206839 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:13:43.206820648 +0000 UTC m=+4.131502556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:42.207108 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.206923 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:13:43.206908824 +0000 UTC m=+4.131590730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:42.296594 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.296566 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d76d205_e9e9_4161_b48a_aebb70401532.slice/crio-3f659e5c6bfc6f64dd013cdd14fa466dcd67ac3ec0f8cd11c75a92e633630aad WatchSource:0}: Error finding container 3f659e5c6bfc6f64dd013cdd14fa466dcd67ac3ec0f8cd11c75a92e633630aad: Status 404 returned error can't find the container with id 3f659e5c6bfc6f64dd013cdd14fa466dcd67ac3ec0f8cd11c75a92e633630aad Jun 14 15:13:42.298341 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.298322 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f76af9f_f3a6_4b84_b942_91a3e27c0366.slice/crio-06430d2d37b8696c920afef7f28610aa7cf2b6f480394265d45ad3c64637e953 WatchSource:0}: Error finding container 06430d2d37b8696c920afef7f28610aa7cf2b6f480394265d45ad3c64637e953: Status 404 returned error can't find the container with id 06430d2d37b8696c920afef7f28610aa7cf2b6f480394265d45ad3c64637e953 Jun 14 15:13:42.300100 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.300041 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0051ccc_776e_4005_b943_3e86b4f7a5d7.slice/crio-e51a7b1a187c4ea8bef235dd8a2709863227975e7a8282f88c1fbfcc7290f8c8 WatchSource:0}: Error finding container e51a7b1a187c4ea8bef235dd8a2709863227975e7a8282f88c1fbfcc7290f8c8: Status 404 returned error can't find the container with id e51a7b1a187c4ea8bef235dd8a2709863227975e7a8282f88c1fbfcc7290f8c8 Jun 14 15:13:42.302329 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.302301 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9acbe3e_4217_473d_b1cd_0c0c561f9c4a.slice/crio-dea4a174945d4924e8e1596cddc5f5490c1552f9020705393b0c15183240a0cd WatchSource:0}: Error finding container dea4a174945d4924e8e1596cddc5f5490c1552f9020705393b0c15183240a0cd: Status 404 returned error can't find the container with id dea4a174945d4924e8e1596cddc5f5490c1552f9020705393b0c15183240a0cd Jun 14 15:13:42.303290 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.303175 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fc6b07_2d0e_4a46_a809_18c2ff0e8ec7.slice/crio-60a79df86f3627ef3613684856860c94f694b469f63d5e2f7ee8e745e2935a09 WatchSource:0}: Error finding container 60a79df86f3627ef3613684856860c94f694b469f63d5e2f7ee8e745e2935a09: Status 404 returned error can't find the container with id 60a79df86f3627ef3613684856860c94f694b469f63d5e2f7ee8e745e2935a09 Jun 14 15:13:42.304097 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.304018 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095aa08c_f837_4da9_925a_3bc9fdecd0c7.slice/crio-c71ef1a1fc5e1e0cdf08fa13e1331a643b95fb788af04ede9f336819073db30c WatchSource:0}: Error finding container c71ef1a1fc5e1e0cdf08fa13e1331a643b95fb788af04ede9f336819073db30c: Status 404 returned error can't find the container with id c71ef1a1fc5e1e0cdf08fa13e1331a643b95fb788af04ede9f336819073db30c Jun 14 15:13:42.305877 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.305853 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ff4dab_cd92_4afc_9190_57324cd003f1.slice/crio-c42d15b8e29927ae845b6df4acfdb126cb9af2094c51d6b5ff15ceeb19706c2e WatchSource:0}: Error finding container c42d15b8e29927ae845b6df4acfdb126cb9af2094c51d6b5ff15ceeb19706c2e: Status 404 returned error can't find the container with id c42d15b8e29927ae845b6df4acfdb126cb9af2094c51d6b5ff15ceeb19706c2e Jun 14 15:13:42.308941 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:13:42.308898 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5b3f31_a8c4_4de4_aa3a_1fb2a8192ffa.slice/crio-33ef6bc6b5248a697b27beb6e4b6c2c91d0aadb7309e20f4c1ca8810b5068578 WatchSource:0}: Error finding container 33ef6bc6b5248a697b27beb6e4b6c2c91d0aadb7309e20f4c1ca8810b5068578: Status 404 returned error can't find the container with id 33ef6bc6b5248a697b27beb6e4b6c2c91d0aadb7309e20f4c1ca8810b5068578 Jun 14 15:13:42.555948 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.555896 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:08:41 +0000 UTC" deadline="2028-01-29 21:32:14.721778789 +0000 UTC" Jun 14 15:13:42.555948 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.555942 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14262h18m32.165839981s" Jun 14 15:13:42.558161 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.558136 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:42.558262 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:42.558235 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:42.566750 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.566724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hx8dm" event={"ID":"a1ff4dab-cd92-4afc-9190-57324cd003f1","Type":"ContainerStarted","Data":"c42d15b8e29927ae845b6df4acfdb126cb9af2094c51d6b5ff15ceeb19706c2e"} Jun 14 15:13:42.567990 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.567967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tlm8j" event={"ID":"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a","Type":"ContainerStarted","Data":"dea4a174945d4924e8e1596cddc5f5490c1552f9020705393b0c15183240a0cd"} Jun 14 15:13:42.568998 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.568973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghxxn" event={"ID":"b0051ccc-776e-4005-b943-3e86b4f7a5d7","Type":"ContainerStarted","Data":"e51a7b1a187c4ea8bef235dd8a2709863227975e7a8282f88c1fbfcc7290f8c8"} Jun 14 15:13:42.570005 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.569978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2w5r" event={"ID":"1f76af9f-f3a6-4b84-b942-91a3e27c0366","Type":"ContainerStarted","Data":"06430d2d37b8696c920afef7f28610aa7cf2b6f480394265d45ad3c64637e953"} Jun 14 15:13:42.570904 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.570881 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerStarted","Data":"1871525bd32456ff1d225bb53d58a28d87567087fbaafc2e0d3489ecf1f52909"} Jun 14 15:13:42.571822 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.571805 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" event={"ID":"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7","Type":"ContainerStarted","Data":"60a79df86f3627ef3613684856860c94f694b469f63d5e2f7ee8e745e2935a09"} Jun 14 15:13:42.572738 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.572720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" event={"ID":"095aa08c-f837-4da9-925a-3bc9fdecd0c7","Type":"ContainerStarted","Data":"c71ef1a1fc5e1e0cdf08fa13e1331a643b95fb788af04ede9f336819073db30c"} Jun 14 15:13:42.573772 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.573753 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"3f659e5c6bfc6f64dd013cdd14fa466dcd67ac3ec0f8cd11c75a92e633630aad"} Jun 14 15:13:42.575738 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.575710 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" event={"ID":"a64a0089d96df9e7686766c7f0343b5c","Type":"ContainerStarted","Data":"f01104c6882d9f95bd6c9d63ffc2161dc915b61873b9336b2894308387ed0395"} Jun 14 15:13:42.577467 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.577414 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxhmb" event={"ID":"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa","Type":"ContainerStarted","Data":"33ef6bc6b5248a697b27beb6e4b6c2c91d0aadb7309e20f4c1ca8810b5068578"} Jun 14 15:13:42.590413 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:42.590326 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-194.ec2.internal" podStartSLOduration=1.5902821870000001 podStartE2EDuration="1.590282187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:13:42.590035515 +0000 UTC m=+3.514717445" watchObservedRunningTime="2026-06-14 15:13:42.590282187 +0000 UTC m=+3.514964117" Jun 14 15:13:43.113502 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.112891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:43.113502 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.113099 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:43.113502 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.113173 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:13:45.113154842 +0000 UTC m=+6.037836752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:43.213333 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.213296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:43.213513 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.213370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:43.213513 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.213505 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:43.213631 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.213585 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:13:45.213566491 +0000 UTC m=+6.138248402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:43.214438 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.214002 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:43.214438 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.214025 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:43.214438 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.214037 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:43.214438 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.214078 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:13:45.214064215 +0000 UTC m=+6.138746127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:43.556434 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.556353 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:08:41 +0000 UTC" deadline="2028-03-20 17:38:15.410385922 +0000 UTC" Jun 14 15:13:43.556434 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.556390 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15482h24m31.854000518s" Jun 14 15:13:43.560987 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.558431 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:43.560987 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.558599 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:43.560987 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.559016 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:43.560987 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:43.559120 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:43.598629 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.598592 2567 generic.go:356] "Generic (PLEG): container finished" podID="6966a3b5ef7b3f02e3b85e0510d36f37" containerID="41c41c0063af2297bdeaeb829f413996244a9b5fb10301e7b05f8247fa3c3941" exitCode=0 Jun 14 15:13:43.599587 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:43.599562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerDied","Data":"41c41c0063af2297bdeaeb829f413996244a9b5fb10301e7b05f8247fa3c3941"} Jun 14 15:13:44.558912 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:44.558369 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:44.558912 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:44.558558 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:44.628839 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:44.628107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" event={"ID":"6966a3b5ef7b3f02e3b85e0510d36f37","Type":"ContainerStarted","Data":"2c17133f11a1eb76d46e7dffd627d08aa3247e4328e30fc3e0664dde78a340a9"} Jun 14 15:13:45.135129 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:45.135090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:45.135322 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.135285 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:45.135395 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.135353 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:13:49.13533245 +0000 UTC m=+10.060014376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:45.235735 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:45.235696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:45.235921 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:45.235778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:45.235978 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.235927 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:45.236026 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.235991 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:13:49.23597277 +0000 UTC m=+10.160654681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:45.236748 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.236413 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:45.236748 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.236438 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:45.236748 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.236450 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:45.236748 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.236497 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:13:49.236482518 +0000 UTC m=+10.161164445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:45.558391 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:45.558353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:45.558567 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.558531 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:45.558670 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:45.558649 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:45.558803 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:45.558767 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:46.558212 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:46.558177 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:46.558704 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:46.558344 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:47.558660 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:47.558142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:47.558660 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:47.558279 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:47.558660 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:47.558317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:47.558660 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:47.558433 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:48.558929 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:48.558899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:48.559434 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:48.559024 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:49.174027 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:49.173981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:49.174224 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.174154 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:49.174224 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.174223 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:13:57.174201983 +0000 UTC m=+18.098883907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:49.275211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:49.275311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275411 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275439 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275453 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:49.275478 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275476 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:49.275896 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275514 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:13:57.2754928 +0000 UTC m=+18.200174707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:49.275896 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.275570 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:13:57.275554449 +0000 UTC m=+18.200236357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:49.560284 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:49.560254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:49.560914 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.560886 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:49.561439 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:49.561414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:49.561605 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:49.561582 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:50.559063 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:50.558556 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:50.559063 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:50.558685 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:51.557994 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:51.557939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:51.558459 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:51.558078 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:51.558459 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:51.558126 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:51.558459 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:51.558253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:52.558120 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:52.558082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:52.558536 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:52.558208 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:53.558574 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:53.558543 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:53.559023 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:53.558549 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:53.559023 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:53.558673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:53.559023 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:53.558739 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:54.557944 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:54.557911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:54.558132 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:54.558034 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:55.558780 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:55.558752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:55.559236 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:55.558873 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:55.559236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:55.558923 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:55.559236 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:55.559035 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:56.558927 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:56.558896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:56.559373 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:56.559004 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:57.231786 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:57.231752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:57.231946 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.231900 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:57.231988 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.231959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:13.231944228 +0000 UTC m=+34.156626135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:13:57.332359 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:57.332315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:57.332562 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:57.332380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:57.332562 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332511 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:13:57.332562 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332556 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:13:57.332562 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332559 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:57.332827 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332570 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:57.332827 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332628 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:13.332608152 +0000 UTC m=+34.257290061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:13:57.332827 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.332663 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:14:13.332652575 +0000 UTC m=+34.257334482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:13:57.558986 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:57.558915 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:57.559399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:57.558915 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:57.559399 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.559046 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:57.559399 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:57.559119 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:13:58.557977 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:58.557937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:13:58.558151 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:58.558065 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:13:59.559715 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:59.559684 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:13:59.560231 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:59.559816 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:13:59.560231 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:13:59.559875 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:13:59.560231 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:13:59.559998 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:00.558824 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:00.558793 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:00.558996 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:00.558900 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:01.558795 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.558602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:01.559409 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.558602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:01.559409 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:01.558913 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:01.559409 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:01.558991 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:01.662719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.662617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hx8dm" event={"ID":"a1ff4dab-cd92-4afc-9190-57324cd003f1","Type":"ContainerStarted","Data":"bbe372c58372ad99b8dee85ecc483e1aa65806cbdddcae73045efac2811f0e2f"} Jun 14 15:14:01.664146 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.664120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tlm8j" event={"ID":"e9acbe3e-4217-473d-b1cd-0c0c561f9c4a","Type":"ContainerStarted","Data":"b23918e12540d4d7fe55882cab67008ff0feb766d5910949f697eb403c6d22bf"} Jun 14 15:14:01.665720 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.665695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghxxn" event={"ID":"b0051ccc-776e-4005-b943-3e86b4f7a5d7","Type":"ContainerStarted","Data":"1f2724e226381a4f19e3dfc8770d11a42c22f3624ae19911faf6b2cb57d8ca01"} Jun 14 15:14:01.667231 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.667184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2w5r" event={"ID":"1f76af9f-f3a6-4b84-b942-91a3e27c0366","Type":"ContainerStarted","Data":"e2523e14acc190d69ffd96e3cc6df702ace4f48581a17541e22a676aa2d6897d"} Jun 14 15:14:01.668928 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.668904 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="1a735c06190372abf3577368ed6464c7715111297406a31062f1458ea8e2ed35" exitCode=0 Jun 14 15:14:01.669040 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.668988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"1a735c06190372abf3577368ed6464c7715111297406a31062f1458ea8e2ed35"} Jun 14 15:14:01.670605 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.670583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" event={"ID":"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7","Type":"ContainerStarted","Data":"1dce187d13be0da09ab2945b66db263532ed659ae2df1b2037a21e3206ebc865"} Jun 14 15:14:01.672250 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.672150 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" event={"ID":"095aa08c-f837-4da9-925a-3bc9fdecd0c7","Type":"ContainerStarted","Data":"25848c98e4bbe8d8c32db346da35c37ad334e56daef9bd359512d97f1ae3d0be"} Jun 14 15:14:01.675189 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:14:01.675573 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675555 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d76d205-e9e9-4161-b48a-aebb70401532" containerID="e3a0a1ede25f10ddce946bf5109b9a5ec8f3650af2f54dc859957c3aaaba8ede" exitCode=1 Jun 14 15:14:01.675650 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"cf2d2aff6eeaf60475e406099ef79562808fb045399849ecb6e3cb534926d985"} Jun 14 15:14:01.675705 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"c54c0b10e81b339a3fba9f57aeac71be9d3eb936aedb08310047741933f0d135"} Jun 14 15:14:01.675766 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"f17384765ae726a4745b781e88aa77be59201570447fa9d992e97a06d8294a8d"} Jun 14 15:14:01.675766 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"dd9c47c49da3058faf389cbf90ca8199137d5d443d72643ecb12a348fac0d91b"} Jun 14 15:14:01.675864 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerDied","Data":"e3a0a1ede25f10ddce946bf5109b9a5ec8f3650af2f54dc859957c3aaaba8ede"} Jun 14 15:14:01.675864 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.675855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"2bf382dca98b41ac2c271f54a94b95e4d9dcd97b9519b989213d8088067bdb03"} Jun 14 15:14:01.682173 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.682128 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hx8dm" podStartSLOduration=4.195309652 podStartE2EDuration="22.682117781s" totalImagesPullingTime="18.486808129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:01.681947171 +0000 UTC m=+22.606629099" watchObservedRunningTime="2026-06-14 15:14:01.682117781 +0000 UTC m=+22.606799707" Jun 14 15:14:01.682543 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.682494 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-194.ec2.internal" podStartSLOduration=20.682485037 podStartE2EDuration="20.682485037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:13:44.646455168 +0000 UTC m=+5.571137098" watchObservedRunningTime="2026-06-14 15:14:01.682485037 +0000 UTC m=+22.607166969" Jun 14 15:14:01.728636 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.728572 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tlm8j" podStartSLOduration=4.279958591 podStartE2EDuration="22.72855241s" totalImagesPullingTime="18.448593819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:01.728172671 +0000 UTC m=+22.652854601" watchObservedRunningTime="2026-06-14 15:14:01.72855241 +0000 UTC m=+22.653234340" Jun 14 15:14:01.745966 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.745914 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cfvg2" podStartSLOduration=4.26729209 podStartE2EDuration="22.745898952s" totalImagesPullingTime="18.478606862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:01.745532502 +0000 UTC m=+22.670214422" watchObservedRunningTime="2026-06-14 15:14:01.745898952 +0000 UTC m=+22.670580913" Jun 14 15:14:01.762047 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.761981 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f2w5r" podStartSLOduration=9.008481012 podStartE2EDuration="22.761960556s" totalImagesPullingTime="13.753479544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:01.761337246 +0000 UTC m=+22.686019174" watchObservedRunningTime="2026-06-14 15:14:01.761960556 +0000 UTC m=+22.686642486" Jun 14 15:14:01.777198 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:01.777148 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ghxxn" podStartSLOduration=4.296329035 podStartE2EDuration="22.77713345s" totalImagesPullingTime="18.480804415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:01.776777394 +0000 UTC m=+22.701459324" watchObservedRunningTime="2026-06-14 15:14:01.77713345 +0000 UTC m=+22.701815380" Jun 14 15:14:02.360904 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.360739 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 15:14:02.559074 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.559033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:02.559513 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:02.559163 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:02.559513 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.559275 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T15:14:02.360897182Z","UUID":"9f4e7701-4af0-439b-903a-a2d64052edb5","Handler":null,"Name":"","Endpoint":""} Jun 14 15:14:02.560987 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.560970 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 15:14:02.561079 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.561009 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 15:14:02.678945 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.678909 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" event={"ID":"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7","Type":"ContainerStarted","Data":"44d78790a3eabaab59581af045b9abdd42a801999e2cfab7819d26f7f67fcad5"} Jun 14 15:14:02.680285 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.680262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxhmb" event={"ID":"1d5b3f31-a8c4-4de4-aa3a-1fb2a8192ffa","Type":"ContainerStarted","Data":"f77143a90b9665ce3855f6edd0f5795053c562c0da0938b7266d03b0ffd12ece"} Jun 14 15:14:02.698810 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:02.698762 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nxhmb" podStartSLOduration=5.256627373 podStartE2EDuration="23.698748032s" totalImagesPullingTime="18.442120659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:02.698202633 +0000 UTC m=+23.622884561" watchObservedRunningTime="2026-06-14 15:14:02.698748032 +0000 UTC m=+23.623429961" Jun 14 15:14:03.558413 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.558376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:03.558591 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:03.558505 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:03.558591 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.558558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:03.558678 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:03.558657 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:03.685661 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.685609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" event={"ID":"f1fc6b07-2d0e-4a46-a809-18c2ff0e8ec7","Type":"ContainerStarted","Data":"1a7f5f7b8d3386f15f2febae6e66fa095f4a96fe9fd94f4bb1af7a225a49a31c"} Jun 14 15:14:03.692710 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.692684 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:14:03.693307 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.693281 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"fd8c3cf24614dc8ef5e47b4684bd79ed5fab05bf88ac9e2ff995e5c4c8852146"} Jun 14 15:14:03.710001 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:03.709955 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zqmgr" podStartSLOduration=4.04116041 podStartE2EDuration="24.709938664s" totalImagesPullingTime="20.668778254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:03.709647749 +0000 UTC m=+24.634329679" watchObservedRunningTime="2026-06-14 15:14:03.709938664 +0000 UTC m=+24.634620592" Jun 14 15:14:04.558355 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:04.558316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:04.558536 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:04.558454 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:05.405029 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.404996 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:14:05.405950 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.405930 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:14:05.558639 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.558599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:05.558823 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.558599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:05.558823 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:05.558745 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:05.558932 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:05.558877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:05.698794 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.698757 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:14:05.699428 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:05.699406 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f2w5r" Jun 14 15:14:06.558868 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.558690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:06.559327 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:06.558949 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:06.702214 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.702181 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="c724731c081d57ab794d44edd89ea5415b6f9942aa3b77c6e1c258efc354e31e" exitCode=0 Jun 14 15:14:06.702410 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.702280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"c724731c081d57ab794d44edd89ea5415b6f9942aa3b77c6e1c258efc354e31e"} Jun 14 15:14:06.705935 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.705914 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:14:06.706261 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.706235 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"f04c38cc5fd490b3ee3632082f5d5263c5bcb12f0c2a278fd0341b7ef8716116"} Jun 14 15:14:06.706734 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:06.706718 2567 scope.go:117] "RemoveContainer" containerID="e3a0a1ede25f10ddce946bf5109b9a5ec8f3650af2f54dc859957c3aaaba8ede" Jun 14 15:14:07.558607 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.558579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:07.558830 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.558589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:07.558830 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:07.558698 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:07.558830 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:07.558748 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:07.710956 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.710816 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="75113d75d8e605c85a053eff2163e039ef7e03bf91464d23e4cc690d936a5329" exitCode=0 Jun 14 15:14:07.711117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.710905 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"75113d75d8e605c85a053eff2163e039ef7e03bf91464d23e4cc690d936a5329"} Jun 14 15:14:07.714855 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.714839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:14:07.715209 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.715182 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" event={"ID":"5d76d205-e9e9-4161-b48a-aebb70401532","Type":"ContainerStarted","Data":"8d377221f262e3b0c3e61cbb3c616bd2063a35ec6519f45c805e2a57857bf796"} Jun 14 15:14:07.715553 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.715503 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:07.715858 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.715831 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:07.715931 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.715925 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:07.731440 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.731416 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:07.731612 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.731597 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:07.764239 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.764196 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" podStartSLOduration=10.22239872 podStartE2EDuration="28.764183128s" totalImagesPullingTime="18.541784408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:07.763394914 +0000 UTC m=+28.688076867" watchObservedRunningTime="2026-06-14 15:14:07.764183128 +0000 UTC m=+28.688865056" Jun 14 15:14:07.887350 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.887316 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwc5s"] Jun 14 15:14:07.887542 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.887456 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:07.887620 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:07.887567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:07.891114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.891089 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6hx4"] Jun 14 15:14:07.891231 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.891201 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:07.891330 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:07.891297 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:07.891916 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.891887 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48cl4"] Jun 14 15:14:07.892036 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:07.891976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:07.892100 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:07.892049 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:08.719469 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:08.719386 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="74cb03c76d265a81d887ce0e8b1d6677f653b226c83004359b2d793533e3771f" exitCode=0 Jun 14 15:14:08.719986 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:08.719479 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"74cb03c76d265a81d887ce0e8b1d6677f653b226c83004359b2d793533e3771f"} Jun 14 15:14:09.561779 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:09.561736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:09.561957 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:09.561930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:09.562108 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:09.562080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:09.562249 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:09.562224 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:09.562385 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:09.562356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:09.562573 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:09.562514 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:11.558475 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:11.558447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:11.559137 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:11.558447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:11.559137 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:11.558605 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:11.559137 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:11.558444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:11.559137 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:11.558653 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:11.559137 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:11.558701 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:13.260161 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.259974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:13.260161 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.260157 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:13.260582 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.260246 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs podName:30285260-6037-4126-8ef0-6989c385dffc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:45.260224012 +0000 UTC m=+66.184905933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs") pod "network-metrics-daemon-d6hx4" (UID: "30285260-6037-4126-8ef0-6989c385dffc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:14:13.361056 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.360956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:13.361056 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.361016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:13.361226 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361114 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:13.361226 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361178 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret podName:3b6d1a04-7c30-40ed-a03d-138acaf994c1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:45.361164261 +0000 UTC m=+66.285846172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret") pod "global-pull-secret-syncer-qwc5s" (UID: "3b6d1a04-7c30-40ed-a03d-138acaf994c1") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:14:13.361226 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361124 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:14:13.361226 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361205 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:14:13.361226 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361215 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9d82g for pod openshift-network-diagnostics/network-check-target-48cl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:13.361403 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.361243 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g podName:dbb0be2d-226a-46a8-9649-5badbc9ae5dd nodeName:}" failed. No retries permitted until 2026-06-14 15:14:45.361236569 +0000 UTC m=+66.285918475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9d82g" (UniqueName: "kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g") pod "network-check-target-48cl4" (UID: "dbb0be2d-226a-46a8-9649-5badbc9ae5dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:14:13.558901 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.558872 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:13.559069 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.558979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:13.559069 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.558994 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6hx4" podUID="30285260-6037-4126-8ef0-6989c385dffc" Jun 14 15:14:13.559069 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.559057 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwc5s" podUID="3b6d1a04-7c30-40ed-a03d-138acaf994c1" Jun 14 15:14:13.559206 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.559064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:13.559206 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:13.559154 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48cl4" podUID="dbb0be2d-226a-46a8-9649-5badbc9ae5dd" Jun 14 15:14:13.732864 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.732833 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="31fe3798244eecff723ed08b51f2b565402ae6be1dc0592731022247ca882ecc" exitCode=0 Jun 14 15:14:13.733008 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.732895 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"31fe3798244eecff723ed08b51f2b565402ae6be1dc0592731022247ca882ecc"} Jun 14 15:14:13.914814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.914791 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-194.ec2.internal" event="NodeReady" Jun 14 15:14:13.914935 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.914926 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 15:14:13.963451 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.963420 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kq8gz"] Jun 14 15:14:13.975730 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.975709 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8pkxv"] Jun 14 15:14:13.975874 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.975855 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:13.978649 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.978627 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 15:14:13.978747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.978677 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qlmw\"" Jun 14 15:14:13.978747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.978675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 15:14:13.987632 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.987587 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kq8gz"] Jun 14 15:14:13.987632 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.987618 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pkxv"] Jun 14 15:14:13.987756 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.987706 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:13.990342 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.990325 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 15:14:13.990437 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.990399 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cwm5q\"" Jun 14 15:14:13.990497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.990444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 15:14:13.990497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:13.990473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 15:14:14.066764 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvpc9\" (UniqueName: \"kubernetes.io/projected/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-kube-api-access-lvpc9\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.066911 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-cert\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.066911 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.066911 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456ce9ab-423f-4141-88cb-280e5a1552d1-tmp-dir\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.066911 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlzd\" (UniqueName: \"kubernetes.io/projected/456ce9ab-423f-4141-88cb-280e5a1552d1-kube-api-access-7qlzd\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.066911 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.066902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456ce9ab-423f-4141-88cb-280e5a1552d1-config-volume\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.167614 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvpc9\" (UniqueName: \"kubernetes.io/projected/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-kube-api-access-lvpc9\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.167774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-cert\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.167774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.167774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456ce9ab-423f-4141-88cb-280e5a1552d1-tmp-dir\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.167774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlzd\" (UniqueName: \"kubernetes.io/projected/456ce9ab-423f-4141-88cb-280e5a1552d1-kube-api-access-7qlzd\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.167774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.167725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456ce9ab-423f-4141-88cb-280e5a1552d1-config-volume\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.167967 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:14.167795 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:14.167967 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:14.167883 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:14.667860778 +0000 UTC m=+35.592542699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:14.168094 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.168077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/456ce9ab-423f-4141-88cb-280e5a1552d1-tmp-dir\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.168261 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.168244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/456ce9ab-423f-4141-88cb-280e5a1552d1-config-volume\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.171807 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.171783 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-cert\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.176440 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.176419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvpc9\" (UniqueName: \"kubernetes.io/projected/5e054323-a283-4a2e-8205-ef2f9ee6f2e1-kube-api-access-lvpc9\") pod \"ingress-canary-8pkxv\" (UID: \"5e054323-a283-4a2e-8205-ef2f9ee6f2e1\") " pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.176719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.176703 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlzd\" (UniqueName: \"kubernetes.io/projected/456ce9ab-423f-4141-88cb-280e5a1552d1-kube-api-access-7qlzd\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.295227 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.295152 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pkxv" Jun 14 15:14:14.498118 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.498076 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pkxv"] Jun 14 15:14:14.502415 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:14.502388 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e054323_a283_4a2e_8205_ef2f9ee6f2e1.slice/crio-d391d8b378303162292fd9322ec37a1d001a18e0cd6e9257bf53b095e773a6db WatchSource:0}: Error finding container d391d8b378303162292fd9322ec37a1d001a18e0cd6e9257bf53b095e773a6db: Status 404 returned error can't find the container with id d391d8b378303162292fd9322ec37a1d001a18e0cd6e9257bf53b095e773a6db Jun 14 15:14:14.671770 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.671698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:14.671894 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:14.671819 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:14.671894 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:14.671882 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:15.671866572 +0000 UTC m=+36.596548479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:14.736028 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.735990 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pkxv" event={"ID":"5e054323-a283-4a2e-8205-ef2f9ee6f2e1","Type":"ContainerStarted","Data":"d391d8b378303162292fd9322ec37a1d001a18e0cd6e9257bf53b095e773a6db"} Jun 14 15:14:14.741682 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.739267 2567 generic.go:356] "Generic (PLEG): container finished" podID="faf314e6-4e69-4158-af2e-dd2df5ab0cf1" containerID="fde491f424b46016ea328ea7e778343112144a8924b6607caacb17c0974f853e" exitCode=0 Jun 14 15:14:14.741682 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:14.739327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerDied","Data":"fde491f424b46016ea328ea7e778343112144a8924b6607caacb17c0974f853e"} Jun 14 15:14:15.558339 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.558165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:15.558798 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.558165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:15.558798 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.558232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:15.561500 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.561471 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:14:15.562821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.562797 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:14:15.562821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.562807 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:14:15.562821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.562816 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:14:15.563034 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.562797 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gt8x4\"" Jun 14 15:14:15.563034 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.562807 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cdz8q\"" Jun 14 15:14:15.680232 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.680194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:15.680401 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:15.680323 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:15.680474 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:15.680407 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:17.680384777 +0000 UTC m=+38.605066683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:15.748486 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.748433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" event={"ID":"faf314e6-4e69-4158-af2e-dd2df5ab0cf1","Type":"ContainerStarted","Data":"696fb5e028e843d3e448fc63685bf457d61c69e4bfe2abaecd5545be9d9fd7a3"} Jun 14 15:14:15.773695 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:15.773637 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x7lmh" podStartSLOduration=8.679519936 podStartE2EDuration="36.773620807s" totalImagesPullingTime="28.094100871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:15.773018643 +0000 UTC m=+36.697700588" watchObservedRunningTime="2026-06-14 15:14:15.773620807 +0000 UTC m=+36.698302727" Jun 14 15:14:16.752468 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:16.752431 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pkxv" event={"ID":"5e054323-a283-4a2e-8205-ef2f9ee6f2e1","Type":"ContainerStarted","Data":"0c28a78a7d4616a6b7736ce8021dee718ba4e51b1e1c69b456c70b0f48173a69"} Jun 14 15:14:16.771000 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:16.770918 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8pkxv" podStartSLOduration=1.76044523 podStartE2EDuration="3.770902503s" totalImagesPullingTime="2.010457273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:16.769577479 +0000 UTC m=+37.694259408" watchObservedRunningTime="2026-06-14 15:14:16.770902503 +0000 UTC m=+37.695584432" Jun 14 15:14:17.693899 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:17.693823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:17.694026 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:17.693937 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:17.694026 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:17.693988 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:21.693975149 +0000 UTC m=+42.618657055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:21.722165 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:21.722124 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:21.722873 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:21.722291 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:21.722873 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:21.722366 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:29.722345431 +0000 UTC m=+50.647027338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:25.334811 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.334774 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fjjd8"] Jun 14 15:14:25.379553 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.379506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fjjd8"] Jun 14 15:14:25.379708 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.379611 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.393642 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.393620 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 15:14:25.393767 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.393717 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 15:14:25.394732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.394717 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 15:14:25.394831 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.394740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6mjcq\"" Jun 14 15:14:25.395893 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.395866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 15:14:25.401230 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.401210 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 15:14:25.430268 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.430237 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn"] Jun 14 15:14:25.452951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.452919 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68bd9d74dd-wf2wx"] Jun 14 15:14:25.453083 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.453037 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.456692 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.456671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 15:14:25.456845 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.456718 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 15:14:25.456845 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.456674 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfj52\"" Jun 14 15:14:25.457004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.456985 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 15:14:25.457422 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.457408 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 15:14:25.477153 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.477123 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn"] Jun 14 15:14:25.477153 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.477157 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68bd9d74dd-wf2wx"] Jun 14 15:14:25.477311 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.477233 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.481745 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.481722 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 15:14:25.481866 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.481768 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 15:14:25.481866 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.481734 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 15:14:25.481866 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.481855 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ps7rz\"" Jun 14 15:14:25.482949 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.482894 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 15:14:25.483038 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.482949 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 15:14:25.483112 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.483087 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 15:14:25.544998 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.544963 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7"] Jun 14 15:14:25.548206 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.548278 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.548278 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1fab5de-b072-4b75-81b0-cc04201d15bc-serving-cert\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.548362 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-tmp\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.548362 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.548362 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbxh\" (UniqueName: \"kubernetes.io/projected/f1fab5de-b072-4b75-81b0-cc04201d15bc-kube-api-access-8lbxh\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.548482 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.548482 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4b2b\" (UniqueName: \"kubernetes.io/projected/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-kube-api-access-j4b2b\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.548482 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.548423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-snapshots\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.566087 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.566007 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7"] Jun 14 15:14:25.566870 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.566159 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.569994 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.569971 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 15:14:25.570328 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.570309 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 15:14:25.570513 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.570491 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 15:14:25.570583 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.570542 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vbp4q\"" Jun 14 15:14:25.570776 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.570750 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:14:25.649324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.649324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbxh\" (UniqueName: \"kubernetes.io/projected/f1fab5de-b072-4b75-81b0-cc04201d15bc-kube-api-access-8lbxh\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85lc\" (UniqueName: \"kubernetes.io/projected/e7385fd9-6170-4eb3-86af-0a57f8b626c7-kube-api-access-s85lc\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4b2b\" (UniqueName: \"kubernetes.io/projected/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-kube-api-access-j4b2b\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-snapshots\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649631 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-stats-auth\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1fab5de-b072-4b75-81b0-cc04201d15bc-serving-cert\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-default-certificate\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:25.649809 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.649822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-tmp\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.649951 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:25.649878 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:26.149857973 +0000 UTC m=+47.074539880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:25.650293 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.650113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.650293 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.650279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-tmp\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.650384 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.650291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.650384 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.650298 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f1fab5de-b072-4b75-81b0-cc04201d15bc-snapshots\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.650454 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.650425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1fab5de-b072-4b75-81b0-cc04201d15bc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.653137 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.653119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1fab5de-b072-4b75-81b0-cc04201d15bc-serving-cert\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.670950 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.670921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbxh\" (UniqueName: \"kubernetes.io/projected/f1fab5de-b072-4b75-81b0-cc04201d15bc-kube-api-access-8lbxh\") pod \"insights-operator-5bbd86d6bd-fjjd8\" (UID: \"f1fab5de-b072-4b75-81b0-cc04201d15bc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.679973 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.679949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4b2b\" (UniqueName: \"kubernetes.io/projected/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-kube-api-access-j4b2b\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:25.687907 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.687888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" Jun 14 15:14:25.750205 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b341b2ad-f147-4851-a70b-c31e8a3e63d8-config\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-stats-auth\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-default-certificate\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85lc\" (UniqueName: \"kubernetes.io/projected/e7385fd9-6170-4eb3-86af-0a57f8b626c7-kube-api-access-s85lc\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.750399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b341b2ad-f147-4851-a70b-c31e8a3e63d8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.750917 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.750407 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzjc\" (UniqueName: \"kubernetes.io/projected/b341b2ad-f147-4851-a70b-c31e8a3e63d8-kube-api-access-tmzjc\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.750977 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:25.750947 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:25.751210 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:25.751031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:26.251008744 +0000 UTC m=+47.175690657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:25.751210 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:25.751159 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:26.251138546 +0000 UTC m=+47.175820466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:25.753733 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.753713 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-default-certificate\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.753871 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.753744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-stats-auth\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.759405 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.759383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85lc\" (UniqueName: \"kubernetes.io/projected/e7385fd9-6170-4eb3-86af-0a57f8b626c7-kube-api-access-s85lc\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:25.842048 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.842015 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fjjd8"] Jun 14 15:14:25.851249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.851227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b341b2ad-f147-4851-a70b-c31e8a3e63d8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.851324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.851256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzjc\" (UniqueName: \"kubernetes.io/projected/b341b2ad-f147-4851-a70b-c31e8a3e63d8-kube-api-access-tmzjc\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.851324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.851277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b341b2ad-f147-4851-a70b-c31e8a3e63d8-config\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.851758 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.851733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b341b2ad-f147-4851-a70b-c31e8a3e63d8-config\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.853460 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.853439 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b341b2ad-f147-4851-a70b-c31e8a3e63d8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.857703 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:25.857680 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fab5de_b072_4b75_81b0_cc04201d15bc.slice/crio-ad52d0d56b893ba957529e0158788170de732c8f88964178a7510af99a22be9b WatchSource:0}: Error finding container ad52d0d56b893ba957529e0158788170de732c8f88964178a7510af99a22be9b: Status 404 returned error can't find the container with id ad52d0d56b893ba957529e0158788170de732c8f88964178a7510af99a22be9b Jun 14 15:14:25.860386 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.860366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzjc\" (UniqueName: \"kubernetes.io/projected/b341b2ad-f147-4851-a70b-c31e8a3e63d8-kube-api-access-tmzjc\") pod \"service-ca-operator-7ccbfd59dc-dpcs7\" (UID: \"b341b2ad-f147-4851-a70b-c31e8a3e63d8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:25.876271 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:25.876243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" Jun 14 15:14:26.015481 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.015449 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7"] Jun 14 15:14:26.018849 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:26.018825 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb341b2ad_f147_4851_a70b_c31e8a3e63d8.slice/crio-40487fe567174eef9dadfd4bd2ef235a7a269bd61ce680e95d1672f045ee7862 WatchSource:0}: Error finding container 40487fe567174eef9dadfd4bd2ef235a7a269bd61ce680e95d1672f045ee7862: Status 404 returned error can't find the container with id 40487fe567174eef9dadfd4bd2ef235a7a269bd61ce680e95d1672f045ee7862 Jun 14 15:14:26.153830 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.153744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:26.153968 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:26.153883 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:26.153968 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:26.153945 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:27.153929854 +0000 UTC m=+48.078611761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:26.254954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.254914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:26.254954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.254957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:26.255205 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:26.255086 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:26.255205 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:26.255122 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:27.25510057 +0000 UTC m=+48.179782495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:26.255205 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:26.255151 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:27.255138817 +0000 UTC m=+48.179820723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:26.776129 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.776060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" event={"ID":"b341b2ad-f147-4851-a70b-c31e8a3e63d8","Type":"ContainerStarted","Data":"40487fe567174eef9dadfd4bd2ef235a7a269bd61ce680e95d1672f045ee7862"} Jun 14 15:14:26.777554 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:26.777500 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" event={"ID":"f1fab5de-b072-4b75-81b0-cc04201d15bc","Type":"ContainerStarted","Data":"ad52d0d56b893ba957529e0158788170de732c8f88964178a7510af99a22be9b"} Jun 14 15:14:27.162347 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:27.162258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:27.162509 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:27.162419 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:27.162509 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:27.162489 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:29.162470893 +0000 UTC m=+50.087152800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:27.263501 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:27.263464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:27.263676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:27.263526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:27.263743 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:27.263670 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:29.263647944 +0000 UTC m=+50.188329867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:27.263743 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:27.263674 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:27.263743 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:27.263722 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:29.26371031 +0000 UTC m=+50.188392237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:29.180935 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.180889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:29.181324 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.181039 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:29.181324 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.181106 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:33.18108969 +0000 UTC m=+54.105771596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:29.281404 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.281370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:29.281404 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.281403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:29.281661 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.281554 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:29.281661 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.281574 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:33.281553408 +0000 UTC m=+54.206235329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:29.281661 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.281603 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:33.281594776 +0000 UTC m=+54.206276686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:29.785140 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.785098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:29.785437 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.785279 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:14:29.785437 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:29.785358 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls podName:456ce9ab-423f-4141-88cb-280e5a1552d1 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:45.785338666 +0000 UTC m=+66.710020578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls") pod "dns-default-kq8gz" (UID: "456ce9ab-423f-4141-88cb-280e5a1552d1") : secret "dns-default-metrics-tls" not found Jun 14 15:14:29.788577 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.788544 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" event={"ID":"b341b2ad-f147-4851-a70b-c31e8a3e63d8","Type":"ContainerStarted","Data":"14008ddce1f63a991b9aa00bb60d745254b0bf7c643c82248edc7241f07fde2d"} Jun 14 15:14:29.790105 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.790082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" event={"ID":"f1fab5de-b072-4b75-81b0-cc04201d15bc","Type":"ContainerStarted","Data":"c0e3efb9eb0664a348db938ed3247ab916ad2e9cc7d3af53e890fac32c997e62"} Jun 14 15:14:29.805432 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.805392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" podStartSLOduration=2.109884548 podStartE2EDuration="4.80537994s" totalImagesPullingTime="2.695495392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:29.804430797 +0000 UTC m=+50.729112725" watchObservedRunningTime="2026-06-14 15:14:29.80537994 +0000 UTC m=+50.730061848" Jun 14 15:14:29.825613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:29.825563 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" podStartSLOduration=1.9748814449999998 podStartE2EDuration="4.825549026s" totalImagesPullingTime="2.850667581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:29.825056042 +0000 UTC m=+50.749737972" watchObservedRunningTime="2026-06-14 15:14:29.825549026 +0000 UTC m=+50.750230953" Jun 14 15:14:30.445074 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.445042 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w2rb9"] Jun 14 15:14:30.468586 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.468548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w2rb9"] Jun 14 15:14:30.468735 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.468627 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.471260 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.471238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 15:14:30.471401 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.471242 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gkvzf\"" Jun 14 15:14:30.471468 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.471278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 15:14:30.590380 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.590345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f56a3fb5-8573-4e81-8d56-ba90d9075c47-crio-socket\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.590565 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.590407 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.590565 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.590432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctrt\" (UniqueName: \"kubernetes.io/projected/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-api-access-8ctrt\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.590565 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.590449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.590565 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.590469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f56a3fb5-8573-4e81-8d56-ba90d9075c47-data-volume\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.691760 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.691715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.691771 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctrt\" (UniqueName: \"kubernetes.io/projected/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-api-access-8ctrt\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.691802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.691826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f56a3fb5-8573-4e81-8d56-ba90d9075c47-data-volume\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:30.691879 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:30.691936 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:14:30.691962 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:30.691948 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:31.191928793 +0000 UTC m=+52.116610700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:30.692262 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.692031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f56a3fb5-8573-4e81-8d56-ba90d9075c47-crio-socket\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.692262 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:30.692037 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:31.192020673 +0000 UTC m=+52.116702580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : configmap "kube-rbac-proxy" not found Jun 14 15:14:30.692262 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.692187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f56a3fb5-8573-4e81-8d56-ba90d9075c47-crio-socket\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.692262 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.692215 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f56a3fb5-8573-4e81-8d56-ba90d9075c47-data-volume\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:30.701819 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:30.701766 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctrt\" (UniqueName: \"kubernetes.io/projected/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-api-access-8ctrt\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:31.196840 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:31.196803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:31.197003 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:31.196850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:31.197003 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:31.196931 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:14:31.197003 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:31.196955 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:31.197003 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:31.196983 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:32.196969356 +0000 UTC m=+53.121651263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : configmap "kube-rbac-proxy" not found Jun 14 15:14:31.197142 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:31.197015 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:32.197001616 +0000 UTC m=+53.121683523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:32.204404 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:32.204368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:32.204929 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:32.204415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:32.204929 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:32.204499 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:14:32.204929 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:32.204545 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:32.204929 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:32.204585 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:34.204563346 +0000 UTC m=+55.129245253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : configmap "kube-rbac-proxy" not found Jun 14 15:14:32.204929 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:32.204600 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:34.204594546 +0000 UTC m=+55.129276453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:33.213439 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:33.213395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:33.213835 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:33.213572 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:33.213835 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:33.213639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:41.213624285 +0000 UTC m=+62.138306197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:33.314825 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:33.314789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:33.314825 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:33.314826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:33.315070 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:33.314996 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:41.314974538 +0000 UTC m=+62.239656461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:33.315070 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:33.315038 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:33.315170 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:33.315090 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:41.315074683 +0000 UTC m=+62.239756591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:33.428959 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:33.428925 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tlm8j_e9acbe3e-4217-473d-b1cd-0c0c561f9c4a/dns-node-resolver/0.log" Jun 14 15:14:34.222337 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:34.222290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:34.222337 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:34.222345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:34.222818 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:34.222443 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:34.222818 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:34.222456 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:14:34.222818 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:34.222506 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:38.22249411 +0000 UTC m=+59.147176017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : configmap "kube-rbac-proxy" not found Jun 14 15:14:34.222818 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:34.222538 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:38.222512081 +0000 UTC m=+59.147193988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:34.240599 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:34.240579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghxxn_b0051ccc-776e-4005-b943-3e86b4f7a5d7/node-ca/0.log" Jun 14 15:14:34.831638 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:34.831610 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pkxv_5e054323-a283-4a2e-8205-ef2f9ee6f2e1/serve-healthcheck-canary/0.log" Jun 14 15:14:38.257856 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:38.257808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:38.257856 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:38.257867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:38.258472 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:38.257968 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:38.258472 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:38.257980 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:14:38.258472 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:38.258037 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:46.258020836 +0000 UTC m=+67.182702748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:38.258472 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:38.258055 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:46.258047992 +0000 UTC m=+67.182729899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : configmap "kube-rbac-proxy" not found Jun 14 15:14:39.732583 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:39.732556 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv5w2" Jun 14 15:14:41.284350 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:41.284307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:41.284864 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:41.284489 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:41.284864 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:41.284603 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls podName:815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc nodeName:}" failed. No retries permitted until 2026-06-14 15:14:57.284582311 +0000 UTC m=+78.209264218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-nrrcn" (UID: "815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:14:41.385744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:41.385709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:41.385744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:41.385744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:41.385941 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:41.385860 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 15:14:41.385941 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:41.385896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:57.385876568 +0000 UTC m=+78.310558493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : configmap references non-existent config key: service-ca.crt Jun 14 15:14:41.385941 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:41.385916 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs podName:e7385fd9-6170-4eb3-86af-0a57f8b626c7 nodeName:}" failed. No retries permitted until 2026-06-14 15:14:57.385908964 +0000 UTC m=+78.310590871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs") pod "router-default-68bd9d74dd-wf2wx" (UID: "e7385fd9-6170-4eb3-86af-0a57f8b626c7") : secret "router-metrics-certs-default" not found Jun 14 15:14:45.321708 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.321662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:45.324594 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.324571 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:14:45.334897 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.334869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30285260-6037-4126-8ef0-6989c385dffc-metrics-certs\") pod \"network-metrics-daemon-d6hx4\" (UID: \"30285260-6037-4126-8ef0-6989c385dffc\") " pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:45.422449 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.422412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:45.422662 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.422481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:45.425329 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.425305 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:14:45.425329 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.425319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:14:45.435578 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.435559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b6d1a04-7c30-40ed-a03d-138acaf994c1-original-pull-secret\") pod \"global-pull-secret-syncer-qwc5s\" (UID: \"3b6d1a04-7c30-40ed-a03d-138acaf994c1\") " pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:45.436106 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.436093 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:14:45.445772 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.445750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d82g\" (UniqueName: \"kubernetes.io/projected/dbb0be2d-226a-46a8-9649-5badbc9ae5dd-kube-api-access-9d82g\") pod \"network-check-target-48cl4\" (UID: \"dbb0be2d-226a-46a8-9649-5badbc9ae5dd\") " pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:45.571456 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.571430 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gt8x4\"" Jun 14 15:14:45.577009 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.576963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cdz8q\"" Jun 14 15:14:45.579062 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.579047 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6hx4" Jun 14 15:14:45.579112 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.579097 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwc5s" Jun 14 15:14:45.584855 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.584839 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:45.726580 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.726547 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6hx4"] Jun 14 15:14:45.730130 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:45.730101 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30285260_6037_4126_8ef0_6989c385dffc.slice/crio-111999ccfd4ef284e0cbe68638d9b6045c84f2ef2c811ac3906363cd5982261f WatchSource:0}: Error finding container 111999ccfd4ef284e0cbe68638d9b6045c84f2ef2c811ac3906363cd5982261f: Status 404 returned error can't find the container with id 111999ccfd4ef284e0cbe68638d9b6045c84f2ef2c811ac3906363cd5982261f Jun 14 15:14:45.743921 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.743888 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48cl4"] Jun 14 15:14:45.748903 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:45.748873 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb0be2d_226a_46a8_9649_5badbc9ae5dd.slice/crio-6f960d7c2ddb202227043ac36bf039c9a2afe7c4564536c92acd649168a6a29e WatchSource:0}: Error finding container 6f960d7c2ddb202227043ac36bf039c9a2afe7c4564536c92acd649168a6a29e: Status 404 returned error can't find the container with id 6f960d7c2ddb202227043ac36bf039c9a2afe7c4564536c92acd649168a6a29e Jun 14 15:14:45.759402 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.759376 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwc5s"] Jun 14 15:14:45.762557 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:45.762533 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6d1a04_7c30_40ed_a03d_138acaf994c1.slice/crio-b4e8aa4c0fabba450c2270d9ab3df1ade52bb8616ce8d33764805b2aa1b1e854 WatchSource:0}: Error finding container b4e8aa4c0fabba450c2270d9ab3df1ade52bb8616ce8d33764805b2aa1b1e854: Status 404 returned error can't find the container with id b4e8aa4c0fabba450c2270d9ab3df1ade52bb8616ce8d33764805b2aa1b1e854 Jun 14 15:14:45.827613 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.827497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:45.829975 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.829952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/456ce9ab-423f-4141-88cb-280e5a1552d1-metrics-tls\") pod \"dns-default-kq8gz\" (UID: \"456ce9ab-423f-4141-88cb-280e5a1552d1\") " pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:45.830720 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.830699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwc5s" event={"ID":"3b6d1a04-7c30-40ed-a03d-138acaf994c1","Type":"ContainerStarted","Data":"b4e8aa4c0fabba450c2270d9ab3df1ade52bb8616ce8d33764805b2aa1b1e854"} Jun 14 15:14:45.831767 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.831743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48cl4" event={"ID":"dbb0be2d-226a-46a8-9649-5badbc9ae5dd","Type":"ContainerStarted","Data":"6f960d7c2ddb202227043ac36bf039c9a2afe7c4564536c92acd649168a6a29e"} Jun 14 15:14:45.832742 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:45.832725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6hx4" event={"ID":"30285260-6037-4126-8ef0-6989c385dffc","Type":"ContainerStarted","Data":"111999ccfd4ef284e0cbe68638d9b6045c84f2ef2c811ac3906363cd5982261f"} Jun 14 15:14:46.089341 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.089266 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qlmw\"" Jun 14 15:14:46.096676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.096649 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:46.257637 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.257557 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kq8gz"] Jun 14 15:14:46.262201 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:46.262172 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456ce9ab_423f_4141_88cb_280e5a1552d1.slice/crio-d4d80ea0c1f6fcda02d95b036c5ea503eaa7154f8c8e6b3814da87a3f2da7b0b WatchSource:0}: Error finding container d4d80ea0c1f6fcda02d95b036c5ea503eaa7154f8c8e6b3814da87a3f2da7b0b: Status 404 returned error can't find the container with id d4d80ea0c1f6fcda02d95b036c5ea503eaa7154f8c8e6b3814da87a3f2da7b0b Jun 14 15:14:46.335477 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.333431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:46.335477 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.333483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:46.335477 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.334069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f56a3fb5-8573-4e81-8d56-ba90d9075c47-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:14:46.335477 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:46.334182 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:14:46.335477 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:14:46.334236 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls podName:f56a3fb5-8573-4e81-8d56-ba90d9075c47 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:02.334218064 +0000 UTC m=+83.258899975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2rb9" (UID: "f56a3fb5-8573-4e81-8d56-ba90d9075c47") : secret "insights-runtime-extractor-tls" not found Jun 14 15:14:46.842458 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:46.842421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq8gz" event={"ID":"456ce9ab-423f-4141-88cb-280e5a1552d1","Type":"ContainerStarted","Data":"d4d80ea0c1f6fcda02d95b036c5ea503eaa7154f8c8e6b3814da87a3f2da7b0b"} Jun 14 15:14:47.849741 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:47.849704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6hx4" event={"ID":"30285260-6037-4126-8ef0-6989c385dffc","Type":"ContainerStarted","Data":"585790dac4ae9cb080e0e999360bf9fbe4b4d97c32b1b033874b2950addeb35a"} Jun 14 15:14:47.850225 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:47.849768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6hx4" event={"ID":"30285260-6037-4126-8ef0-6989c385dffc","Type":"ContainerStarted","Data":"3de5f970cca8a5115e6e680189b726eda02bb42893f17dc6c6151baa2de04224"} Jun 14 15:14:47.869170 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:47.869122 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d6hx4" podStartSLOduration=67.855280326 podStartE2EDuration="1m8.869104029s" totalImagesPullingTime="1.013823703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:47.868010815 +0000 UTC m=+68.792692748" watchObservedRunningTime="2026-06-14 15:14:47.869104029 +0000 UTC m=+68.793785960" Jun 14 15:14:50.863676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.863572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwc5s" event={"ID":"3b6d1a04-7c30-40ed-a03d-138acaf994c1","Type":"ContainerStarted","Data":"33b1e68d7d5c315b23bb6c5b1c871c2b1aa3855467e5011aec81f75385ad16af"} Jun 14 15:14:50.865226 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.865195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48cl4" event={"ID":"dbb0be2d-226a-46a8-9649-5badbc9ae5dd","Type":"ContainerStarted","Data":"a10a46368e3af8cbf6616c02710c15a676d7bc2e7b8c1b12185fb24da3812805"} Jun 14 15:14:50.865382 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.865246 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:14:50.867004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.866979 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq8gz" event={"ID":"456ce9ab-423f-4141-88cb-280e5a1552d1","Type":"ContainerStarted","Data":"255be0c22d59fef1fa793909a101f2ba5f19329d70462fe337b2b0527133ef06"} Jun 14 15:14:50.867117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.867029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq8gz" event={"ID":"456ce9ab-423f-4141-88cb-280e5a1552d1","Type":"ContainerStarted","Data":"b072662d526902a0bed547d9c6494b37f77d48cd5e7337b2ec46d8946d81515e"} Jun 14 15:14:50.867117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.867060 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kq8gz" Jun 14 15:14:50.880100 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.880003 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qwc5s" podStartSLOduration=67.01009537 podStartE2EDuration="1m11.879991202s" totalImagesPullingTime="4.869895832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:50.879636112 +0000 UTC m=+71.804318042" watchObservedRunningTime="2026-06-14 15:14:50.879991202 +0000 UTC m=+71.804673185" Jun 14 15:14:50.896404 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.896362 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-48cl4" podStartSLOduration=67.01826285 podStartE2EDuration="1m11.89634838s" totalImagesPullingTime="4.87808553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:50.895276278 +0000 UTC m=+71.819958208" watchObservedRunningTime="2026-06-14 15:14:50.89634838 +0000 UTC m=+71.821030308" Jun 14 15:14:50.912830 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:50.912742 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kq8gz" podStartSLOduration=33.557186458 podStartE2EDuration="37.912724954s" totalImagesPullingTime="4.355538496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:50.912148794 +0000 UTC m=+71.836830725" watchObservedRunningTime="2026-06-14 15:14:50.912724954 +0000 UTC m=+71.837406884" Jun 14 15:14:52.619058 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.619026 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr"] Jun 14 15:14:52.622751 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.622733 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm"] Jun 14 15:14:52.622877 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.622850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.625152 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.625130 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-x9n2n\"" Jun 14 15:14:52.625389 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.625367 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 15:14:52.625546 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.625530 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 15:14:52.626097 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.626085 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 15:14:52.626370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.626358 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 15:14:52.626450 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.626433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.628715 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.628700 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 15:14:52.628935 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.628917 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 15:14:52.628986 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.628937 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 15:14:52.629032 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.628991 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 15:14:52.635619 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.635596 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr"] Jun 14 15:14:52.637994 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.637971 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm"] Jun 14 15:14:52.687577 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687739 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6km2l\" (UniqueName: \"kubernetes.io/projected/86bf3512-0ad6-4922-9372-795fcc3feeee-kube-api-access-6km2l\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687739 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687739 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/86bf3512-0ad6-4922-9372-795fcc3feeee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.687906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6baa3fa3-ccd5-4327-8dd1-846897623216-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.687906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.687877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zlht\" (UniqueName: \"kubernetes.io/projected/6baa3fa3-ccd5-4327-8dd1-846897623216-kube-api-access-4zlht\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.788378 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788391 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/86bf3512-0ad6-4922-9372-795fcc3feeee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6baa3fa3-ccd5-4327-8dd1-846897623216-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zlht\" (UniqueName: \"kubernetes.io/projected/6baa3fa3-ccd5-4327-8dd1-846897623216-kube-api-access-4zlht\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.788593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6km2l\" (UniqueName: \"kubernetes.io/projected/86bf3512-0ad6-4922-9372-795fcc3feeee-kube-api-access-6km2l\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.789003 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.788973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.789282 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.789258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/86bf3512-0ad6-4922-9372-795fcc3feeee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.791030 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.790994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-ca\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.791178 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.791158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.791233 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.791209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6baa3fa3-ccd5-4327-8dd1-846897623216-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.791403 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.791382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-hub\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.791440 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.791395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/86bf3512-0ad6-4922-9372-795fcc3feeee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.802147 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.802122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6km2l\" (UniqueName: \"kubernetes.io/projected/86bf3512-0ad6-4922-9372-795fcc3feeee-kube-api-access-6km2l\") pod \"cluster-proxy-proxy-agent-856c4b488-ptsqm\" (UID: \"86bf3512-0ad6-4922-9372-795fcc3feeee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:52.802281 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.802263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zlht\" (UniqueName: \"kubernetes.io/projected/6baa3fa3-ccd5-4327-8dd1-846897623216-kube-api-access-4zlht\") pod \"managed-serviceaccount-addon-agent-55566c7b4-k6xwr\" (UID: \"6baa3fa3-ccd5-4327-8dd1-846897623216\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.967190 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.967095 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" Jun 14 15:14:52.971272 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:52.971248 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" Jun 14 15:14:53.112312 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:53.112269 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr"] Jun 14 15:14:53.115399 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:53.115375 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6baa3fa3_ccd5_4327_8dd1_846897623216.slice/crio-97ced20d2b8e36cf41b36c450e00bd89752506bbbc8ed80cc1e214907a213ca3 WatchSource:0}: Error finding container 97ced20d2b8e36cf41b36c450e00bd89752506bbbc8ed80cc1e214907a213ca3: Status 404 returned error can't find the container with id 97ced20d2b8e36cf41b36c450e00bd89752506bbbc8ed80cc1e214907a213ca3 Jun 14 15:14:53.128363 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:53.128336 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm"] Jun 14 15:14:53.131553 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:53.131531 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86bf3512_0ad6_4922_9372_795fcc3feeee.slice/crio-63a333c6796b515ec543f71d40074185e8906640870147a544b8171daab295bc WatchSource:0}: Error finding container 63a333c6796b515ec543f71d40074185e8906640870147a544b8171daab295bc: Status 404 returned error can't find the container with id 63a333c6796b515ec543f71d40074185e8906640870147a544b8171daab295bc Jun 14 15:14:53.879695 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:53.879660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" event={"ID":"86bf3512-0ad6-4922-9372-795fcc3feeee","Type":"ContainerStarted","Data":"63a333c6796b515ec543f71d40074185e8906640870147a544b8171daab295bc"} Jun 14 15:14:53.880744 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:53.880715 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" event={"ID":"6baa3fa3-ccd5-4327-8dd1-846897623216","Type":"ContainerStarted","Data":"97ced20d2b8e36cf41b36c450e00bd89752506bbbc8ed80cc1e214907a213ca3"} Jun 14 15:14:57.326837 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.326767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:57.328999 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.328978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-nrrcn\" (UID: \"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:57.427378 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.427323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:57.427378 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.427379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:57.427978 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.427955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7385fd9-6170-4eb3-86af-0a57f8b626c7-service-ca-bundle\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:57.429691 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.429673 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7385fd9-6170-4eb3-86af-0a57f8b626c7-metrics-certs\") pod \"router-default-68bd9d74dd-wf2wx\" (UID: \"e7385fd9-6170-4eb3-86af-0a57f8b626c7\") " pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:57.564126 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.564091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfj52\"" Jun 14 15:14:57.572282 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.572259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" Jun 14 15:14:57.587931 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.587902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ps7rz\"" Jun 14 15:14:57.596249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.596221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:57.708835 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.708795 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn"] Jun 14 15:14:57.711901 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:57.711871 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815133b2_5d7c_4c28_a0c8_9f1cb2bfcddc.slice/crio-ef62d51f665c28dac69a47b0ea111f7d0febeb65f28867e54cf4ce79610bbb43 WatchSource:0}: Error finding container ef62d51f665c28dac69a47b0ea111f7d0febeb65f28867e54cf4ce79610bbb43: Status 404 returned error can't find the container with id ef62d51f665c28dac69a47b0ea111f7d0febeb65f28867e54cf4ce79610bbb43 Jun 14 15:14:57.731828 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.731799 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68bd9d74dd-wf2wx"] Jun 14 15:14:57.735408 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:14:57.735380 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7385fd9_6170_4eb3_86af_0a57f8b626c7.slice/crio-a8a3507244f29c0ee4ffd7dd9801a65c180e64479dd156fc52f0bb9ceeaac616 WatchSource:0}: Error finding container a8a3507244f29c0ee4ffd7dd9801a65c180e64479dd156fc52f0bb9ceeaac616: Status 404 returned error can't find the container with id a8a3507244f29c0ee4ffd7dd9801a65c180e64479dd156fc52f0bb9ceeaac616 Jun 14 15:14:57.898111 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.897940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" event={"ID":"86bf3512-0ad6-4922-9372-795fcc3feeee","Type":"ContainerStarted","Data":"0112ac57fede8cd6e950c118355569567319f0bc5c3a5e8abc3811c47c1d71bb"} Jun 14 15:14:57.898111 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.897992 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" event={"ID":"86bf3512-0ad6-4922-9372-795fcc3feeee","Type":"ContainerStarted","Data":"919b1e0e4dfc830e8d652e0cbab4d3b0a39b1fb39bc6f91a90acd3adda47eb0d"} Jun 14 15:14:57.898111 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.898012 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" event={"ID":"86bf3512-0ad6-4922-9372-795fcc3feeee","Type":"ContainerStarted","Data":"7c571f16f2175124be206a70b63a35575f897feb82dfcf614a504b318042a3ee"} Jun 14 15:14:57.899329 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.899307 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" event={"ID":"6baa3fa3-ccd5-4327-8dd1-846897623216","Type":"ContainerStarted","Data":"b729ee2b07b61dd7a07d46dd44d5a90de15164f9e9e53fd60006d322cce45dfb"} Jun 14 15:14:57.900656 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.900635 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" event={"ID":"e7385fd9-6170-4eb3-86af-0a57f8b626c7","Type":"ContainerStarted","Data":"6fda7858eff2c019a038fede70c98731f033f20366958b9e1482f3f399f51acb"} Jun 14 15:14:57.900756 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.900679 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" event={"ID":"e7385fd9-6170-4eb3-86af-0a57f8b626c7","Type":"ContainerStarted","Data":"a8a3507244f29c0ee4ffd7dd9801a65c180e64479dd156fc52f0bb9ceeaac616"} Jun 14 15:14:57.901705 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.901688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" event={"ID":"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc","Type":"ContainerStarted","Data":"ef62d51f665c28dac69a47b0ea111f7d0febeb65f28867e54cf4ce79610bbb43"} Jun 14 15:14:57.918069 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.918026 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856c4b488-ptsqm" podStartSLOduration=1.917389507 podStartE2EDuration="5.918010638s" totalImagesPullingTime="4.000621131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:57.917023962 +0000 UTC m=+78.841705890" watchObservedRunningTime="2026-06-14 15:14:57.918010638 +0000 UTC m=+78.842692566" Jun 14 15:14:57.939164 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.939113 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" podStartSLOduration=32.939092999 podStartE2EDuration="32.939092999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:57.938810918 +0000 UTC m=+78.863492846" watchObservedRunningTime="2026-06-14 15:14:57.939092999 +0000 UTC m=+78.863774930" Jun 14 15:14:57.954315 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:57.954263 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55566c7b4-k6xwr" podStartSLOduration=1.9942826409999999 podStartE2EDuration="5.95424649s" totalImagesPullingTime="3.959963849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:57.953462748 +0000 UTC m=+78.878144679" watchObservedRunningTime="2026-06-14 15:14:57.95424649 +0000 UTC m=+78.878928418" Jun 14 15:14:58.596784 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:58.596747 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:58.600011 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:58.599984 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:58.906052 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:58.905964 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:58.907196 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:58.907171 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68bd9d74dd-wf2wx" Jun 14 15:14:59.910632 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:59.910585 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" event={"ID":"815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc","Type":"ContainerStarted","Data":"09e6b0f196e0ceaa4ef2298b4636c5bd88b19fa3e587014dc729fe789fbef671"} Jun 14 15:14:59.928414 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:14:59.928357 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-nrrcn" podStartSLOduration=33.459767395 podStartE2EDuration="34.928342096s" totalImagesPullingTime="1.468574701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:59.92771652 +0000 UTC m=+80.852398460" watchObservedRunningTime="2026-06-14 15:14:59.928342096 +0000 UTC m=+80.853024024" Jun 14 15:15:00.872031 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:00.872000 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kq8gz" Jun 14 15:15:02.366598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.366560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:15:02.368870 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.368844 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f56a3fb5-8573-4e81-8d56-ba90d9075c47-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2rb9\" (UID: \"f56a3fb5-8573-4e81-8d56-ba90d9075c47\") " pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:15:02.580938 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.580906 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gkvzf\"" Jun 14 15:15:02.588773 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.588755 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w2rb9" Jun 14 15:15:02.720932 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.720900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w2rb9"] Jun 14 15:15:02.725244 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:15:02.725218 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56a3fb5_8573_4e81_8d56_ba90d9075c47.slice/crio-452dbfe2193fbe517e07a5be43b0818cc357f043d2dd996828361ccaafe4d811 WatchSource:0}: Error finding container 452dbfe2193fbe517e07a5be43b0818cc357f043d2dd996828361ccaafe4d811: Status 404 returned error can't find the container with id 452dbfe2193fbe517e07a5be43b0818cc357f043d2dd996828361ccaafe4d811 Jun 14 15:15:02.921584 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:02.921494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2rb9" event={"ID":"f56a3fb5-8573-4e81-8d56-ba90d9075c47","Type":"ContainerStarted","Data":"452dbfe2193fbe517e07a5be43b0818cc357f043d2dd996828361ccaafe4d811"} Jun 14 15:15:06.938171 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:06.938139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2rb9" event={"ID":"f56a3fb5-8573-4e81-8d56-ba90d9075c47","Type":"ContainerStarted","Data":"656d646476b10e5f317419621713d6630bdcb8b9e02ebbcc9d48c27ae3bd48b6"} Jun 14 15:15:06.938594 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:06.938195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2rb9" event={"ID":"f56a3fb5-8573-4e81-8d56-ba90d9075c47","Type":"ContainerStarted","Data":"0357e62c057f0a3d39be7c8ff92e752845bc765da60989cfa658bf771275a91b"} Jun 14 15:15:08.947126 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:08.947040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2rb9" event={"ID":"f56a3fb5-8573-4e81-8d56-ba90d9075c47","Type":"ContainerStarted","Data":"03c9be97bfe5ec73d2146e7d126127464f6fd033cecaf1cb260a18ca74e2ab66"} Jun 14 15:15:08.969605 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:08.969558 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w2rb9" podStartSLOduration=33.180313515 podStartE2EDuration="38.969543821s" totalImagesPullingTime="5.789230306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:14:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:08.968292569 +0000 UTC m=+89.892974499" watchObservedRunningTime="2026-06-14 15:15:08.969543821 +0000 UTC m=+89.894225744" Jun 14 15:15:10.139969 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.139939 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bpswp"] Jun 14 15:15:10.143417 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.143398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.147719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.147695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 15:15:10.147838 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.147728 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 15:15:10.147838 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.147757 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 15:15:10.148119 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.148107 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 15:15:10.148159 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.148136 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6qkbt\"" Jun 14 15:15:10.226514 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-metrics-client-ca\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbsnd\" (UniqueName: \"kubernetes.io/projected/66a5fc66-e00f-45e5-80e6-285a57c11508-kube-api-access-tbsnd\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-sys\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-wtmp\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-root\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226950 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-textfile\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.226950 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.226854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-accelerators-collector-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327691 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbsnd\" (UniqueName: \"kubernetes.io/projected/66a5fc66-e00f-45e5-80e6-285a57c11508-kube-api-access-tbsnd\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327691 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-sys\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-wtmp\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327782 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-sys\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-root\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-textfile\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:15:10.327886 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-accelerators-collector-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:15:10.327942 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls podName:66a5fc66-e00f-45e5-80e6-285a57c11508 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:10.827922114 +0000 UTC m=+91.752604022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls") pod "node-exporter-bpswp" (UID: "66a5fc66-e00f-45e5-80e6-285a57c11508") : secret "node-exporter-tls" not found Jun 14 15:15:10.327942 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327940 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-root\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.328361 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.327968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-metrics-client-ca\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.328361 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.328047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-wtmp\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.328361 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.328297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-textfile\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.328618 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.328598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-metrics-client-ca\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.328670 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.328598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-accelerators-collector-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.330051 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.330029 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.338809 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.338789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbsnd\" (UniqueName: \"kubernetes.io/projected/66a5fc66-e00f-45e5-80e6-285a57c11508-kube-api-access-tbsnd\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.831640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:10.831604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:10.831793 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:15:10.831749 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 15:15:10.831834 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:15:10.831821 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls podName:66a5fc66-e00f-45e5-80e6-285a57c11508 nodeName:}" failed. No retries permitted until 2026-06-14 15:15:11.831805549 +0000 UTC m=+92.756487461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls") pod "node-exporter-bpswp" (UID: "66a5fc66-e00f-45e5-80e6-285a57c11508") : secret "node-exporter-tls" not found Jun 14 15:15:11.839439 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:11.839401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:11.841721 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:11.841698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a5fc66-e00f-45e5-80e6-285a57c11508-node-exporter-tls\") pod \"node-exporter-bpswp\" (UID: \"66a5fc66-e00f-45e5-80e6-285a57c11508\") " pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:11.951838 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:11.951800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bpswp" Jun 14 15:15:11.965131 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:15:11.965104 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a5fc66_e00f_45e5_80e6_285a57c11508.slice/crio-b158b1e325137a384a5f9e3bb8f6d240f91f9054c34c393c235bd02297c0992e WatchSource:0}: Error finding container b158b1e325137a384a5f9e3bb8f6d240f91f9054c34c393c235bd02297c0992e: Status 404 returned error can't find the container with id b158b1e325137a384a5f9e3bb8f6d240f91f9054c34c393c235bd02297c0992e Jun 14 15:15:12.122964 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.122883 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-785dbb9494-8fjk9"] Jun 14 15:15:12.127477 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.127459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.130279 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.130258 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 15:15:12.130399 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.130314 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 15:15:12.130529 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.130498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jn7mh\"" Jun 14 15:15:12.130583 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.130566 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8lq6lqq673u70\"" Jun 14 15:15:12.130632 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.130586 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 15:15:12.131474 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.131455 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 15:15:12.131701 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.131685 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 15:15:12.142095 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.142072 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-785dbb9494-8fjk9"] Jun 14 15:15:12.243118 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7rwn\" (UniqueName: \"kubernetes.io/projected/7868c0af-0fea-4abb-8108-a0b1a5370092-kube-api-access-x7rwn\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243118 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243332 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243142 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243332 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243332 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243332 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7868c0af-0fea-4abb-8108-a0b1a5370092-metrics-client-ca\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243463 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243344 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.243463 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.243367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-grpc-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344147 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7868c0af-0fea-4abb-8108-a0b1a5370092-metrics-client-ca\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344347 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344347 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-grpc-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344347 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7rwn\" (UniqueName: \"kubernetes.io/projected/7868c0af-0fea-4abb-8108-a0b1a5370092-kube-api-access-x7rwn\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.344512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.345074 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.344963 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7868c0af-0fea-4abb-8108-a0b1a5370092-metrics-client-ca\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.347890 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.347860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.347890 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.347877 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.348392 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.348371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.348480 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.348426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-grpc-tls\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.348480 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.348435 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.348611 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.348590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7868c0af-0fea-4abb-8108-a0b1a5370092-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.359254 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.358121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7rwn\" (UniqueName: \"kubernetes.io/projected/7868c0af-0fea-4abb-8108-a0b1a5370092-kube-api-access-x7rwn\") pod \"thanos-querier-785dbb9494-8fjk9\" (UID: \"7868c0af-0fea-4abb-8108-a0b1a5370092\") " pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.436979 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.436897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:12.581874 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.581838 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-785dbb9494-8fjk9"] Jun 14 15:15:12.726485 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:15:12.726454 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7868c0af_0fea_4abb_8108_a0b1a5370092.slice/crio-a09a40998dd931a79ccc1b89a2dcf0ff143445f183be18663f16fe7a61f271d0 WatchSource:0}: Error finding container a09a40998dd931a79ccc1b89a2dcf0ff143445f183be18663f16fe7a61f271d0: Status 404 returned error can't find the container with id a09a40998dd931a79ccc1b89a2dcf0ff143445f183be18663f16fe7a61f271d0 Jun 14 15:15:12.960605 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.960567 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"a09a40998dd931a79ccc1b89a2dcf0ff143445f183be18663f16fe7a61f271d0"} Jun 14 15:15:12.962092 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.962067 2567 generic.go:356] "Generic (PLEG): container finished" podID="66a5fc66-e00f-45e5-80e6-285a57c11508" containerID="eb53f01972e0e62ff7190c987b36649cbd7d8be7e76c74f56e31f3676fee6660" exitCode=0 Jun 14 15:15:12.962190 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.962101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bpswp" event={"ID":"66a5fc66-e00f-45e5-80e6-285a57c11508","Type":"ContainerDied","Data":"eb53f01972e0e62ff7190c987b36649cbd7d8be7e76c74f56e31f3676fee6660"} Jun 14 15:15:12.962190 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:12.962149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bpswp" event={"ID":"66a5fc66-e00f-45e5-80e6-285a57c11508","Type":"ContainerStarted","Data":"b158b1e325137a384a5f9e3bb8f6d240f91f9054c34c393c235bd02297c0992e"} Jun 14 15:15:13.969659 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:13.969623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bpswp" event={"ID":"66a5fc66-e00f-45e5-80e6-285a57c11508","Type":"ContainerStarted","Data":"f71b0e1ec5416f4a63abb09f9ffc31d49fc310650051198c623b23366f735af9"} Jun 14 15:15:13.970129 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:13.969683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bpswp" event={"ID":"66a5fc66-e00f-45e5-80e6-285a57c11508","Type":"ContainerStarted","Data":"88c677a57344596fae8a63dde03642b79106f03c5316b326f40053c84d572c13"} Jun 14 15:15:13.996425 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:13.996368 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bpswp" podStartSLOduration=3.129695263 podStartE2EDuration="3.996351251s" totalImagesPullingTime="803.83903ms" totalInitContainerRuntime="62.816958ms" isStatefulPod=true podCreationTimestamp="2026-06-14 15:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:13.994371374 +0000 UTC m=+94.919053303" watchObservedRunningTime="2026-06-14 15:15:13.996351251 +0000 UTC m=+94.921033180" Jun 14 15:15:14.975959 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:14.975923 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"54789a322f779522dce55a9824bbeec26d5dc3030a1a3d4ba1c46da07c70d015"} Jun 14 15:15:14.976349 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:14.975991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"8e4409f6ae2db062fac98fd29ca6a0956e50d09c9460c903c4577ed06693ed36"} Jun 14 15:15:14.976349 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:14.976029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"6573e5844040896471146f01168e9e53504959b2cf6ed6b8b859ccf38ac65628"} Jun 14 15:15:15.981860 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:15.981821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"d8227b29f366677456797424b7b95e6ab05a37dbc774fba798a18501e31e21b7"} Jun 14 15:15:15.982311 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:15.981917 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"c012705f7d1aeb30c9e9109f180d3647387e3df474b89120569e6b5bbf1e8921"} Jun 14 15:15:15.982311 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:15.981950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" event={"ID":"7868c0af-0fea-4abb-8108-a0b1a5370092","Type":"ContainerStarted","Data":"b20348ec2e74cdda4886d937207b8e24e4e12c632ea5e590573e02ec14652ff5"} Jun 14 15:15:15.982311 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:15.981990 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:16.006943 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:16.006884 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" podStartSLOduration=1.867918305 podStartE2EDuration="4.006868386s" totalImagesPullingTime="2.138950081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:15:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:16.005320565 +0000 UTC m=+96.930002493" watchObservedRunningTime="2026-06-14 15:15:16.006868386 +0000 UTC m=+96.931550316" Jun 14 15:15:21.872986 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:21.872956 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-48cl4" Jun 14 15:15:21.990758 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:21.990732 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-785dbb9494-8fjk9" Jun 14 15:15:40.069365 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:40.069331 2567 generic.go:356] "Generic (PLEG): container finished" podID="f1fab5de-b072-4b75-81b0-cc04201d15bc" containerID="c0e3efb9eb0664a348db938ed3247ab916ad2e9cc7d3af53e890fac32c997e62" exitCode=0 Jun 14 15:15:40.069849 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:40.069370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" event={"ID":"f1fab5de-b072-4b75-81b0-cc04201d15bc","Type":"ContainerDied","Data":"c0e3efb9eb0664a348db938ed3247ab916ad2e9cc7d3af53e890fac32c997e62"} Jun 14 15:15:40.069849 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:40.069694 2567 scope.go:117] "RemoveContainer" containerID="c0e3efb9eb0664a348db938ed3247ab916ad2e9cc7d3af53e890fac32c997e62" Jun 14 15:15:40.702803 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:40.702773 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log" Jun 14 15:15:40.708748 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:40.708728 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pkxv_5e054323-a283-4a2e-8205-ef2f9ee6f2e1/serve-healthcheck-canary/0.log" Jun 14 15:15:41.074920 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:41.074884 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fjjd8" event={"ID":"f1fab5de-b072-4b75-81b0-cc04201d15bc","Type":"ContainerStarted","Data":"93d4ba4cf0715eb6ce4a6741b3a5eeb06e00ea7080314da5099780da0b79f99b"} Jun 14 15:15:55.131306 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:55.131269 2567 generic.go:356] "Generic (PLEG): container finished" podID="b341b2ad-f147-4851-a70b-c31e8a3e63d8" containerID="14008ddce1f63a991b9aa00bb60d745254b0bf7c643c82248edc7241f07fde2d" exitCode=0 Jun 14 15:15:55.131787 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:55.131343 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" event={"ID":"b341b2ad-f147-4851-a70b-c31e8a3e63d8","Type":"ContainerDied","Data":"14008ddce1f63a991b9aa00bb60d745254b0bf7c643c82248edc7241f07fde2d"} Jun 14 15:15:55.131787 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:55.131677 2567 scope.go:117] "RemoveContainer" containerID="14008ddce1f63a991b9aa00bb60d745254b0bf7c643c82248edc7241f07fde2d" Jun 14 15:15:56.137258 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:15:56.137217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-dpcs7" event={"ID":"b341b2ad-f147-4851-a70b-c31e8a3e63d8","Type":"ContainerStarted","Data":"f5dcdcfff2e49ba05b3b197d76d89a1a29f813b8ab1eb599c1ebc623d4e81536"} Jun 14 15:18:39.505351 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:18:39.505065 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:18:39.513623 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:18:39.513601 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 15:18:39.514678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:18:39.514659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:19:51.149601 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.149561 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h"] Jun 14 15:19:51.152688 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.152673 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.159379 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.159353 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 15:19:51.159543 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.159356 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 15:19:51.159543 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.159410 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 15:19:51.159650 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.159629 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bsf4x\"" Jun 14 15:19:51.170473 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.170452 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 15:19:51.192694 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.192665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-webhook-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.192804 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.192708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdq5z\" (UniqueName: \"kubernetes.io/projected/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-kube-api-access-rdq5z\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.192804 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.192758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-manifests\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.192804 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.192796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.192964 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.192885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-tmp\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.202187 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.202162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h"] Jun 14 15:19:51.293387 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-tmp\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.293598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-webhook-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.293598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdq5z\" (UniqueName: \"kubernetes.io/projected/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-kube-api-access-rdq5z\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.293598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-manifests\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.293598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.293821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.293765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-manifests\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.295799 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.295773 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-tmp\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.296004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.295984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.296046 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.295987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-webhook-cert\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.315510 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.315485 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdq5z\" (UniqueName: \"kubernetes.io/projected/0c5c5f65-2e2e-4229-a233-1eb3d12142c1-kube-api-access-rdq5z\") pod \"opendatahub-operator-controller-manager-988f4c544-shr7h\" (UID: \"0c5c5f65-2e2e-4229-a233-1eb3d12142c1\") " pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.466144 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.466055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:51.604340 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.604309 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h"] Jun 14 15:19:51.607312 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:19:51.607292 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5c5f65_2e2e_4229_a233_1eb3d12142c1.slice/crio-0f39c06824e7a8485e8acb9606d1b62226b636bcdbdf07776eda62559096dd35 WatchSource:0}: Error finding container 0f39c06824e7a8485e8acb9606d1b62226b636bcdbdf07776eda62559096dd35: Status 404 returned error can't find the container with id 0f39c06824e7a8485e8acb9606d1b62226b636bcdbdf07776eda62559096dd35 Jun 14 15:19:51.609066 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.609050 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:19:51.982192 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:51.982146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" event={"ID":"0c5c5f65-2e2e-4229-a233-1eb3d12142c1","Type":"ContainerStarted","Data":"0f39c06824e7a8485e8acb9606d1b62226b636bcdbdf07776eda62559096dd35"} Jun 14 15:19:54.995155 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:54.995122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" event={"ID":"0c5c5f65-2e2e-4229-a233-1eb3d12142c1","Type":"ContainerStarted","Data":"010d1b697d283f3cdf914c056f52ececc279ce1fd059be87085a7626ce871820"} Jun 14 15:19:56.000530 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:56.000484 2567 generic.go:356] "Generic (PLEG): container finished" podID="0c5c5f65-2e2e-4229-a233-1eb3d12142c1" containerID="010d1b697d283f3cdf914c056f52ececc279ce1fd059be87085a7626ce871820" exitCode=0 Jun 14 15:19:56.000993 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:56.000556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" event={"ID":"0c5c5f65-2e2e-4229-a233-1eb3d12142c1","Type":"ContainerDied","Data":"010d1b697d283f3cdf914c056f52ececc279ce1fd059be87085a7626ce871820"} Jun 14 15:19:57.005889 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:57.005853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" event={"ID":"0c5c5f65-2e2e-4229-a233-1eb3d12142c1","Type":"ContainerStarted","Data":"82e51676deded7271200ef6d5b80732163d68ac1f14cef0e28607d5c74c5ffaa"} Jun 14 15:19:57.006270 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:57.005995 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:19:57.029695 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:19:57.029638 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" podStartSLOduration=2.041511409 podStartE2EDuration="6.029618612s" totalImagesPullingTime="3.035968051s" totalInitContainerRuntime="952.139152ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:19:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:57.028122238 +0000 UTC m=+377.952804168" watchObservedRunningTime="2026-06-14 15:19:57.029618612 +0000 UTC m=+377.954300556" Jun 14 15:20:08.012636 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:08.012606 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-988f4c544-shr7h" Jun 14 15:20:10.726708 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.726673 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7576766bb9-npjxg"] Jun 14 15:20:10.736448 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.736419 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.740530 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.740497 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 15:20:10.740831 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.740814 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j6dz4\"" Jun 14 15:20:10.741691 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.741666 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 15:20:10.750312 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.750291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7576766bb9-npjxg"] Jun 14 15:20:10.839417 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.839387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tmp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.839598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.839420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f2zp\" (UniqueName: \"kubernetes.io/projected/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-kube-api-access-7f2zp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.839598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.839459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tls-certs\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.868397 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.868366 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ljls"] Jun 14 15:20:10.871424 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.871409 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:10.878448 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.878431 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-j87mh\"" Jun 14 15:20:10.878571 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.878540 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 15:20:10.934097 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.934067 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ljls"] Jun 14 15:20:10.939876 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.939852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm5m2\" (UniqueName: \"kubernetes.io/projected/b4c9b029-335c-44db-849c-c9a229bf1dbb-kube-api-access-jm5m2\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:10.940001 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.939894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tmp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.940001 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.939918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f2zp\" (UniqueName: \"kubernetes.io/projected/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-kube-api-access-7f2zp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.940095 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.939999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tls-certs\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.940095 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.940027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:10.942064 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.942041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tmp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.942363 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.942340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-tls-certs\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:10.967761 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:10.967733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f2zp\" (UniqueName: \"kubernetes.io/projected/5dcd43b7-7be9-4d9c-a3a0-e49431ca8223-kube-api-access-7f2zp\") pod \"kube-auth-proxy-7576766bb9-npjxg\" (UID: \"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223\") " pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:11.041073 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.041002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.041073 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.041042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm5m2\" (UniqueName: \"kubernetes.io/projected/b4c9b029-335c-44db-849c-c9a229bf1dbb-kube-api-access-jm5m2\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.041223 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:11.041151 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 15:20:11.041223 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:11.041215 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert podName:b4c9b029-335c-44db-849c-c9a229bf1dbb nodeName:}" failed. No retries permitted until 2026-06-14 15:20:11.541196843 +0000 UTC m=+392.465878754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert") pod "odh-model-controller-6dc94f689f-4ljls" (UID: "b4c9b029-335c-44db-849c-c9a229bf1dbb") : secret "odh-model-controller-webhook-cert" not found Jun 14 15:20:11.045747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.045731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" Jun 14 15:20:11.062537 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.062493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm5m2\" (UniqueName: \"kubernetes.io/projected/b4c9b029-335c-44db-849c-c9a229bf1dbb-kube-api-access-jm5m2\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.197175 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.197142 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7576766bb9-npjxg"] Jun 14 15:20:11.200059 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:11.200029 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcd43b7_7be9_4d9c_a3a0_e49431ca8223.slice/crio-9e2aaf2ba80cace44e994c3cec20ea7e0a727628a1b6f95714e2bff93493ba16 WatchSource:0}: Error finding container 9e2aaf2ba80cace44e994c3cec20ea7e0a727628a1b6f95714e2bff93493ba16: Status 404 returned error can't find the container with id 9e2aaf2ba80cace44e994c3cec20ea7e0a727628a1b6f95714e2bff93493ba16 Jun 14 15:20:11.544429 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.544394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.546751 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.546725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4c9b029-335c-44db-849c-c9a229bf1dbb-cert\") pod \"odh-model-controller-6dc94f689f-4ljls\" (UID: \"b4c9b029-335c-44db-849c-c9a229bf1dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.781463 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.781426 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:11.961604 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:11.961571 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4ljls"] Jun 14 15:20:11.965552 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:11.965474 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c9b029_335c_44db_849c_c9a229bf1dbb.slice/crio-87c4fbeaa464b63ac01615016ed9fb57d2106a486e6d27f6583de2ffa28c258b WatchSource:0}: Error finding container 87c4fbeaa464b63ac01615016ed9fb57d2106a486e6d27f6583de2ffa28c258b: Status 404 returned error can't find the container with id 87c4fbeaa464b63ac01615016ed9fb57d2106a486e6d27f6583de2ffa28c258b Jun 14 15:20:12.068460 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.068423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" event={"ID":"b4c9b029-335c-44db-849c-c9a229bf1dbb","Type":"ContainerStarted","Data":"87c4fbeaa464b63ac01615016ed9fb57d2106a486e6d27f6583de2ffa28c258b"} Jun 14 15:20:12.069940 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.069910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" event={"ID":"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223","Type":"ContainerStarted","Data":"9e2aaf2ba80cace44e994c3cec20ea7e0a727628a1b6f95714e2bff93493ba16"} Jun 14 15:20:12.157774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.157692 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7n8bz"] Jun 14 15:20:12.162125 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.162105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.164747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.164723 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 15:20:12.165017 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.164993 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jm7ks\"" Jun 14 15:20:12.176237 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.176214 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7n8bz"] Jun 14 15:20:12.250223 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.250187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.250398 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.250250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7xsw\" (UniqueName: \"kubernetes.io/projected/d7993d60-fbf0-48d6-a4db-7720f52fe464-kube-api-access-l7xsw\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.351294 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.351253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.351476 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.351342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7xsw\" (UniqueName: \"kubernetes.io/projected/d7993d60-fbf0-48d6-a4db-7720f52fe464-kube-api-access-l7xsw\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.351476 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:12.351454 2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 15:20:12.351630 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:12.351512 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs podName:d7993d60-fbf0-48d6-a4db-7720f52fe464 nodeName:}" failed. No retries permitted until 2026-06-14 15:20:12.851496628 +0000 UTC m=+393.776178535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs") pod "model-serving-api-5dd488fc48-7n8bz" (UID: "d7993d60-fbf0-48d6-a4db-7720f52fe464") : secret "model-serving-api-tls" not found Jun 14 15:20:12.364495 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.364430 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7xsw\" (UniqueName: \"kubernetes.io/projected/d7993d60-fbf0-48d6-a4db-7720f52fe464-kube-api-access-l7xsw\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.856392 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.856364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:12.859598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:12.859566 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7993d60-fbf0-48d6-a4db-7720f52fe464-tls-certs\") pod \"model-serving-api-5dd488fc48-7n8bz\" (UID: \"d7993d60-fbf0-48d6-a4db-7720f52fe464\") " pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:13.074173 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:13.074128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:15.203861 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:15.203835 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-7n8bz"] Jun 14 15:20:15.206577 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:15.206551 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7993d60_fbf0_48d6_a4db_7720f52fe464.slice/crio-698499385da4dc8e7b1878cf41013f880530de765ed7cf8bda7101f6ebfe2c04 WatchSource:0}: Error finding container 698499385da4dc8e7b1878cf41013f880530de765ed7cf8bda7101f6ebfe2c04: Status 404 returned error can't find the container with id 698499385da4dc8e7b1878cf41013f880530de765ed7cf8bda7101f6ebfe2c04 Jun 14 15:20:16.089193 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.089150 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" event={"ID":"5dcd43b7-7be9-4d9c-a3a0-e49431ca8223","Type":"ContainerStarted","Data":"b5b850d336fc48fe82534ad381f3a038138b42d38ab4879f82a223eba954e4c6"} Jun 14 15:20:16.090326 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.090300 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" event={"ID":"d7993d60-fbf0-48d6-a4db-7720f52fe464","Type":"ContainerStarted","Data":"698499385da4dc8e7b1878cf41013f880530de765ed7cf8bda7101f6ebfe2c04"} Jun 14 15:20:16.091676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.091653 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" event={"ID":"b4c9b029-335c-44db-849c-c9a229bf1dbb","Type":"ContainerStarted","Data":"b24ad1a3e124478629da33e3cf69530dafa87b790a7970636b3ee24312e2ab92"} Jun 14 15:20:16.091781 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.091774 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:16.117158 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.117110 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7576766bb9-npjxg" podStartSLOduration=2.262854196 podStartE2EDuration="6.117096348s" totalImagesPullingTime="3.854242152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:16.115744071 +0000 UTC m=+397.040426004" watchObservedRunningTime="2026-06-14 15:20:16.117096348 +0000 UTC m=+397.041778276" Jun 14 15:20:16.134870 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:16.134823 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" podStartSLOduration=2.992199373 podStartE2EDuration="6.134803622s" totalImagesPullingTime="3.142604249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:16.13338119 +0000 UTC m=+397.058063121" watchObservedRunningTime="2026-06-14 15:20:16.134803622 +0000 UTC m=+397.059485552" Jun 14 15:20:17.098697 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:17.098661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" event={"ID":"d7993d60-fbf0-48d6-a4db-7720f52fe464","Type":"ContainerStarted","Data":"44f50064faf0c23510bf7aa48f1664c5203a68bd3074047fc1b197d1d355ead6"} Jun 14 15:20:17.099082 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:17.098945 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:17.192431 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:17.192385 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" podStartSLOduration=3.937281172 podStartE2EDuration="5.192370734s" totalImagesPullingTime="1.255089562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:17.180666439 +0000 UTC m=+398.105348367" watchObservedRunningTime="2026-06-14 15:20:17.192370734 +0000 UTC m=+398.117052663" Jun 14 15:20:24.153601 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.153571 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lsxbv"] Jun 14 15:20:24.156961 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.156943 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5"] Jun 14 15:20:24.157079 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.157060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.159914 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.159899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.168047 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.168030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 15:20:24.179175 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.179155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 15:20:24.179291 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.179234 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9qfdj\"" Jun 14 15:20:24.180073 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.180059 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7g4mt\"" Jun 14 15:20:24.185422 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.185395 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lsxbv"] Jun 14 15:20:24.214805 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.214770 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5"] Jun 14 15:20:24.253584 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.253555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.253786 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.253594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thkjf\" (UniqueName: \"kubernetes.io/projected/e3a633d6-5762-4c42-b346-90d1eb4a74d5-kube-api-access-thkjf\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.253786 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.253709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbkb\" (UniqueName: \"kubernetes.io/projected/00df141c-2168-4e21-8641-acc0785cfdca-kube-api-access-spbkb\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.253786 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.253763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00df141c-2168-4e21-8641-acc0785cfdca-cert\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.354408 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.354375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbkb\" (UniqueName: \"kubernetes.io/projected/00df141c-2168-4e21-8641-acc0785cfdca-kube-api-access-spbkb\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.354628 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.354418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00df141c-2168-4e21-8641-acc0785cfdca-cert\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.354628 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.354452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.354628 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.354471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thkjf\" (UniqueName: \"kubernetes.io/projected/e3a633d6-5762-4c42-b346-90d1eb4a74d5-kube-api-access-thkjf\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.354805 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:24.354783 2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 15:20:24.354871 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:20:24.354859 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert podName:e3a633d6-5762-4c42-b346-90d1eb4a74d5 nodeName:}" failed. No retries permitted until 2026-06-14 15:20:24.854837453 +0000 UTC m=+405.779519374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert") pod "llmisvc-controller-manager-864bfd7bc9-4h5r5" (UID: "e3a633d6-5762-4c42-b346-90d1eb4a74d5") : secret "llmisvc-webhook-server-cert" not found Jun 14 15:20:24.356937 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.356915 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00df141c-2168-4e21-8641-acc0785cfdca-cert\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.369106 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.369076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thkjf\" (UniqueName: \"kubernetes.io/projected/e3a633d6-5762-4c42-b346-90d1eb4a74d5-kube-api-access-thkjf\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.369212 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.369196 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbkb\" (UniqueName: \"kubernetes.io/projected/00df141c-2168-4e21-8641-acc0785cfdca-kube-api-access-spbkb\") pod \"kserve-controller-manager-69fc866d76-lsxbv\" (UID: \"00df141c-2168-4e21-8641-acc0785cfdca\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.468249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.468158 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:24.668081 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.668042 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lsxbv"] Jun 14 15:20:24.671948 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:24.671922 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00df141c_2168_4e21_8641_acc0785cfdca.slice/crio-808645be251626df79f09fcb22ad8364fc8eaf1f99ab48e0d0839ef47b32acd3 WatchSource:0}: Error finding container 808645be251626df79f09fcb22ad8364fc8eaf1f99ab48e0d0839ef47b32acd3: Status 404 returned error can't find the container with id 808645be251626df79f09fcb22ad8364fc8eaf1f99ab48e0d0839ef47b32acd3 Jun 14 15:20:24.858267 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.858229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:24.860636 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:24.860614 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3a633d6-5762-4c42-b346-90d1eb4a74d5-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4h5r5\" (UID: \"e3a633d6-5762-4c42-b346-90d1eb4a74d5\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:25.073454 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:25.073424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:25.130647 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:25.130603 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" event={"ID":"00df141c-2168-4e21-8641-acc0785cfdca","Type":"ContainerStarted","Data":"808645be251626df79f09fcb22ad8364fc8eaf1f99ab48e0d0839ef47b32acd3"} Jun 14 15:20:25.259393 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:25.259357 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5"] Jun 14 15:20:25.262659 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:25.262630 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode3a633d6_5762_4c42_b346_90d1eb4a74d5.slice/crio-74aabd63df91249c6a76e9459e65173a1f221acb7d88d7c23d8da10350c6f330 WatchSource:0}: Error finding container 74aabd63df91249c6a76e9459e65173a1f221acb7d88d7c23d8da10350c6f330: Status 404 returned error can't find the container with id 74aabd63df91249c6a76e9459e65173a1f221acb7d88d7c23d8da10350c6f330 Jun 14 15:20:26.137024 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:26.136987 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" event={"ID":"e3a633d6-5762-4c42-b346-90d1eb4a74d5","Type":"ContainerStarted","Data":"74aabd63df91249c6a76e9459e65173a1f221acb7d88d7c23d8da10350c6f330"} Jun 14 15:20:27.101955 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:27.101866 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4ljls" Jun 14 15:20:28.107136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.107051 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-7n8bz" Jun 14 15:20:28.153921 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.153885 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" event={"ID":"e3a633d6-5762-4c42-b346-90d1eb4a74d5","Type":"ContainerStarted","Data":"f81f39105ee14d289f6457ed8eb7143e5ac7b762ed235d9bc2b32900e030af66"} Jun 14 15:20:28.154098 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.153985 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:28.155432 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.155406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" event={"ID":"00df141c-2168-4e21-8641-acc0785cfdca","Type":"ContainerStarted","Data":"207ebc1254e6b5e1c72faaa5fafa73db9dbfe0eaff185a157720ea0e2e583a54"} Jun 14 15:20:28.155598 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.155465 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:20:28.201887 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.201832 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" podStartSLOduration=1.633340922 podStartE2EDuration="4.201815437s" totalImagesPullingTime="2.568474515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:28.20168917 +0000 UTC m=+409.126371100" watchObservedRunningTime="2026-06-14 15:20:28.201815437 +0000 UTC m=+409.126497367" Jun 14 15:20:28.300882 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:28.300820 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" podStartSLOduration=1.964858145 podStartE2EDuration="4.300804821s" totalImagesPullingTime="2.335946676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:28.299514245 +0000 UTC m=+409.224196191" watchObservedRunningTime="2026-06-14 15:20:28.300804821 +0000 UTC m=+409.225486773" Jun 14 15:20:31.727349 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.727315 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq"] Jun 14 15:20:31.730709 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.730692 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.733818 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.733789 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-skb5s\"" Jun 14 15:20:31.733933 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.733877 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 15:20:31.734093 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.734081 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 15:20:31.751781 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.751758 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq"] Jun 14 15:20:31.820712 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.820677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c505f5cf-16aa-4863-b01f-b8a71b32c65b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.820876 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.820724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7xwp\" (UniqueName: \"kubernetes.io/projected/c505f5cf-16aa-4863-b01f-b8a71b32c65b-kube-api-access-v7xwp\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.921481 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.921448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7xwp\" (UniqueName: \"kubernetes.io/projected/c505f5cf-16aa-4863-b01f-b8a71b32c65b-kube-api-access-v7xwp\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.921663 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.921573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c505f5cf-16aa-4863-b01f-b8a71b32c65b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.924063 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.924012 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/c505f5cf-16aa-4863-b01f-b8a71b32c65b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:31.936586 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:31.936562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7xwp\" (UniqueName: \"kubernetes.io/projected/c505f5cf-16aa-4863-b01f-b8a71b32c65b-kube-api-access-v7xwp\") pod \"servicemesh-operator3-57f65f65fb-rqgbq\" (UID: \"c505f5cf-16aa-4863-b01f-b8a71b32c65b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:32.039414 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:32.039336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:32.187431 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:32.187299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq"] Jun 14 15:20:32.190295 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:32.190258 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc505f5cf_16aa_4863_b01f_b8a71b32c65b.slice/crio-7f32ba268c353757b6825200db2a5878de82833ea356cce2083689fa22135033 WatchSource:0}: Error finding container 7f32ba268c353757b6825200db2a5878de82833ea356cce2083689fa22135033: Status 404 returned error can't find the container with id 7f32ba268c353757b6825200db2a5878de82833ea356cce2083689fa22135033 Jun 14 15:20:33.178892 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:33.178851 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" event={"ID":"c505f5cf-16aa-4863-b01f-b8a71b32c65b","Type":"ContainerStarted","Data":"7f32ba268c353757b6825200db2a5878de82833ea356cce2083689fa22135033"} Jun 14 15:20:35.189864 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.189825 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" event={"ID":"c505f5cf-16aa-4863-b01f-b8a71b32c65b","Type":"ContainerStarted","Data":"b58ee6716f8f25bedb930bd78f649e87f717a7a741671d2931786e58cbec860c"} Jun 14 15:20:35.190321 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.189927 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:35.222161 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.222109 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" podStartSLOduration=1.933779426 podStartE2EDuration="4.222094195s" totalImagesPullingTime="2.288314769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:35.2170463 +0000 UTC m=+416.141728228" watchObservedRunningTime="2026-06-14 15:20:35.222094195 +0000 UTC m=+416.146776124" Jun 14 15:20:35.656934 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.656895 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd"] Jun 14 15:20:35.660296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.660276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.663221 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.663058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 15:20:35.663221 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.663097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 15:20:35.663221 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.663109 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 15:20:35.663221 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.663063 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 15:20:35.663221 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.663141 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gq8jg\"" Jun 14 15:20:35.674943 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.674917 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd"] Jun 14 15:20:35.755340 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463cf404-6918-4965-9ccb-89c7c0a9bbb5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755675 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.755675 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.755585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444qv\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-kube-api-access-444qv\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.856956 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.856912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857162 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.856964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-444qv\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-kube-api-access-444qv\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857162 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463cf404-6918-4965-9ccb-89c7c0a9bbb5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857162 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857162 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857376 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857203 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857376 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.857939 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.857891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.859547 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.859508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.859657 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.859636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463cf404-6918-4965-9ccb-89c7c0a9bbb5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.860007 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.859987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.860045 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.860032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.866182 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.866154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-444qv\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-kube-api-access-444qv\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.867252 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.867231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463cf404-6918-4965-9ccb-89c7c0a9bbb5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zlbzd\" (UID: \"463cf404-6918-4965-9ccb-89c7c0a9bbb5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:35.970388 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:35.970299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:36.115776 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:36.115748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd"] Jun 14 15:20:36.118261 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:20:36.118235 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463cf404_6918_4965_9ccb_89c7c0a9bbb5.slice/crio-ed99aef59d30bdea20d3e808ebb9aa2974559a9408ebc57159811d9a57b5e73d WatchSource:0}: Error finding container ed99aef59d30bdea20d3e808ebb9aa2974559a9408ebc57159811d9a57b5e73d: Status 404 returned error can't find the container with id ed99aef59d30bdea20d3e808ebb9aa2974559a9408ebc57159811d9a57b5e73d Jun 14 15:20:36.195585 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:36.195548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" event={"ID":"463cf404-6918-4965-9ccb-89c7c0a9bbb5","Type":"ContainerStarted","Data":"ed99aef59d30bdea20d3e808ebb9aa2974559a9408ebc57159811d9a57b5e73d"} Jun 14 15:20:38.520888 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:38.520839 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:20:38.521336 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:38.521291 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 15:20:39.210999 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:39.210955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" event={"ID":"463cf404-6918-4965-9ccb-89c7c0a9bbb5","Type":"ContainerStarted","Data":"39ba669aa774c0b803711467c970a31c90d5881e5ba636779b6301413e573a17"} Jun 14 15:20:39.211364 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:39.211339 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:39.212635 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:39.212612 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-zlbzd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 15:20:39.212719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:39.212657 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" podUID="463cf404-6918-4965-9ccb-89c7c0a9bbb5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:20:39.236114 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:39.236048 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" podStartSLOduration=1.835949582 podStartE2EDuration="4.236028245s" totalImagesPullingTime="2.400078663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:39.235623314 +0000 UTC m=+420.160305244" watchObservedRunningTime="2026-06-14 15:20:39.236028245 +0000 UTC m=+420.160710174" Jun 14 15:20:40.216004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.215975 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zlbzd" Jun 14 15:20:40.847223 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.847187 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-545cdcc467-ghh84"] Jun 14 15:20:40.852011 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.851980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:40.854661 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.854642 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 15:20:40.854962 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.854946 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k2jp6\"" Jun 14 15:20:40.863426 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:40.863403 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-545cdcc467-ghh84"] Jun 14 15:20:41.003855 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.003819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-redirect-config\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.004033 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.003910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gthc7\" (UniqueName: \"kubernetes.io/projected/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-kube-api-access-gthc7\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.104787 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.104705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gthc7\" (UniqueName: \"kubernetes.io/projected/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-kube-api-access-gthc7\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.104787 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.104751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-redirect-config\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.105454 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.105433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-redirect-config\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.115300 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.115277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gthc7\" (UniqueName: \"kubernetes.io/projected/a5bf38bd-d3dc-4cb8-b33e-542709ade38e-kube-api-access-gthc7\") pod \"dashboard-redirect-545cdcc467-ghh84\" (UID: \"a5bf38bd-d3dc-4cb8-b33e-542709ade38e\") " pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.164197 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.164162 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" Jun 14 15:20:41.312080 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:41.310722 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-545cdcc467-ghh84"] Jun 14 15:20:42.229058 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:42.229017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" event={"ID":"a5bf38bd-d3dc-4cb8-b33e-542709ade38e","Type":"ContainerStarted","Data":"8ccb63eaf569ce69bae4f5e440a80d371ee129e042b054c475f742610e316463"} Jun 14 15:20:43.235678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:43.235647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" event={"ID":"a5bf38bd-d3dc-4cb8-b33e-542709ade38e","Type":"ContainerStarted","Data":"74100f7886fc6df39377f260d663f535e843ef30041dcc7e0a05f1aac92a7875"} Jun 14 15:20:43.252838 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:43.252785 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-545cdcc467-ghh84" podStartSLOduration=1.508735373 podStartE2EDuration="3.252769528s" totalImagesPullingTime="1.744034155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:20:43.252283316 +0000 UTC m=+424.176965248" watchObservedRunningTime="2026-06-14 15:20:43.252769528 +0000 UTC m=+424.177451456" Jun 14 15:20:46.198309 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:46.198278 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rqgbq" Jun 14 15:20:59.168045 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:59.167837 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4h5r5" Jun 14 15:20:59.168842 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:20:59.168811 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lsxbv" Jun 14 15:21:46.228002 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.227964 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq"] Jun 14 15:21:46.231646 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.231624 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:46.234474 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.234453 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 15:21:46.234590 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.234479 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:21:46.234590 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.234480 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-72dzk\"" Jun 14 15:21:46.235678 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.235662 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:21:46.245376 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.245350 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq"] Jun 14 15:21:46.246572 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.246548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x58p\" (UniqueName: \"kubernetes.io/projected/ff1d3e2b-37c2-4c53-ab31-7f188e711862-kube-api-access-7x58p\") pod \"dns-operator-controller-manager-864dd78c4c-lcpzq\" (UID: \"ff1d3e2b-37c2-4c53-ab31-7f188e711862\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:46.347004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.346959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x58p\" (UniqueName: \"kubernetes.io/projected/ff1d3e2b-37c2-4c53-ab31-7f188e711862-kube-api-access-7x58p\") pod \"dns-operator-controller-manager-864dd78c4c-lcpzq\" (UID: \"ff1d3e2b-37c2-4c53-ab31-7f188e711862\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:46.359194 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.359158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x58p\" (UniqueName: \"kubernetes.io/projected/ff1d3e2b-37c2-4c53-ab31-7f188e711862-kube-api-access-7x58p\") pod \"dns-operator-controller-manager-864dd78c4c-lcpzq\" (UID: \"ff1d3e2b-37c2-4c53-ab31-7f188e711862\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:46.542452 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.542350 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:46.682421 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:46.682356 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq"] Jun 14 15:21:46.684643 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:21:46.684615 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1d3e2b_37c2_4c53_ab31_7f188e711862.slice/crio-e1e14c8867ab0ff64d075d217a34cde1027f845d4ef09e90a6fa6ad47ed6d46b WatchSource:0}: Error finding container e1e14c8867ab0ff64d075d217a34cde1027f845d4ef09e90a6fa6ad47ed6d46b: Status 404 returned error can't find the container with id e1e14c8867ab0ff64d075d217a34cde1027f845d4ef09e90a6fa6ad47ed6d46b Jun 14 15:21:47.509179 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:47.509136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" event={"ID":"ff1d3e2b-37c2-4c53-ab31-7f188e711862","Type":"ContainerStarted","Data":"e1e14c8867ab0ff64d075d217a34cde1027f845d4ef09e90a6fa6ad47ed6d46b"} Jun 14 15:21:48.515315 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:48.515281 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" event={"ID":"ff1d3e2b-37c2-4c53-ab31-7f188e711862","Type":"ContainerStarted","Data":"e7c104038c8dc4a31b8203979c707421fa94ed54f5120202d02e4361c2ee2482"} Jun 14 15:21:48.515733 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:48.515353 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:21:48.537286 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:48.537237 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" podStartSLOduration=1.114053763 podStartE2EDuration="2.537221138s" totalImagesPullingTime="1.423167375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:48.536668107 +0000 UTC m=+489.461350037" watchObservedRunningTime="2026-06-14 15:21:48.537221138 +0000 UTC m=+489.461903066" Jun 14 15:21:51.339508 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.339471 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr"] Jun 14 15:21:51.342770 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.342754 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.345279 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.345256 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jk8ps\"" Jun 14 15:21:51.358891 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.358853 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr"] Jun 14 15:21:51.384352 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.384326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5bnq\" (UniqueName: \"kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.384465 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.384373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.485771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.485739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5bnq\" (UniqueName: \"kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.485955 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.485811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.486183 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.486161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.501028 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.500996 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5bnq\" (UniqueName: \"kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.652431 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.652337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:51.793082 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:51.793057 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr"] Jun 14 15:21:51.795448 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:21:51.795425 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90416c60_bec2_4ed4_9f0f_3bbca85ceaa3.slice/crio-e9f6f22dbea5208e0f19072e4b4d297250192b08f7b2ebe2c65d73eb58ee0afd WatchSource:0}: Error finding container e9f6f22dbea5208e0f19072e4b4d297250192b08f7b2ebe2c65d73eb58ee0afd: Status 404 returned error can't find the container with id e9f6f22dbea5208e0f19072e4b4d297250192b08f7b2ebe2c65d73eb58ee0afd Jun 14 15:21:52.539322 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:52.539277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" event={"ID":"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3","Type":"ContainerStarted","Data":"e9f6f22dbea5208e0f19072e4b4d297250192b08f7b2ebe2c65d73eb58ee0afd"} Jun 14 15:21:56.559337 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:56.559300 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" event={"ID":"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3","Type":"ContainerStarted","Data":"0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710"} Jun 14 15:21:56.559756 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:56.559404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:21:56.599136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:56.599072 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" podStartSLOduration=1.219944321 podStartE2EDuration="5.59905076s" totalImagesPullingTime="4.379106439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:21:56.596256768 +0000 UTC m=+497.520938697" watchObservedRunningTime="2026-06-14 15:21:56.59905076 +0000 UTC m=+497.523732690" Jun 14 15:21:59.524105 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:21:59.524076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lcpzq" Jun 14 15:22:07.565815 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:07.565786 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.158606 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.158575 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr"] Jun 14 15:22:09.159002 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.158792 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" containerName="manager" containerID="cri-o://0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710" gracePeriod=2 Jun 14 15:22:09.166339 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.166306 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr"] Jun 14 15:22:09.187373 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.187021 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:09.187550 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.187513 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" containerName="manager" Jun 14 15:22:09.187625 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.187554 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" containerName="manager" Jun 14 15:22:09.187677 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.187661 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" containerName="manager" Jun 14 15:22:09.190597 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.190576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.206985 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.206951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:09.235902 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:22:09.235871 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.237170 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.237148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qx6g\" (UniqueName: \"kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.237298 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.237186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.338177 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.338142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qx6g\" (UniqueName: \"kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.338320 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.338201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.338584 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.338559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.353101 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.353079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qx6g\" (UniqueName: \"kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msmg2\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.406766 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.406741 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.410047 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:22:09.409995 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.538939 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.538903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:09.539102 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.538968 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5bnq\" (UniqueName: \"kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq\") pod \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " Jun 14 15:22:09.539102 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.539024 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume\") pod \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\" (UID: \"90416c60-bec2-4ed4-9f0f-3bbca85ceaa3\") " Jun 14 15:22:09.539502 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.539483 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" (UID: "90416c60-bec2-4ed4-9f0f-3bbca85ceaa3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:22:09.541122 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.541092 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq" (OuterVolumeSpecName: "kube-api-access-m5bnq") pod "90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" (UID: "90416c60-bec2-4ed4-9f0f-3bbca85ceaa3"). InnerVolumeSpecName "kube-api-access-m5bnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:22:09.563589 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:22:09.563547 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd4fr\" is forbidden: User \"system:node:ip-10-0-141-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-194.ec2.internal' and this object" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.563729 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.563649 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" path="/var/lib/kubelet/pods/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3/volumes" Jun 14 15:22:09.621640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.621610 2567 generic.go:356] "Generic (PLEG): container finished" podID="90416c60-bec2-4ed4-9f0f-3bbca85ceaa3" containerID="0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710" exitCode=0 Jun 14 15:22:09.621791 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.621665 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd4fr" Jun 14 15:22:09.621791 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.621663 2567 scope.go:117] "RemoveContainer" containerID="0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710" Jun 14 15:22:09.632953 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.632929 2567 scope.go:117] "RemoveContainer" containerID="0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710" Jun 14 15:22:09.633249 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:22:09.633229 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710\": container with ID starting with 0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710 not found: ID does not exist" containerID="0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710" Jun 14 15:22:09.633325 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.633258 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710"} err="failed to get container status \"0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710\": rpc error: code = NotFound desc = could not find container \"0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710\": container with ID starting with 0eeb436336776ebf8e917be23c2bbb29e88e1111b2fe41835ab4c407d0bc3710 not found: ID does not exist" Jun 14 15:22:09.639732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.639709 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-extensions-socket-volume\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:22:09.639732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.639730 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5bnq\" (UniqueName: \"kubernetes.io/projected/90416c60-bec2-4ed4-9f0f-3bbca85ceaa3-kube-api-access-m5bnq\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:22:09.683820 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:09.683752 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:09.687163 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:22:09.687141 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode888d70f_e1ac_4820_833b_dc2a9fb8ffc4.slice/crio-bf2f92437efc420535f87a44826aec512d09867623ed839e22a5b73c3291d699 WatchSource:0}: Error finding container bf2f92437efc420535f87a44826aec512d09867623ed839e22a5b73c3291d699: Status 404 returned error can't find the container with id bf2f92437efc420535f87a44826aec512d09867623ed839e22a5b73c3291d699 Jun 14 15:22:10.628359 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:10.628320 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" event={"ID":"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4","Type":"ContainerStarted","Data":"ae5c3806f6525aca342fe28fdba24d29a5bbb2bc96e086e039096558f38eda3a"} Jun 14 15:22:10.628843 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:10.628380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" event={"ID":"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4","Type":"ContainerStarted","Data":"bf2f92437efc420535f87a44826aec512d09867623ed839e22a5b73c3291d699"} Jun 14 15:22:10.628843 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:10.628503 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:10.657534 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:10.657477 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" podStartSLOduration=1.657462533 podStartE2EDuration="1.657462533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:22:10.655286821 +0000 UTC m=+511.579968784" watchObservedRunningTime="2026-06-14 15:22:10.657462533 +0000 UTC m=+511.582144462" Jun 14 15:22:21.636329 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:21.636296 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:37.574061 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.574026 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:37.574429 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.574217 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" podUID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" containerName="manager" containerID="cri-o://ae5c3806f6525aca342fe28fdba24d29a5bbb2bc96e086e039096558f38eda3a" gracePeriod=10 Jun 14 15:22:37.756546 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.756498 2567 generic.go:356] "Generic (PLEG): container finished" podID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" containerID="ae5c3806f6525aca342fe28fdba24d29a5bbb2bc96e086e039096558f38eda3a" exitCode=0 Jun 14 15:22:37.756690 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.756547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" event={"ID":"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4","Type":"ContainerDied","Data":"ae5c3806f6525aca342fe28fdba24d29a5bbb2bc96e086e039096558f38eda3a"} Jun 14 15:22:37.827413 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.827354 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:37.883968 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.883937 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qx6g\" (UniqueName: \"kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g\") pod \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " Jun 14 15:22:37.884121 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.883978 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume\") pod \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\" (UID: \"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4\") " Jun 14 15:22:37.884418 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.884389 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" (UID: "e888d70f-e1ac-4820-833b-dc2a9fb8ffc4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:22:37.886004 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.885978 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g" (OuterVolumeSpecName: "kube-api-access-4qx6g") pod "e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" (UID: "e888d70f-e1ac-4820-833b-dc2a9fb8ffc4"). InnerVolumeSpecName "kube-api-access-4qx6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:22:37.984651 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.984615 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-extensions-socket-volume\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:22:37.984651 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:37.984646 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qx6g\" (UniqueName: \"kubernetes.io/projected/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4-kube-api-access-4qx6g\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:22:38.762481 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:38.762442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" event={"ID":"e888d70f-e1ac-4820-833b-dc2a9fb8ffc4","Type":"ContainerDied","Data":"bf2f92437efc420535f87a44826aec512d09867623ed839e22a5b73c3291d699"} Jun 14 15:22:38.762481 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:38.762465 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2" Jun 14 15:22:38.762954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:38.762541 2567 scope.go:117] "RemoveContainer" containerID="ae5c3806f6525aca342fe28fdba24d29a5bbb2bc96e086e039096558f38eda3a" Jun 14 15:22:38.793857 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:38.793830 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:38.802272 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:38.802245 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msmg2"] Jun 14 15:22:39.563645 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:39.563619 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" path="/var/lib/kubelet/pods/e888d70f-e1ac-4820-833b-dc2a9fb8ffc4/volumes" Jun 14 15:22:56.248753 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.248714 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:22:56.249236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.249046 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" containerName="manager" Jun 14 15:22:56.249236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.249059 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" containerName="manager" Jun 14 15:22:56.249236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.249122 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e888d70f-e1ac-4820-833b-dc2a9fb8ffc4" containerName="manager" Jun 14 15:22:56.253709 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.253687 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:22:56.253833 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.253772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.256502 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.256474 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 15:22:56.256652 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.256623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8z4vx\"" Jun 14 15:22:56.333853 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.333820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.334018 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.333888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn64l\" (UniqueName: \"kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.341326 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.341299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:22:56.435158 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.435123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.435308 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.435186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn64l\" (UniqueName: \"kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.435764 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.435746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.442896 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.442872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn64l\" (UniqueName: \"kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l\") pod \"limitador-limitador-64c94fd64f-prqlr\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.563706 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.563629 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:56.696188 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.696163 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:22:56.698600 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:22:56.698575 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cfcb81_3b01_4837_93f4_85d494a13f23.slice/crio-16a81ad7da55419711166b51fa32038d1e675f9a7892f8f4ae4076e094bd78be WatchSource:0}: Error finding container 16a81ad7da55419711166b51fa32038d1e675f9a7892f8f4ae4076e094bd78be: Status 404 returned error can't find the container with id 16a81ad7da55419711166b51fa32038d1e675f9a7892f8f4ae4076e094bd78be Jun 14 15:22:56.847580 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:56.847490 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" event={"ID":"79cfcb81-3b01-4837-93f4-85d494a13f23","Type":"ContainerStarted","Data":"16a81ad7da55419711166b51fa32038d1e675f9a7892f8f4ae4076e094bd78be"} Jun 14 15:22:59.863415 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:59.863383 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" event={"ID":"79cfcb81-3b01-4837-93f4-85d494a13f23","Type":"ContainerStarted","Data":"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8"} Jun 14 15:22:59.863830 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:59.863457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:22:59.880766 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:22:59.880721 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" podStartSLOduration=1.317306895 podStartE2EDuration="3.880705198s" totalImagesPullingTime="2.563398303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:22:59.879318778 +0000 UTC m=+560.804000708" watchObservedRunningTime="2026-06-14 15:22:59.880705198 +0000 UTC m=+560.805387127" Jun 14 15:23:10.868423 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:10.868391 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:23:12.944354 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:12.944320 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:23:12.944831 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:12.944502 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" podUID="79cfcb81-3b01-4837-93f4-85d494a13f23" containerName="limitador" containerID="cri-o://386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8" gracePeriod=30 Jun 14 15:23:13.396865 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.396839 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:23:13.480894 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.480860 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file\") pod \"79cfcb81-3b01-4837-93f4-85d494a13f23\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " Jun 14 15:23:13.481044 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.480997 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn64l\" (UniqueName: \"kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l\") pod \"79cfcb81-3b01-4837-93f4-85d494a13f23\" (UID: \"79cfcb81-3b01-4837-93f4-85d494a13f23\") " Jun 14 15:23:13.481262 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.481243 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file" (OuterVolumeSpecName: "config-file") pod "79cfcb81-3b01-4837-93f4-85d494a13f23" (UID: "79cfcb81-3b01-4837-93f4-85d494a13f23"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:23:13.483016 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.482984 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l" (OuterVolumeSpecName: "kube-api-access-rn64l") pod "79cfcb81-3b01-4837-93f4-85d494a13f23" (UID: "79cfcb81-3b01-4837-93f4-85d494a13f23"). InnerVolumeSpecName "kube-api-access-rn64l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:23:13.581887 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.581862 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn64l\" (UniqueName: \"kubernetes.io/projected/79cfcb81-3b01-4837-93f4-85d494a13f23-kube-api-access-rn64l\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:23:13.581887 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.581888 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/79cfcb81-3b01-4837-93f4-85d494a13f23-config-file\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:23:13.932107 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.932020 2567 generic.go:356] "Generic (PLEG): container finished" podID="79cfcb81-3b01-4837-93f4-85d494a13f23" containerID="386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8" exitCode=0 Jun 14 15:23:13.932107 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.932074 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" Jun 14 15:23:13.932289 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.932108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" event={"ID":"79cfcb81-3b01-4837-93f4-85d494a13f23","Type":"ContainerDied","Data":"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8"} Jun 14 15:23:13.932289 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.932180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-prqlr" event={"ID":"79cfcb81-3b01-4837-93f4-85d494a13f23","Type":"ContainerDied","Data":"16a81ad7da55419711166b51fa32038d1e675f9a7892f8f4ae4076e094bd78be"} Jun 14 15:23:13.932289 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.932238 2567 scope.go:117] "RemoveContainer" containerID="386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8" Jun 14 15:23:13.942281 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.942246 2567 scope.go:117] "RemoveContainer" containerID="386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8" Jun 14 15:23:13.942727 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:23:13.942708 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8\": container with ID starting with 386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8 not found: ID does not exist" containerID="386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8" Jun 14 15:23:13.942804 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.942734 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8"} err="failed to get container status \"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8\": rpc error: code = NotFound desc = could not find container \"386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8\": container with ID starting with 386f8d5fd8620747f6e777de24974a54b5328bfdb7be549aa7c525276cf509e8 not found: ID does not exist" Jun 14 15:23:13.949602 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.949580 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:23:13.952782 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:13.952762 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-prqlr"] Jun 14 15:23:15.563983 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:15.563942 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cfcb81-3b01-4837-93f4-85d494a13f23" path="/var/lib/kubelet/pods/79cfcb81-3b01-4837-93f4-85d494a13f23/volumes" Jun 14 15:23:17.388068 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.388032 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vblcx"] Jun 14 15:23:17.388577 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.388558 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cfcb81-3b01-4837-93f4-85d494a13f23" containerName="limitador" Jun 14 15:23:17.388653 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.388580 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cfcb81-3b01-4837-93f4-85d494a13f23" containerName="limitador" Jun 14 15:23:17.388711 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.388667 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cfcb81-3b01-4837-93f4-85d494a13f23" containerName="limitador" Jun 14 15:23:17.392861 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.392838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.395947 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.395929 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 15:23:17.400340 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.400318 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vblcx"] Jun 14 15:23:17.515215 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.515172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmds\" (UniqueName: \"kubernetes.io/projected/3ee2a78b-f7e8-463f-b472-37bd2007b96e-kube-api-access-hdmds\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.515389 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.515233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3ee2a78b-f7e8-463f-b472-37bd2007b96e-data\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.615826 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.615796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmds\" (UniqueName: \"kubernetes.io/projected/3ee2a78b-f7e8-463f-b472-37bd2007b96e-kube-api-access-hdmds\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.616019 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.615842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3ee2a78b-f7e8-463f-b472-37bd2007b96e-data\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.616166 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.616149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3ee2a78b-f7e8-463f-b472-37bd2007b96e-data\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.624253 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.624229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmds\" (UniqueName: \"kubernetes.io/projected/3ee2a78b-f7e8-463f-b472-37bd2007b96e-kube-api-access-hdmds\") pod \"postgres-69fb4594cf-vblcx\" (UID: \"3ee2a78b-f7e8-463f-b472-37bd2007b96e\") " pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.703107 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.703027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:17.832152 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.832127 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vblcx"] Jun 14 15:23:17.833749 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:23:17.833722 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee2a78b_f7e8_463f_b472_37bd2007b96e.slice/crio-7337c941a87413d3016d3689d21aa16a9bf02483ab1e49071ae8850bea0143c2 WatchSource:0}: Error finding container 7337c941a87413d3016d3689d21aa16a9bf02483ab1e49071ae8850bea0143c2: Status 404 returned error can't find the container with id 7337c941a87413d3016d3689d21aa16a9bf02483ab1e49071ae8850bea0143c2 Jun 14 15:23:17.951415 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:17.951386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vblcx" event={"ID":"3ee2a78b-f7e8-463f-b472-37bd2007b96e","Type":"ContainerStarted","Data":"7337c941a87413d3016d3689d21aa16a9bf02483ab1e49071ae8850bea0143c2"} Jun 14 15:23:19.961779 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:19.961742 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vblcx" event={"ID":"3ee2a78b-f7e8-463f-b472-37bd2007b96e","Type":"ContainerStarted","Data":"663b822f0c004f4e42a9843d68035229514c97d1411cac5d36bbedab21694be0"} Jun 14 15:23:19.962117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:19.961870 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:19.999837 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:19.999786 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vblcx" podStartSLOduration=0.982253491 podStartE2EDuration="2.999770259s" totalImagesPullingTime="2.017516768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:23:19.998513707 +0000 UTC m=+580.923195639" watchObservedRunningTime="2026-06-14 15:23:19.999770259 +0000 UTC m=+580.924452188" Jun 14 15:23:25.998486 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:25.998457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vblcx" Jun 14 15:23:35.640577 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.640543 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bfvkr"] Jun 14 15:23:35.647688 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.647668 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" Jun 14 15:23:35.650574 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.650552 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 15:23:35.651840 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.651817 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-7mb7l\"" Jun 14 15:23:35.652258 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.652077 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 15:23:35.654161 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.654137 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bfvkr"] Jun 14 15:23:35.770591 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.770559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8t9t\" (UniqueName: \"kubernetes.io/projected/f9612d82-b59c-4f16-9321-23530ef2ad61-kube-api-access-g8t9t\") pod \"keycloak-operator-d67dbbb48-bfvkr\" (UID: \"f9612d82-b59c-4f16-9321-23530ef2ad61\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" Jun 14 15:23:35.871263 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.871225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8t9t\" (UniqueName: \"kubernetes.io/projected/f9612d82-b59c-4f16-9321-23530ef2ad61-kube-api-access-g8t9t\") pod \"keycloak-operator-d67dbbb48-bfvkr\" (UID: \"f9612d82-b59c-4f16-9321-23530ef2ad61\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" Jun 14 15:23:35.882812 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.882778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8t9t\" (UniqueName: \"kubernetes.io/projected/f9612d82-b59c-4f16-9321-23530ef2ad61-kube-api-access-g8t9t\") pod \"keycloak-operator-d67dbbb48-bfvkr\" (UID: \"f9612d82-b59c-4f16-9321-23530ef2ad61\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" Jun 14 15:23:35.959087 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:35.958992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" Jun 14 15:23:36.093036 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:36.093014 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bfvkr"] Jun 14 15:23:36.095756 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:23:36.095724 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9612d82_b59c_4f16_9321_23530ef2ad61.slice/crio-d1fbd826a4331acbd72e22da9eb634d0b720ae4da76220b77c1f3f5dde5ca9f9 WatchSource:0}: Error finding container d1fbd826a4331acbd72e22da9eb634d0b720ae4da76220b77c1f3f5dde5ca9f9: Status 404 returned error can't find the container with id d1fbd826a4331acbd72e22da9eb634d0b720ae4da76220b77c1f3f5dde5ca9f9 Jun 14 15:23:37.048065 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:37.048028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" event={"ID":"f9612d82-b59c-4f16-9321-23530ef2ad61","Type":"ContainerStarted","Data":"d1fbd826a4331acbd72e22da9eb634d0b720ae4da76220b77c1f3f5dde5ca9f9"} Jun 14 15:23:41.263572 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:41.263546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:23:41.264272 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:41.264252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:23:42.073782 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:42.073746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" event={"ID":"f9612d82-b59c-4f16-9321-23530ef2ad61","Type":"ContainerStarted","Data":"e2d164a230968280c88798b020ac5dd5f25839ede2f28da4e957fc5acf9c3b4c"} Jun 14 15:23:42.091491 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:23:42.091445 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-bfvkr" podStartSLOduration=1.888852999 podStartE2EDuration="7.091430479s" totalImagesPullingTime="5.20257748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:23:42.090338837 +0000 UTC m=+603.015020778" watchObservedRunningTime="2026-06-14 15:23:42.091430479 +0000 UTC m=+603.016112399" Jun 14 15:24:24.740139 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.740098 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:24.748771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.748741 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:24.751898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.751879 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 15:24:24.751898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.751896 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dlxfn\"" Jun 14 15:24:24.752855 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.752832 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 15:24:24.758088 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.758065 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:24.887869 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.887831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrfg\" (UniqueName: \"kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:24.888042 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.887888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:24.957390 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.957357 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:24:24.960898 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.960871 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:24.981579 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.981551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:24:24.989324 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.989301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrfg\" (UniqueName: \"kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:24.989460 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:24.989353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:24.989460 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:24:24.989455 2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 15:24:24.989595 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:24:24.989514 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert podName:ceb14301-be00-469c-ba67-ea2b841f2b46 nodeName:}" failed. No retries permitted until 2026-06-14 15:24:25.48949886 +0000 UTC m=+646.414180768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert") pod "maas-controller-6cd6d94d7d-zjx8k" (UID: "ceb14301-be00-469c-ba67-ea2b841f2b46") : secret "maas-controller-webhook-cert" not found Jun 14 15:24:25.003036 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.002973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrfg\" (UniqueName: \"kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:25.089771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.089731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.089771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.089767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwrx\" (UniqueName: \"kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.190718 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.190686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.190718 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.190722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwrx\" (UniqueName: \"kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.193180 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.193160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.200582 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.200563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwrx\" (UniqueName: \"kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx\") pod \"maas-controller-6dbdff6cd-wpsxs\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.270101 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.270024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:25.403467 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.403443 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:24:25.406046 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:24:25.406015 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffc1730_9a77_40c8_b005_2cc3d7a7d8a1.slice/crio-1531507003a2a323caa1194159fa0e139beab4e3373514caa3f6a2a2f4a116eb WatchSource:0}: Error finding container 1531507003a2a323caa1194159fa0e139beab4e3373514caa3f6a2a2f4a116eb: Status 404 returned error can't find the container with id 1531507003a2a323caa1194159fa0e139beab4e3373514caa3f6a2a2f4a116eb Jun 14 15:24:25.492853 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.492823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:25.495168 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.495150 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") pod \"maas-controller-6cd6d94d7d-zjx8k\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:25.660222 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.660122 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:25.789617 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:25.789593 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:25.791213 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:24:25.791188 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb14301_be00_469c_ba67_ea2b841f2b46.slice/crio-c76ecf516821e12df45cedef4f6b4d80ce7bc45058ddf5eee831de8ee049df19 WatchSource:0}: Error finding container c76ecf516821e12df45cedef4f6b4d80ce7bc45058ddf5eee831de8ee049df19: Status 404 returned error can't find the container with id c76ecf516821e12df45cedef4f6b4d80ce7bc45058ddf5eee831de8ee049df19 Jun 14 15:24:26.274301 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:26.274216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" event={"ID":"ceb14301-be00-469c-ba67-ea2b841f2b46","Type":"ContainerStarted","Data":"c76ecf516821e12df45cedef4f6b4d80ce7bc45058ddf5eee831de8ee049df19"} Jun 14 15:24:26.275592 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:26.275558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" event={"ID":"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1","Type":"ContainerStarted","Data":"1531507003a2a323caa1194159fa0e139beab4e3373514caa3f6a2a2f4a116eb"} Jun 14 15:24:28.286681 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.286639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" event={"ID":"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1","Type":"ContainerStarted","Data":"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4"} Jun 14 15:24:28.287150 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.286752 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:28.288219 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.288198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" event={"ID":"ceb14301-be00-469c-ba67-ea2b841f2b46","Type":"ContainerStarted","Data":"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6"} Jun 14 15:24:28.288327 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.288307 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:28.308630 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.308580 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" podStartSLOduration=2.481791998 podStartE2EDuration="4.308565271s" totalImagesPullingTime="1.826773273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:28.306465861 +0000 UTC m=+649.231147792" watchObservedRunningTime="2026-06-14 15:24:28.308565271 +0000 UTC m=+649.233247200" Jun 14 15:24:28.325875 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:28.325825 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" podStartSLOduration=2.864485255 podStartE2EDuration="4.32581398s" totalImagesPullingTime="1.461328725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:24:28.32471289 +0000 UTC m=+649.249394823" watchObservedRunningTime="2026-06-14 15:24:28.32581398 +0000 UTC m=+649.250495906" Jun 14 15:24:39.298737 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.298702 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:39.299153 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.298875 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:24:39.360320 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.360287 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:39.360497 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.360473 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" podUID="ceb14301-be00-469c-ba67-ea2b841f2b46" containerName="manager" containerID="cri-o://81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6" gracePeriod=30 Jun 14 15:24:39.617002 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.616975 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:39.713258 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.713230 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") pod \"ceb14301-be00-469c-ba67-ea2b841f2b46\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " Jun 14 15:24:39.713443 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.713267 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjrfg\" (UniqueName: \"kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg\") pod \"ceb14301-be00-469c-ba67-ea2b841f2b46\" (UID: \"ceb14301-be00-469c-ba67-ea2b841f2b46\") " Jun 14 15:24:39.715814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.715784 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ceb14301-be00-469c-ba67-ea2b841f2b46" (UID: "ceb14301-be00-469c-ba67-ea2b841f2b46"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:24:39.715814 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.715803 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg" (OuterVolumeSpecName: "kube-api-access-gjrfg") pod "ceb14301-be00-469c-ba67-ea2b841f2b46" (UID: "ceb14301-be00-469c-ba67-ea2b841f2b46"). InnerVolumeSpecName "kube-api-access-gjrfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:24:39.813906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.813873 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb14301-be00-469c-ba67-ea2b841f2b46-webhook-cert\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:24:39.813906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:39.813899 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrfg\" (UniqueName: \"kubernetes.io/projected/ceb14301-be00-469c-ba67-ea2b841f2b46-kube-api-access-gjrfg\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:24:40.343095 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.343060 2567 generic.go:356] "Generic (PLEG): container finished" podID="ceb14301-be00-469c-ba67-ea2b841f2b46" containerID="81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6" exitCode=0 Jun 14 15:24:40.343493 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.343118 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" Jun 14 15:24:40.343493 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.343147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" event={"ID":"ceb14301-be00-469c-ba67-ea2b841f2b46","Type":"ContainerDied","Data":"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6"} Jun 14 15:24:40.343493 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.343219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd6d94d7d-zjx8k" event={"ID":"ceb14301-be00-469c-ba67-ea2b841f2b46","Type":"ContainerDied","Data":"c76ecf516821e12df45cedef4f6b4d80ce7bc45058ddf5eee831de8ee049df19"} Jun 14 15:24:40.343493 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.343242 2567 scope.go:117] "RemoveContainer" containerID="81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6" Jun 14 15:24:40.351605 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.351587 2567 scope.go:117] "RemoveContainer" containerID="81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6" Jun 14 15:24:40.351869 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:24:40.351852 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6\": container with ID starting with 81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6 not found: ID does not exist" containerID="81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6" Jun 14 15:24:40.351916 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.351878 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6"} err="failed to get container status \"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6\": rpc error: code = NotFound desc = could not find container \"81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6\": container with ID starting with 81509d36e0fd4197c6bc49f5d69a2dd87c0561d6ddfccfeff0dcf583e994fad6 not found: ID does not exist" Jun 14 15:24:40.364186 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.364162 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:40.368187 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:40.368166 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cd6d94d7d-zjx8k"] Jun 14 15:24:41.563491 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:41.563462 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceb14301-be00-469c-ba67-ea2b841f2b46" path="/var/lib/kubelet/pods/ceb14301-be00-469c-ba67-ea2b841f2b46/volumes" Jun 14 15:24:58.510155 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.510123 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5b885568cf-dhrxb"] Jun 14 15:24:58.510771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.510661 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceb14301-be00-469c-ba67-ea2b841f2b46" containerName="manager" Jun 14 15:24:58.510771 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.510682 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceb14301-be00-469c-ba67-ea2b841f2b46" containerName="manager" Jun 14 15:24:58.510882 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.510777 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceb14301-be00-469c-ba67-ea2b841f2b46" containerName="manager" Jun 14 15:24:58.517136 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.517116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.519532 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.519496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 15:24:58.519614 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.519543 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nw9nk\"" Jun 14 15:24:58.525754 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.525729 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b885568cf-dhrxb"] Jun 14 15:24:58.572993 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.572964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7123a639-04f7-47fb-93e9-9a2c90db2543-openshift-service-ca\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.573124 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.573059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.573124 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.573082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxg9f\" (UniqueName: \"kubernetes.io/projected/7123a639-04f7-47fb-93e9-9a2c90db2543-kube-api-access-fxg9f\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.673607 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.673578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7123a639-04f7-47fb-93e9-9a2c90db2543-openshift-service-ca\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.673780 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.673731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.673780 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.673766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxg9f\" (UniqueName: \"kubernetes.io/projected/7123a639-04f7-47fb-93e9-9a2c90db2543-kube-api-access-fxg9f\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.673871 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:24:58.673854 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 14 15:24:58.673924 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:24:58.673915 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls podName:7123a639-04f7-47fb-93e9-9a2c90db2543 nodeName:}" failed. No retries permitted until 2026-06-14 15:24:59.173900643 +0000 UTC m=+680.098582551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls") pod "maas-api-5b885568cf-dhrxb" (UID: "7123a639-04f7-47fb-93e9-9a2c90db2543") : secret "maas-api-serving-cert" not found Jun 14 15:24:58.674235 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.674215 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7123a639-04f7-47fb-93e9-9a2c90db2543-openshift-service-ca\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:58.684912 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:58.684891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxg9f\" (UniqueName: \"kubernetes.io/projected/7123a639-04f7-47fb-93e9-9a2c90db2543-kube-api-access-fxg9f\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:59.094444 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.094408 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9f8r9"] Jun 14 15:24:59.099066 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.099026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:24:59.102461 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.102441 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 15:24:59.102592 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.102500 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-njqp2\"" Jun 14 15:24:59.111887 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.111863 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9f8r9"] Jun 14 15:24:59.178361 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.178328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5dq\" (UniqueName: \"kubernetes.io/projected/286b282e-c166-4f11-a541-1a21be327fb4-kube-api-access-qt5dq\") pod \"payload-pre-processing-579785bc64-9f8r9\" (UID: \"286b282e-c166-4f11-a541-1a21be327fb4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:24:59.178571 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.178375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:59.180767 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.180735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7123a639-04f7-47fb-93e9-9a2c90db2543-maas-api-tls\") pod \"maas-api-5b885568cf-dhrxb\" (UID: \"7123a639-04f7-47fb-93e9-9a2c90db2543\") " pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:59.279169 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.279131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5dq\" (UniqueName: \"kubernetes.io/projected/286b282e-c166-4f11-a541-1a21be327fb4-kube-api-access-qt5dq\") pod \"payload-pre-processing-579785bc64-9f8r9\" (UID: \"286b282e-c166-4f11-a541-1a21be327fb4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:24:59.287895 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.287869 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5dq\" (UniqueName: \"kubernetes.io/projected/286b282e-c166-4f11-a541-1a21be327fb4-kube-api-access-qt5dq\") pod \"payload-pre-processing-579785bc64-9f8r9\" (UID: \"286b282e-c166-4f11-a541-1a21be327fb4\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:24:59.410556 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.410461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:24:59.428218 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.428140 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:24:59.554885 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.554859 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9f8r9"] Jun 14 15:24:59.556638 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:24:59.556614 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286b282e_c166_4f11_a541_1a21be327fb4.slice/crio-e2a7560c7c6f49ca99ac77322fb1c2f010f3608e7656f9bc1224690b34c9656c WatchSource:0}: Error finding container e2a7560c7c6f49ca99ac77322fb1c2f010f3608e7656f9bc1224690b34c9656c: Status 404 returned error can't find the container with id e2a7560c7c6f49ca99ac77322fb1c2f010f3608e7656f9bc1224690b34c9656c Jun 14 15:24:59.558712 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.558696 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:24:59.780732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:24:59.780699 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b885568cf-dhrxb"] Jun 14 15:24:59.783899 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:24:59.783865 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7123a639_04f7_47fb_93e9_9a2c90db2543.slice/crio-34747b048466d07e01f025fd7c872c3bd667972f3c27ee7c0565ba47f1e09856 WatchSource:0}: Error finding container 34747b048466d07e01f025fd7c872c3bd667972f3c27ee7c0565ba47f1e09856: Status 404 returned error can't find the container with id 34747b048466d07e01f025fd7c872c3bd667972f3c27ee7c0565ba47f1e09856 Jun 14 15:25:00.433512 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:00.433473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b885568cf-dhrxb" event={"ID":"7123a639-04f7-47fb-93e9-9a2c90db2543","Type":"ContainerStarted","Data":"34747b048466d07e01f025fd7c872c3bd667972f3c27ee7c0565ba47f1e09856"} Jun 14 15:25:00.435063 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:00.435033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" event={"ID":"286b282e-c166-4f11-a541-1a21be327fb4","Type":"ContainerStarted","Data":"e2a7560c7c6f49ca99ac77322fb1c2f010f3608e7656f9bc1224690b34c9656c"} Jun 14 15:25:02.445797 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.445698 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b885568cf-dhrxb" event={"ID":"7123a639-04f7-47fb-93e9-9a2c90db2543","Type":"ContainerStarted","Data":"c2d4cccb53107cfbf810295a263f1a14d4006e989da304a9e12d630b488db42a"} Jun 14 15:25:02.446229 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.445788 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:25:02.447254 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.447233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" event={"ID":"286b282e-c166-4f11-a541-1a21be327fb4","Type":"ContainerStarted","Data":"5173793fe609d2b0e927da7fdbd039a2ea7b99ce5f5d24b59376306337e2287c"} Jun 14 15:25:02.447345 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.447327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:25:02.467733 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.467690 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5b885568cf-dhrxb" podStartSLOduration=2.128945561 podStartE2EDuration="4.467677006s" totalImagesPullingTime="2.338731445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:25:02.464959446 +0000 UTC m=+683.389641375" watchObservedRunningTime="2026-06-14 15:25:02.467677006 +0000 UTC m=+683.392358935" Jun 14 15:25:02.488939 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:02.488895 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" podStartSLOduration=0.922505084 podStartE2EDuration="3.488880436s" totalImagesPullingTime="2.566375352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:25:02.488132267 +0000 UTC m=+683.412814200" watchObservedRunningTime="2026-06-14 15:25:02.488880436 +0000 UTC m=+683.413562344" Jun 14 15:25:08.457757 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:08.457724 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5b885568cf-dhrxb" Jun 14 15:25:13.454296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:25:13.454266 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-9f8r9" Jun 14 15:26:21.794996 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.794962 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb"] Jun 14 15:26:21.798642 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.798619 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.802548 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.802507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 15:26:21.802548 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.802543 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 15:26:21.802685 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.802556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wskj2\"" Jun 14 15:26:21.802685 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.802512 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 15:26:21.816725 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.816696 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb"] Jun 14 15:26:21.922172 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.922172 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79cab84-19f9-43cf-b020-0728aa93ee13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.922370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrwfl\" (UniqueName: \"kubernetes.io/projected/c79cab84-19f9-43cf-b020-0728aa93ee13-kube-api-access-mrwfl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.922370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.922370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:21.922370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:21.922320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.022802 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.022802 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023046 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023046 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023046 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79cab84-19f9-43cf-b020-0728aa93ee13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023046 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.022908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrwfl\" (UniqueName: \"kubernetes.io/projected/c79cab84-19f9-43cf-b020-0728aa93ee13-kube-api-access-mrwfl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023253 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.023181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023364 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.023268 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.023364 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.023280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.025127 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.025106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79cab84-19f9-43cf-b020-0728aa93ee13-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.025373 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.025354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79cab84-19f9-43cf-b020-0728aa93ee13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.032074 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.032048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrwfl\" (UniqueName: \"kubernetes.io/projected/c79cab84-19f9-43cf-b020-0728aa93ee13-kube-api-access-mrwfl\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb\" (UID: \"c79cab84-19f9-43cf-b020-0728aa93ee13\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.118419 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.118333 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:22.256394 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.256365 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb"] Jun 14 15:26:22.258503 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:26:22.258479 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79cab84_19f9_43cf_b020_0728aa93ee13.slice/crio-e41f209c04baf9ac1a90c986fc2a82b80a8538053c7bbb030c08f275c1452c9d WatchSource:0}: Error finding container e41f209c04baf9ac1a90c986fc2a82b80a8538053c7bbb030c08f275c1452c9d: Status 404 returned error can't find the container with id e41f209c04baf9ac1a90c986fc2a82b80a8538053c7bbb030c08f275c1452c9d Jun 14 15:26:22.830689 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:22.830651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" event={"ID":"c79cab84-19f9-43cf-b020-0728aa93ee13","Type":"ContainerStarted","Data":"e41f209c04baf9ac1a90c986fc2a82b80a8538053c7bbb030c08f275c1452c9d"} Jun 14 15:26:25.848861 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:25.848816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" event={"ID":"c79cab84-19f9-43cf-b020-0728aa93ee13","Type":"ContainerStarted","Data":"679a2b72c6c7bdc014ffaf40eaf96cbca2bcea0cd187f0d9ae6c1292c3638dba"} Jun 14 15:26:27.860440 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:27.860411 2567 generic.go:356] "Generic (PLEG): container finished" podID="c79cab84-19f9-43cf-b020-0728aa93ee13" containerID="679a2b72c6c7bdc014ffaf40eaf96cbca2bcea0cd187f0d9ae6c1292c3638dba" exitCode=0 Jun 14 15:26:27.860878 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:27.860488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" event={"ID":"c79cab84-19f9-43cf-b020-0728aa93ee13","Type":"ContainerDied","Data":"679a2b72c6c7bdc014ffaf40eaf96cbca2bcea0cd187f0d9ae6c1292c3638dba"} Jun 14 15:26:29.872437 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:29.872405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" event={"ID":"c79cab84-19f9-43cf-b020-0728aa93ee13","Type":"ContainerStarted","Data":"7c46c05ad840a2326d6097835df43379c33424ec73c72cdb280cdd019e992306"} Jun 14 15:26:29.893752 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:29.893704 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" podStartSLOduration=3.305640688 podStartE2EDuration="8.893690876s" totalImagesPullingTime="4.116569709s" totalInitContainerRuntime="1.471480479s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:26:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:26:29.893154778 +0000 UTC m=+770.817836708" watchObservedRunningTime="2026-06-14 15:26:29.893690876 +0000 UTC m=+770.818372803" Jun 14 15:26:32.118685 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:32.118651 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:32.119092 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:32.118732 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:32.131170 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:32.131146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:26:32.898725 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:26:32.898694 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb" Jun 14 15:28:41.291494 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:28:41.291465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:28:41.292249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:28:41.292228 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:29:28.661190 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.661152 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:29:28.663657 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.661366 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" podUID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" containerName="manager" containerID="cri-o://01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4" gracePeriod=30 Jun 14 15:29:28.912640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.912589 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:29:28.942017 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.941989 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzwrx\" (UniqueName: \"kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx\") pod \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " Jun 14 15:29:28.942165 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.942057 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert\") pod \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\" (UID: \"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1\") " Jun 14 15:29:28.944065 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.944034 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" (UID: "9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:29:28.944170 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:28.944085 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx" (OuterVolumeSpecName: "kube-api-access-wzwrx") pod "9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" (UID: "9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1"). InnerVolumeSpecName "kube-api-access-wzwrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:29:29.043718 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.043686 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-webhook-cert\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:29:29.043718 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.043715 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzwrx\" (UniqueName: \"kubernetes.io/projected/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1-kube-api-access-wzwrx\") on node \"ip-10-0-141-194.ec2.internal\" DevicePath \"\"" Jun 14 15:29:29.740830 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.740799 2567 generic.go:356] "Generic (PLEG): container finished" podID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" containerID="01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4" exitCode=0 Jun 14 15:29:29.741209 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.740843 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" Jun 14 15:29:29.741209 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.740862 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" event={"ID":"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1","Type":"ContainerDied","Data":"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4"} Jun 14 15:29:29.741209 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.740918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-wpsxs" event={"ID":"9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1","Type":"ContainerDied","Data":"1531507003a2a323caa1194159fa0e139beab4e3373514caa3f6a2a2f4a116eb"} Jun 14 15:29:29.741209 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.740940 2567 scope.go:117] "RemoveContainer" containerID="01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4" Jun 14 15:29:29.749301 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.749285 2567 scope.go:117] "RemoveContainer" containerID="01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4" Jun 14 15:29:29.749559 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:29:29.749542 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4\": container with ID starting with 01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4 not found: ID does not exist" containerID="01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4" Jun 14 15:29:29.749637 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.749564 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4"} err="failed to get container status \"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4\": rpc error: code = NotFound desc = could not find container \"01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4\": container with ID starting with 01384b5e3619df61919361d159db0904c3332f9b35a5b637c5f07003561b0bf4 not found: ID does not exist" Jun 14 15:29:29.757385 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.757364 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:29:29.764565 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:29.761512 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-wpsxs"] Jun 14 15:29:30.512030 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.511989 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-4qq6l"] Jun 14 15:29:30.512385 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.512373 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" containerName="manager" Jun 14 15:29:30.512431 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.512386 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" containerName="manager" Jun 14 15:29:30.512469 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.512449 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" containerName="manager" Jun 14 15:29:30.516770 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.516750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.520426 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.520397 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 15:29:30.520426 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.520417 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dlxfn\"" Jun 14 15:29:30.520608 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.520435 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 15:29:30.525916 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.525890 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-4qq6l"] Jun 14 15:29:30.557370 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.557342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9925d-6cbc-4f0a-86eb-fec056204d04-webhook-cert\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.557490 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.557394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlv5t\" (UniqueName: \"kubernetes.io/projected/a2c9925d-6cbc-4f0a-86eb-fec056204d04-kube-api-access-vlv5t\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.657901 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.657869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlv5t\" (UniqueName: \"kubernetes.io/projected/a2c9925d-6cbc-4f0a-86eb-fec056204d04-kube-api-access-vlv5t\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.658059 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.657934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9925d-6cbc-4f0a-86eb-fec056204d04-webhook-cert\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.660237 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.660217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2c9925d-6cbc-4f0a-86eb-fec056204d04-webhook-cert\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.666256 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.666228 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlv5t\" (UniqueName: \"kubernetes.io/projected/a2c9925d-6cbc-4f0a-86eb-fec056204d04-kube-api-access-vlv5t\") pod \"maas-controller-6dbdff6cd-4qq6l\" (UID: \"a2c9925d-6cbc-4f0a-86eb-fec056204d04\") " pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.827592 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.827470 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:30.956945 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:30.956917 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dbdff6cd-4qq6l"] Jun 14 15:29:30.959007 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:29:30.958981 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c9925d_6cbc_4f0a_86eb_fec056204d04.slice/crio-36c160e77074973a38283fe5c90207b2330810498ef049cc72dcc2e9eebf4345 WatchSource:0}: Error finding container 36c160e77074973a38283fe5c90207b2330810498ef049cc72dcc2e9eebf4345: Status 404 returned error can't find the container with id 36c160e77074973a38283fe5c90207b2330810498ef049cc72dcc2e9eebf4345 Jun 14 15:29:31.564805 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:31.564764 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1" path="/var/lib/kubelet/pods/9ffc1730-9a77-40c8-b005-2cc3d7a7d8a1/volumes" Jun 14 15:29:31.751818 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:31.751783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" event={"ID":"a2c9925d-6cbc-4f0a-86eb-fec056204d04","Type":"ContainerStarted","Data":"9ec120f3298876a0d4f6b751fc32f05dce76dd00e7033d301eebd6e4022fa8b9"} Jun 14 15:29:31.751966 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:31.751837 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" event={"ID":"a2c9925d-6cbc-4f0a-86eb-fec056204d04","Type":"ContainerStarted","Data":"36c160e77074973a38283fe5c90207b2330810498ef049cc72dcc2e9eebf4345"} Jun 14 15:29:31.751966 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:31.751870 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:29:31.774834 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:31.774779 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" podStartSLOduration=1.386731668 podStartE2EDuration="1.77476464s" totalImagesPullingTime="388.032972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:29:31.7717896 +0000 UTC m=+952.696471528" watchObservedRunningTime="2026-06-14 15:29:31.77476464 +0000 UTC m=+952.699446568" Jun 14 15:29:42.762732 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:29:42.762696 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dbdff6cd-4qq6l" Jun 14 15:33:41.318891 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:33:41.318866 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:33:41.321041 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:33:41.321020 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:38:41.351629 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:38:41.351601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:38:41.352334 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:38:41.352312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:41:42.387743 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.387707 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp"] Jun 14 15:41:42.390996 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.390979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.394083 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.394057 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jk8ps\"" Jun 14 15:41:42.407834 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.407809 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp"] Jun 14 15:41:42.440845 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.440822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ss7k\" (UniqueName: \"kubernetes.io/projected/2655edd5-78f7-4e55-99e7-7af3e4ace342-kube-api-access-9ss7k\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.440966 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.440874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2655edd5-78f7-4e55-99e7-7af3e4ace342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.542278 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.542237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ss7k\" (UniqueName: \"kubernetes.io/projected/2655edd5-78f7-4e55-99e7-7af3e4ace342-kube-api-access-9ss7k\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.542443 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.542290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2655edd5-78f7-4e55-99e7-7af3e4ace342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.542654 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.542637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2655edd5-78f7-4e55-99e7-7af3e4ace342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.551821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.551796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ss7k\" (UniqueName: \"kubernetes.io/projected/2655edd5-78f7-4e55-99e7-7af3e4ace342-kube-api-access-9ss7k\") pod \"kuadrant-operator-controller-manager-86878c769f-cvqwp\" (UID: \"2655edd5-78f7-4e55-99e7-7af3e4ace342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.700795 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.700701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:42.855817 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:42.855793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp"] Jun 14 15:41:42.857789 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:41:42.857753 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2655edd5_78f7_4e55_99e7_7af3e4ace342.slice/crio-442cb4fe403d5842599c6455815c4461d48efbfb41339a519a166904e0436e46 WatchSource:0}: Error finding container 442cb4fe403d5842599c6455815c4461d48efbfb41339a519a166904e0436e46: Status 404 returned error can't find the container with id 442cb4fe403d5842599c6455815c4461d48efbfb41339a519a166904e0436e46 Jun 14 15:41:43.128117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:43.128047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" event={"ID":"2655edd5-78f7-4e55-99e7-7af3e4ace342","Type":"ContainerStarted","Data":"64d220376fa56be34ba164313fe598d6a1cf3b66e499978aca898595703c630c"} Jun 14 15:41:43.128117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:43.128108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" event={"ID":"2655edd5-78f7-4e55-99e7-7af3e4ace342","Type":"ContainerStarted","Data":"442cb4fe403d5842599c6455815c4461d48efbfb41339a519a166904e0436e46"} Jun 14 15:41:43.128371 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:43.128223 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:41:43.156673 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:43.156618 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" podStartSLOduration=1.156603649 podStartE2EDuration="1.156603649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:41:43.155086622 +0000 UTC m=+1684.079768552" watchObservedRunningTime="2026-06-14 15:41:43.156603649 +0000 UTC m=+1684.081285578" Jun 14 15:41:54.135239 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:41:54.135204 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvqwp" Jun 14 15:43:41.388310 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:43:41.388284 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:43:41.389044 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:43:41.389027 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:48:41.424635 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:48:41.424607 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:48:41.427179 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:48:41.427076 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv5w2_5d76d205-e9e9-4161-b48a-aebb70401532/ovn-acl-logging/0.log" Jun 14 15:50:56.516242 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.516205 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg"] Jun 14 15:50:56.519835 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.519815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.534176 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.534153 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg"] Jun 14 15:50:56.637111 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.637073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-openshift-service-ca\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.637429 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.637403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpzcr\" (UniqueName: \"kubernetes.io/projected/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-kube-api-access-gpzcr\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.637845 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.637817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-maas-api-tls\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.738397 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.738362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-openshift-service-ca\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.738585 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.738433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpzcr\" (UniqueName: \"kubernetes.io/projected/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-kube-api-access-gpzcr\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.738585 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.738467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-maas-api-tls\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.739151 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.739125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-openshift-service-ca\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.741148 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.741121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-maas-api-tls\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.748891 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.748865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpzcr\" (UniqueName: \"kubernetes.io/projected/8d086ff2-2cb6-4083-b79e-842c9cfef9c5-kube-api-access-gpzcr\") pod \"maas-api-e2e-ait-f5630253-67d876f578-fldlg\" (UID: \"8d086ff2-2cb6-4083-b79e-842c9cfef9c5\") " pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.830670 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.830574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:50:56.979795 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.979768 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg"] Jun 14 15:50:56.982604 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:50:56.982576 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d086ff2_2cb6_4083_b79e_842c9cfef9c5.slice/crio-cb660674096ee55793a3331007dcb50101d22a077d24769afb303cf994973031 WatchSource:0}: Error finding container cb660674096ee55793a3331007dcb50101d22a077d24769afb303cf994973031: Status 404 returned error can't find the container with id cb660674096ee55793a3331007dcb50101d22a077d24769afb303cf994973031 Jun 14 15:50:56.983973 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:56.983951 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:50:57.811487 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:57.811455 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" containerID="040eba9eaedd997e5d490dc0a0ecb876ffa349d4ab6942aae146b51e9a1f6d2f" exitCode=1 Jun 14 15:50:57.811953 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:57.811499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerDied","Data":"040eba9eaedd997e5d490dc0a0ecb876ffa349d4ab6942aae146b51e9a1f6d2f"} Jun 14 15:50:57.811953 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:57.811560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerStarted","Data":"cb660674096ee55793a3331007dcb50101d22a077d24769afb303cf994973031"} Jun 14 15:50:57.811953 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:57.811834 2567 scope.go:117] "RemoveContainer" containerID="040eba9eaedd997e5d490dc0a0ecb876ffa349d4ab6942aae146b51e9a1f6d2f" Jun 14 15:50:58.817749 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:58.817711 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" exitCode=1 Jun 14 15:50:58.818185 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:58.817755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerDied","Data":"a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a"} Jun 14 15:50:58.818185 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:58.817815 2567 scope.go:117] "RemoveContainer" containerID="040eba9eaedd997e5d490dc0a0ecb876ffa349d4ab6942aae146b51e9a1f6d2f" Jun 14 15:50:58.818185 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:58.818013 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:50:58.818302 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:50:58.818222 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:50:59.823807 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:50:59.823784 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:50:59.824201 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:50:59.823960 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:01.830956 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:01.830922 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:01.831449 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:01.831418 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:51:01.831693 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:01.831667 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:06.831117 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:06.831089 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:06.831493 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:06.831417 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:51:06.831621 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:06.831602 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:09.790772 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.790739 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46"] Jun 14 15:51:09.795696 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.795677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:09.819236 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.819210 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46"] Jun 14 15:51:09.952030 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.951993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e60c698-d455-4872-ba73-124c48d5fd5c-openshift-service-ca\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:09.952198 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.952084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9n8\" (UniqueName: \"kubernetes.io/projected/8e60c698-d455-4872-ba73-124c48d5fd5c-kube-api-access-zp9n8\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:09.952198 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:09.952122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e60c698-d455-4872-ba73-124c48d5fd5c-maas-api-tls\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.052866 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.052770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9n8\" (UniqueName: \"kubernetes.io/projected/8e60c698-d455-4872-ba73-124c48d5fd5c-kube-api-access-zp9n8\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.052866 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.052812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e60c698-d455-4872-ba73-124c48d5fd5c-maas-api-tls\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.053087 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.052873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e60c698-d455-4872-ba73-124c48d5fd5c-openshift-service-ca\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.053587 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.053565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e60c698-d455-4872-ba73-124c48d5fd5c-openshift-service-ca\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.055327 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.055305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e60c698-d455-4872-ba73-124c48d5fd5c-maas-api-tls\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.062795 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.062774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9n8\" (UniqueName: \"kubernetes.io/projected/8e60c698-d455-4872-ba73-124c48d5fd5c-kube-api-access-zp9n8\") pod \"maas-api-e2e-ait-80e3d033-b45578996-ssx46\" (UID: \"8e60c698-d455-4872-ba73-124c48d5fd5c\") " pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.106629 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.106591 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:10.257096 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.257071 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46"] Jun 14 15:51:10.259192 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:51:10.259163 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e60c698_d455_4872_ba73_124c48d5fd5c.slice/crio-40532c5e25efe286b15e11e39accafc5e632ff4c8b1dbaf8a576bc5dae4a2d66 WatchSource:0}: Error finding container 40532c5e25efe286b15e11e39accafc5e632ff4c8b1dbaf8a576bc5dae4a2d66: Status 404 returned error can't find the container with id 40532c5e25efe286b15e11e39accafc5e632ff4c8b1dbaf8a576bc5dae4a2d66 Jun 14 15:51:10.880392 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.880363 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e60c698-d455-4872-ba73-124c48d5fd5c" containerID="18c0052d0ee9a39bf5ecf8bbbafe5790cb0467e8e5d70dfae890f5b7459dcc9b" exitCode=1 Jun 14 15:51:10.881244 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.880415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerDied","Data":"18c0052d0ee9a39bf5ecf8bbbafe5790cb0467e8e5d70dfae890f5b7459dcc9b"} Jun 14 15:51:10.881244 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.880452 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerStarted","Data":"40532c5e25efe286b15e11e39accafc5e632ff4c8b1dbaf8a576bc5dae4a2d66"} Jun 14 15:51:10.881244 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:10.880723 2567 scope.go:117] "RemoveContainer" containerID="18c0052d0ee9a39bf5ecf8bbbafe5790cb0467e8e5d70dfae890f5b7459dcc9b" Jun 14 15:51:11.887334 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:11.887252 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e60c698-d455-4872-ba73-124c48d5fd5c" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" exitCode=1 Jun 14 15:51:11.887334 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:11.887320 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerDied","Data":"d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc"} Jun 14 15:51:11.887774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:11.887364 2567 scope.go:117] "RemoveContainer" containerID="18c0052d0ee9a39bf5ecf8bbbafe5790cb0467e8e5d70dfae890f5b7459dcc9b" Jun 14 15:51:11.887774 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:11.887642 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:11.887842 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:11.887821 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:12.893944 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:12.893868 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:12.894309 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:12.894030 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:15.107201 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:15.107168 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:15.107593 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:15.107539 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:15.107720 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:15.107700 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:20.107171 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.107132 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:20.107586 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.107571 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:20.107773 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:20.107752 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:20.558501 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.558471 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:51:20.934152 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.934114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerStarted","Data":"fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a"} Jun 14 15:51:20.934341 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.934326 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:20.955270 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:20.955222 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podStartSLOduration=23.860461489 podStartE2EDuration="24.955204733s" totalImagesPullingTime="1.094743244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:50:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:51:20.953171025 +0000 UTC m=+2261.877852956" watchObservedRunningTime="2026-06-14 15:51:20.955204733 +0000 UTC m=+2261.879886662" Jun 14 15:51:21.940157 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:21.940117 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" exitCode=1 Jun 14 15:51:21.940664 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:21.940157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerDied","Data":"fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a"} Jun 14 15:51:21.940664 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:21.940220 2567 scope.go:117] "RemoveContainer" containerID="a28ee80d6975708fe26af80d3802aab861c6107cef3efd971e752ffeb7305b6a" Jun 14 15:51:21.940664 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:21.940500 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:21.940824 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:21.940763 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:22.946844 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:22.946815 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:22.947221 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:22.947008 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:26.831596 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:26.831555 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:26.831992 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:26.831914 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:26.832113 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:26.832094 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:33.559025 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:33.558993 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:34.001554 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:34.001505 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerStarted","Data":"038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5"} Jun 14 15:51:34.001747 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:34.001729 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:34.020630 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:34.020563 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podStartSLOduration=24.057924733 podStartE2EDuration="25.020546617s" totalImagesPullingTime="962.621884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:51:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:51:34.020229925 +0000 UTC m=+2274.944911854" watchObservedRunningTime="2026-06-14 15:51:34.020546617 +0000 UTC m=+2274.945228546" Jun 14 15:51:35.008033 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:35.007998 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e60c698-d455-4872-ba73-124c48d5fd5c" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" exitCode=1 Jun 14 15:51:35.008441 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:35.008080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerDied","Data":"038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5"} Jun 14 15:51:35.008441 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:35.008135 2567 scope.go:117] "RemoveContainer" containerID="d81275779845fd993f1ae59568a530d0e46057005cdaa455e7b513a1bc3618fc" Jun 14 15:51:35.008441 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:35.008286 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:51:35.008597 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:35.008555 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:36.015087 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:36.015061 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:51:36.015470 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:36.015228 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:36.455964 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:36.455878 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-545cdcc467-ghh84_a5bf38bd-d3dc-4cb8-b33e-542709ade38e/nginx/0.log" Jun 14 15:51:36.701637 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:36.701603 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lsxbv_00df141c-2168-4e21-8641-acc0785cfdca/manager/0.log" Jun 14 15:51:36.822034 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:36.822008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4h5r5_e3a633d6-5762-4c42-b346-90d1eb4a74d5/manager/0.log" Jun 14 15:51:36.956033 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:36.956005 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b885568cf-dhrxb_7123a639-04f7-47fb-93e9-9a2c90db2543/maas-api/0.log" Jun 14 15:51:37.066486 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.066453 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-80e3d033-b45578996-ssx46_8e60c698-d455-4872-ba73-124c48d5fd5c/maas-api/2.log" Jun 14 15:51:37.181906 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.181820 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-f5630253-67d876f578-fldlg_8d086ff2-2cb6-4083-b79e-842c9cfef9c5/maas-api/2.log" Jun 14 15:51:37.528727 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.528689 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dbdff6cd-4qq6l_a2c9925d-6cbc-4f0a-86eb-fec056204d04/manager/0.log" Jun 14 15:51:37.644623 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.644595 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7n8bz_d7993d60-fbf0-48d6-a4db-7720f52fe464/server/0.log" Jun 14 15:51:37.793008 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.792927 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4ljls_b4c9b029-335c-44db-849c-c9a229bf1dbb/manager/0.log" Jun 14 15:51:37.917848 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.917820 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-988f4c544-shr7h_0c5c5f65-2e2e-4229-a233-1eb3d12142c1/copy-manifests/0.log" Jun 14 15:51:37.926206 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:37.926168 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-988f4c544-shr7h_0c5c5f65-2e2e-4229-a233-1eb3d12142c1/manager/0.log" Jun 14 15:51:38.291797 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:38.291760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vblcx_3ee2a78b-f7e8-463f-b472-37bd2007b96e/postgres/0.log" Jun 14 15:51:39.836244 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:39.836217 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lcpzq_ff1d3e2b-37c2-4c53-ab31-7f188e711862/manager/0.log" Jun 14 15:51:40.107650 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:40.107552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:51:40.108037 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:40.108020 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:51:40.108254 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:40.108233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:40.188857 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:40.188817 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cvqwp_2655edd5-78f7-4e55-99e7-7af3e4ace342/manager/0.log" Jun 14 15:51:40.559226 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:40.559191 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:40.559435 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:40.559406 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:40.911348 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:40.911271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zlbzd_463cf404-6918-4965-9ccb-89c7c0a9bbb5/discovery/0.log" Jun 14 15:51:41.147659 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:41.147627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7576766bb9-npjxg_5dcd43b7-7be9-4d9c-a3a0-e49431ca8223/kube-auth-proxy/0.log" Jun 14 15:51:41.399958 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:41.399927 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9f8r9_286b282e-c166-4f11-a541-1a21be327fb4/payload-pre-processing/0.log" Jun 14 15:51:41.633248 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:41.633218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log" Jun 14 15:51:42.206208 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:42.206181 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb_c79cab84-19f9-43cf-b020-0728aa93ee13/storage-initializer/0.log" Jun 14 15:51:42.213867 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:42.213845 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-zgslb_c79cab84-19f9-43cf-b020-0728aa93ee13/main/0.log" Jun 14 15:51:50.222388 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:50.222352 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qwc5s_3b6d1a04-7c30-40ed-a03d-138acaf994c1/global-pull-secret-syncer/0.log" Jun 14 15:51:50.352671 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:50.352641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f2w5r_1f76af9f-f3a6-4b84-b942-91a3e27c0366/konnectivity-agent/0.log" Jun 14 15:51:50.446462 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:50.446434 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-194.ec2.internal_a64a0089d96df9e7686766c7f0343b5c/haproxy/0.log" Jun 14 15:51:52.558466 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:52.558433 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:53.098295 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:53.098260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerStarted","Data":"0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1"} Jun 14 15:51:53.098479 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:53.098462 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:53.558639 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:53.558605 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:51:53.559110 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:53.558840 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:51:54.105125 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:54.105084 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" containerID="0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1" exitCode=1 Jun 14 15:51:54.105296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:54.105171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" event={"ID":"8d086ff2-2cb6-4083-b79e-842c9cfef9c5","Type":"ContainerDied","Data":"0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1"} Jun 14 15:51:54.105296 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:54.105232 2567 scope.go:117] "RemoveContainer" containerID="fd6349eff5da8061338b26c8380c8368001ebca3d502300098258209c7dec90a" Jun 14 15:51:54.105478 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:54.105460 2567 scope.go:117] "RemoveContainer" containerID="0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1" Jun 14 15:51:54.105716 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:54.105699 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:54.477556 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:54.477502 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-rqgbq_c505f5cf-16aa-4863-b01f-b8a71b32c65b/sail-operator/0.log" Jun 14 15:51:55.112172 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:55.112145 2567 scope.go:117] "RemoveContainer" containerID="0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1" Jun 14 15:51:55.112594 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:55.112309 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:56.535929 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:56.535895 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lcpzq_ff1d3e2b-37c2-4c53-ab31-7f188e711862/manager/0.log" Jun 14 15:51:56.700799 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:56.700766 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cvqwp_2655edd5-78f7-4e55-99e7-7af3e4ace342/manager/0.log" Jun 14 15:51:56.830821 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:56.830737 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" Jun 14 15:51:56.831141 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:56.831128 2567 scope.go:117] "RemoveContainer" containerID="0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1" Jun 14 15:51:56.831332 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:51:56.831313 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:51:59.098925 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:59.098880 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-nrrcn_815133b2-5d7c-4c28-a0c8-9f1cb2bfcddc/cluster-monitoring-operator/0.log" Jun 14 15:51:59.285286 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:59.285237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bpswp_66a5fc66-e00f-45e5-80e6-285a57c11508/node-exporter/0.log" Jun 14 15:51:59.309772 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:59.309738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bpswp_66a5fc66-e00f-45e5-80e6-285a57c11508/kube-rbac-proxy/0.log" Jun 14 15:51:59.335006 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:51:59.334982 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bpswp_66a5fc66-e00f-45e5-80e6-285a57c11508/init-textfile/0.log" Jun 14 15:52:00.255775 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.255741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/thanos-query/0.log" Jun 14 15:52:00.279681 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.279659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/kube-rbac-proxy-web/0.log" Jun 14 15:52:00.306569 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.306543 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/kube-rbac-proxy/0.log" Jun 14 15:52:00.340824 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.340798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/prom-label-proxy/0.log" Jun 14 15:52:00.412584 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.412545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/kube-rbac-proxy-rules/0.log" Jun 14 15:52:00.472126 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:00.472099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-785dbb9494-8fjk9_7868c0af-0fea-4abb-8108-a0b1a5370092/kube-rbac-proxy-metrics/0.log" Jun 14 15:52:01.580669 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.580638 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7"] Jun 14 15:52:01.585439 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.585420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.588640 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.588622 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb4z5\"/\"kube-root-ca.crt\"" Jun 14 15:52:01.589845 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.589827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gb4z5\"/\"default-dockercfg-5l7cw\"" Jun 14 15:52:01.589904 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.589856 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb4z5\"/\"openshift-service-ca.crt\"" Jun 14 15:52:01.605651 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.605630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7"] Jun 14 15:52:01.622041 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.621977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-sys\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.622218 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.622197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-lib-modules\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.622299 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.622259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9dfb\" (UniqueName: \"kubernetes.io/projected/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-kube-api-access-b9dfb\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.622357 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.622328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-proc\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.622409 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.622391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-podres\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723667 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-lib-modules\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9dfb\" (UniqueName: \"kubernetes.io/projected/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-kube-api-access-b9dfb\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-proc\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-podres\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-sys\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-lib-modules\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.723850 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-proc\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.724137 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-sys\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.724137 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.723891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-podres\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.733345 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.733315 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9dfb\" (UniqueName: \"kubernetes.io/projected/05f36055-9ee1-4011-b1f8-bc9ecffe38bd-kube-api-access-b9dfb\") pod \"perf-node-gather-daemonset-zdpz7\" (UID: \"05f36055-9ee1-4011-b1f8-bc9ecffe38bd\") " pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:01.895633 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:01.895546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:02.041635 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:02.041485 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7"] Jun 14 15:52:02.043753 ip-10-0-141-194 kubenswrapper[2567]: W0614 15:52:02.043724 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05f36055_9ee1_4011_b1f8_bc9ecffe38bd.slice/crio-2baa52792cb0f05ff361b2cfe554794aae304c2c0ceb55a7a5957e70f61cc485 WatchSource:0}: Error finding container 2baa52792cb0f05ff361b2cfe554794aae304c2c0ceb55a7a5957e70f61cc485: Status 404 returned error can't find the container with id 2baa52792cb0f05ff361b2cfe554794aae304c2c0ceb55a7a5957e70f61cc485 Jun 14 15:52:02.146576 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:02.146501 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" event={"ID":"05f36055-9ee1-4011-b1f8-bc9ecffe38bd","Type":"ContainerStarted","Data":"83a9848daf70771b7221cedc3d3a0fb261cc6e3dddccfa65fc1cecc942399b3f"} Jun 14 15:52:02.146676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:02.146576 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" event={"ID":"05f36055-9ee1-4011-b1f8-bc9ecffe38bd","Type":"ContainerStarted","Data":"2baa52792cb0f05ff361b2cfe554794aae304c2c0ceb55a7a5957e70f61cc485"} Jun 14 15:52:02.146676 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:02.146609 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:02.174592 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:02.174546 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" podStartSLOduration=1.174513891 podStartE2EDuration="1.174513891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:52:02.171093026 +0000 UTC m=+2303.095774954" watchObservedRunningTime="2026-06-14 15:52:02.174513891 +0000 UTC m=+2303.099195819" Jun 14 15:52:04.821953 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:04.821919 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kq8gz_456ce9ab-423f-4141-88cb-280e5a1552d1/dns/0.log" Jun 14 15:52:04.853413 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:04.853391 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kq8gz_456ce9ab-423f-4141-88cb-280e5a1552d1/kube-rbac-proxy/0.log" Jun 14 15:52:04.935048 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:04.935015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tlm8j_e9acbe3e-4217-473d-b1cd-0c0c561f9c4a/dns-node-resolver/0.log" Jun 14 15:52:05.558366 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:05.558337 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:52:05.591361 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:05.591331 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghxxn_b0051ccc-776e-4005-b943-3e86b4f7a5d7/node-ca/0.log" Jun 14 15:52:06.168721 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:06.168678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerStarted","Data":"92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07"} Jun 14 15:52:06.169092 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:06.168904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:52:06.764290 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:06.764262 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zlbzd_463cf404-6918-4965-9ccb-89c7c0a9bbb5/discovery/0.log" Jun 14 15:52:06.809470 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:06.809436 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7576766bb9-npjxg_5dcd43b7-7be9-4d9c-a3a0-e49431ca8223/kube-auth-proxy/0.log" Jun 14 15:52:06.939112 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:06.939085 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9f8r9_286b282e-c166-4f11-a541-1a21be327fb4/payload-pre-processing/0.log" Jun 14 15:52:07.025142 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.025050 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log" Jun 14 15:52:07.175481 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.175452 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e60c698-d455-4872-ba73-124c48d5fd5c" containerID="92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07" exitCode=1 Jun 14 15:52:07.175954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.175552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" event={"ID":"8e60c698-d455-4872-ba73-124c48d5fd5c","Type":"ContainerDied","Data":"92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07"} Jun 14 15:52:07.175954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.175608 2567 scope.go:117] "RemoveContainer" containerID="038feef65edc369217b70769fd19f822cfb7647316d8f3cfc34538056ccb6eb5" Jun 14 15:52:07.175954 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.175861 2567 scope.go:117] "RemoveContainer" containerID="92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07" Jun 14 15:52:07.176088 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:52:07.176053 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:52:07.657211 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:07.657186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pkxv_5e054323-a283-4a2e-8205-ef2f9ee6f2e1/serve-healthcheck-canary/0.log" Jun 14 15:52:08.161552 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.161506 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gb4z5/perf-node-gather-daemonset-zdpz7" Jun 14 15:52:08.182832 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.182799 2567 scope.go:117] "RemoveContainer" containerID="92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07" Jun 14 15:52:08.183190 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:52:08.182985 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:52:08.246888 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.246856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-fjjd8_f1fab5de-b072-4b75-81b0-cc04201d15bc/insights-operator/0.log" Jun 14 15:52:08.247609 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.247586 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-fjjd8_f1fab5de-b072-4b75-81b0-cc04201d15bc/insights-operator/1.log" Jun 14 15:52:08.417950 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.417869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2rb9_f56a3fb5-8573-4e81-8d56-ba90d9075c47/kube-rbac-proxy/0.log" Jun 14 15:52:08.442571 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.442544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2rb9_f56a3fb5-8573-4e81-8d56-ba90d9075c47/exporter/0.log" Jun 14 15:52:08.465350 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:08.465322 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2rb9_f56a3fb5-8573-4e81-8d56-ba90d9075c47/extractor/0.log" Jun 14 15:52:10.107861 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:10.107826 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" Jun 14 15:52:10.108240 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:10.108198 2567 scope.go:117] "RemoveContainer" containerID="92ffbd6e39343f33a3d75e51ea859785953ea0be13eab83417988a94a2aa5f07" Jun 14 15:52:10.108372 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:52:10.108354 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-80e3d033-b45578996-ssx46_opendatahub(8e60c698-d455-4872-ba73-124c48d5fd5c)\"" pod="opendatahub/maas-api-e2e-ait-80e3d033-b45578996-ssx46" podUID="8e60c698-d455-4872-ba73-124c48d5fd5c" Jun 14 15:52:10.894095 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:10.894069 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-545cdcc467-ghh84_a5bf38bd-d3dc-4cb8-b33e-542709ade38e/nginx/0.log" Jun 14 15:52:10.949978 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:10.949942 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lsxbv_00df141c-2168-4e21-8641-acc0785cfdca/manager/0.log" Jun 14 15:52:11.088982 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.088903 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4h5r5_e3a633d6-5762-4c42-b346-90d1eb4a74d5/manager/0.log" Jun 14 15:52:11.137532 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.137491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b885568cf-dhrxb_7123a639-04f7-47fb-93e9-9a2c90db2543/maas-api/0.log" Jun 14 15:52:11.161686 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.161659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-80e3d033-b45578996-ssx46_8e60c698-d455-4872-ba73-124c48d5fd5c/maas-api/3.log" Jun 14 15:52:11.161848 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.161666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-80e3d033-b45578996-ssx46_8e60c698-d455-4872-ba73-124c48d5fd5c/maas-api/3.log" Jun 14 15:52:11.183249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.183220 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-f5630253-67d876f578-fldlg_8d086ff2-2cb6-4083-b79e-842c9cfef9c5/maas-api/3.log" Jun 14 15:52:11.183249 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.183241 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-f5630253-67d876f578-fldlg_8d086ff2-2cb6-4083-b79e-842c9cfef9c5/maas-api/3.log" Jun 14 15:52:11.363793 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.363706 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dbdff6cd-4qq6l_a2c9925d-6cbc-4f0a-86eb-fec056204d04/manager/0.log" Jun 14 15:52:11.387719 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.387697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-7n8bz_d7993d60-fbf0-48d6-a4db-7720f52fe464/server/0.log" Jun 14 15:52:11.475992 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.475972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4ljls_b4c9b029-335c-44db-849c-c9a229bf1dbb/manager/0.log" Jun 14 15:52:11.508477 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.508432 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-988f4c544-shr7h_0c5c5f65-2e2e-4229-a233-1eb3d12142c1/manager/0.log" Jun 14 15:52:11.530081 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.530061 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-988f4c544-shr7h_0c5c5f65-2e2e-4229-a233-1eb3d12142c1/copy-manifests/0.log" Jun 14 15:52:11.815013 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:11.814974 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vblcx_3ee2a78b-f7e8-463f-b472-37bd2007b96e/postgres/0.log" Jun 14 15:52:12.558456 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:12.558421 2567 scope.go:117] "RemoveContainer" containerID="0a0f60fb9f175b48394207d33f7bb72b6780c7eb3ff77db99b67795c0ba3e0f1" Jun 14 15:52:12.558863 ip-10-0-141-194 kubenswrapper[2567]: E0614 15:52:12.558634 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-f5630253-67d876f578-fldlg_opendatahub(8d086ff2-2cb6-4083-b79e-842c9cfef9c5)\"" pod="opendatahub/maas-api-e2e-ait-f5630253-67d876f578-fldlg" podUID="8d086ff2-2cb6-4083-b79e-842c9cfef9c5" Jun 14 15:52:15.373599 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:15.373570 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zlbzd_463cf404-6918-4965-9ccb-89c7c0a9bbb5/discovery/0.log" Jun 14 15:52:15.401349 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:15.401321 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7576766bb9-npjxg_5dcd43b7-7be9-4d9c-a3a0-e49431ca8223/kube-auth-proxy/0.log" Jun 14 15:52:15.515286 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:15.515250 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9f8r9_286b282e-c166-4f11-a541-1a21be327fb4/payload-pre-processing/0.log" Jun 14 15:52:15.580243 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:15.580212 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log" Jun 14 15:52:16.782770 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:16.782725 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zlbzd_463cf404-6918-4965-9ccb-89c7c0a9bbb5/discovery/0.log" Jun 14 15:52:16.815030 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:16.815004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7576766bb9-npjxg_5dcd43b7-7be9-4d9c-a3a0-e49431ca8223/kube-auth-proxy/0.log" Jun 14 15:52:16.929730 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:16.929641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9f8r9_286b282e-c166-4f11-a541-1a21be327fb4/payload-pre-processing/0.log" Jun 14 15:52:16.996177 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:16.996148 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log" Jun 14 15:52:18.808261 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:18.808220 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zlbzd_463cf404-6918-4965-9ccb-89c7c0a9bbb5/discovery/0.log" Jun 14 15:52:18.837971 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:18.837943 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7576766bb9-npjxg_5dcd43b7-7be9-4d9c-a3a0-e49431ca8223/kube-auth-proxy/0.log" Jun 14 15:52:18.952328 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:18.952301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9f8r9_286b282e-c166-4f11-a541-1a21be327fb4/payload-pre-processing/0.log" Jun 14 15:52:19.016740 ip-10-0-141-194 kubenswrapper[2567]: I0614 15:52:19.016711 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68bd9d74dd-wf2wx_e7385fd9-6170-4eb3-86af-0a57f8b626c7/router/0.log"