Jun 11 18:25:30.215953 ip-10-0-143-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 18:25:30.215960 ip-10-0-143-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 18:25:30.215967 ip-10-0-143-116 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 18:25:30.216192 ip-10-0-143-116 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 18:25:40.401810 ip-10-0-143-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 18:25:40.401829 ip-10-0-143-116 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 852e9c1e9d034c37b0b355dd74a91426 -- Jun 11 18:28:09.067778 ip-10-0-143-116 systemd[1]: Starting Kubernetes Kubelet... Jun 11 18:28:09.520136 ip-10-0-143-116 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:09.520136 ip-10-0-143-116 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 18:28:09.520136 ip-10-0-143-116 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:09.520136 ip-10-0-143-116 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 18:28:09.520136 ip-10-0-143-116 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:09.523037 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.522892 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 18:28:09.527577 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527560 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527578 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527582 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527586 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527589 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527592 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527595 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527598 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527606 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527609 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527611 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527614 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527617 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527620 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527622 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.527619 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527625 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527630 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527634 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527637 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527640 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527642 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527645 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527648 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527650 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527653 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527655 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527658 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527661 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527663 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527665 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527668 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527671 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527673 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527676 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527679 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.527969 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527682 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527685 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527687 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527690 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527692 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527695 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527697 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527701 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527704 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527708 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527711 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527714 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527717 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527720 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527725 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527728 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527730 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527733 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527736 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.528439 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527739 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527741 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527744 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527746 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527749 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527751 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527754 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527758 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527762 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527764 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527768 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527771 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527774 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527777 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527780 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527783 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527786 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527789 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527792 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.528929 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527794 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527797 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527800 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527802 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527805 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527808 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527810 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527813 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527816 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527818 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527821 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527823 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527826 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527830 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527833 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527836 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527838 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527841 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527843 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527846 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.529500 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527849 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527851 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527854 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527856 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527859 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.527861 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528597 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528605 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528608 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528611 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528614 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528617 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528620 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528623 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528625 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528628 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528631 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528634 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528637 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528639 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.530261 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528642 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528645 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528647 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528650 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528652 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528655 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528658 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528660 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528664 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528668 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528672 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528674 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528677 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528681 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528684 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528687 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528690 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528693 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528696 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.530910 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528699 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528702 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528705 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528708 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528712 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528715 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528718 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528721 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528724 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528727 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528729 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528732 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528735 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528738 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528740 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528743 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528746 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528748 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528751 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528753 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.531384 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528756 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528758 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528761 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528763 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528766 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528768 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528771 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528773 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528776 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528779 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528782 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528784 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528787 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528789 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528792 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528795 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528798 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528801 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528803 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528806 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.531892 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528808 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528811 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528813 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528816 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528818 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528820 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528823 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528825 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528828 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528831 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528834 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528836 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528841 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528844 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528847 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528850 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528853 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528856 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528859 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.532409 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528861 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528864 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528866 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528869 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528871 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528874 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.528877 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529623 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529642 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529647 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529652 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529660 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529665 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529669 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529673 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529677 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529682 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529686 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529691 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529696 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.532899 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529705 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529710 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529714 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529718 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529723 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529728 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529732 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529737 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529741 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529745 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529750 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529754 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529759 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529768 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529773 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529779 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529787 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529793 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529797 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.533372 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529802 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529808 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529812 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529817 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529821 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529831 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529836 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529840 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529844 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529849 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529853 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529858 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529862 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529867 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529871 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529875 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529880 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529884 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529893 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529897 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.533898 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529901 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529906 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529910 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529914 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529921 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529927 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529932 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529936 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529941 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529946 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529955 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529960 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529965 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529970 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529976 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529980 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529985 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529992 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.529997 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530002 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.534376 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530006 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530011 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530020 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530025 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530029 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530033 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530037 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530041 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530045 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530050 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530054 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530059 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530063 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530067 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530071 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530080 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530087 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530092 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530097 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.534883 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530101 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530110 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530116 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530121 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530125 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530129 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530134 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.530139 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530303 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530439 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530449 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530454 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530459 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530462 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530482 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530487 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530491 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530494 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530497 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530500 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530504 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530507 2568 flags.go:64] FLAG: --cgroup-root="" Jun 11 18:28:09.535401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530510 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530513 2568 flags.go:64] FLAG: --client-ca-file="" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530516 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530519 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530523 2568 flags.go:64] FLAG: --cluster-domain="" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530526 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530529 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530532 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530536 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530539 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530542 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530546 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530549 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530552 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530555 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530558 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530562 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530566 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530571 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530574 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530577 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530580 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530583 2568 flags.go:64] FLAG: --enable-server="true" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530586 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530591 2568 flags.go:64] FLAG: --event-burst="100" Jun 11 18:28:09.535959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530594 2568 flags.go:64] FLAG: --event-qps="50" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530597 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530601 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530603 2568 flags.go:64] FLAG: --eviction-hard="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530615 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530618 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530621 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530624 2568 flags.go:64] FLAG: --eviction-soft="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530627 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530630 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530633 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530636 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530639 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530642 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530645 2568 flags.go:64] FLAG: --feature-gates="" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530648 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530651 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530655 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530658 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530661 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530664 2568 flags.go:64] FLAG: --help="false" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530667 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530670 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530673 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 18:28:09.536675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530677 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530680 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530684 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530687 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530690 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530693 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530696 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530698 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530702 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530704 2568 flags.go:64] FLAG: --kube-reserved="" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530707 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530710 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530713 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530716 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530719 2568 flags.go:64] FLAG: --lock-file="" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530721 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530724 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530727 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530733 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530736 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530740 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530742 2568 flags.go:64] FLAG: --logging-format="text" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530745 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530749 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 18:28:09.537289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530751 2568 flags.go:64] FLAG: --manifest-url="" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530754 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530759 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530762 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530767 2568 flags.go:64] FLAG: --max-pods="110" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530770 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530773 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530776 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530779 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530782 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530785 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530789 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530797 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530800 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530803 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530806 2568 flags.go:64] FLAG: --pod-cidr="" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530809 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530815 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530818 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530821 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530824 2568 flags.go:64] FLAG: --port="10250" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530827 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530830 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08fe7a4fb9cc77ea3" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530833 2568 flags.go:64] FLAG: --qos-reserved="" Jun 11 18:28:09.537916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530837 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530839 2568 flags.go:64] FLAG: --register-node="true" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530842 2568 flags.go:64] FLAG: --register-with-taints="" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530846 2568 flags.go:64] FLAG: --registry-burst="10" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530849 2568 flags.go:64] FLAG: --registry-qps="5" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530852 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530855 2568 flags.go:64] FLAG: --reserved-memory="" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530859 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530862 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530865 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530868 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530871 2568 flags.go:64] FLAG: --runonce="false" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530874 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530877 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530880 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530882 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530886 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530889 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530892 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530896 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530899 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530902 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530905 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530908 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530911 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 18:28:09.538540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530914 2568 flags.go:64] FLAG: --system-cgroups="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530917 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530924 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530926 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530929 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530934 2568 flags.go:64] FLAG: --tls-min-version="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530937 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530940 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530943 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530946 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530949 2568 flags.go:64] FLAG: --v="2" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530953 2568 flags.go:64] FLAG: --version="false" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530957 2568 flags.go:64] FLAG: --vmodule="" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530962 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.530965 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531082 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531086 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531089 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531092 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531095 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531098 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531101 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531105 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.539179 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531111 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531113 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531116 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531121 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531124 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531127 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531130 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531133 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531135 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531138 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531140 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531144 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531147 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531149 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531152 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531155 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531157 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531160 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531162 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531165 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.539754 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531168 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531171 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531173 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531176 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531179 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531182 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531184 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531187 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531190 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531192 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531195 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531197 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531203 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531206 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531210 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531216 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531219 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531221 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531224 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.540248 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531226 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531229 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531232 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531234 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531239 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531242 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531245 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531248 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531251 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531255 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531257 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531260 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531262 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531265 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531268 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531271 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531273 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531276 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531279 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.540739 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531282 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531285 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531287 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531290 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531293 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531295 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531299 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531301 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531304 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531308 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531310 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531313 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531316 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531318 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531322 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531326 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531329 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531332 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531335 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531337 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.541208 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531339 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531342 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531345 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531347 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531350 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531352 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531355 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531357 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531360 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531362 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531365 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531368 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.531371 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.532138 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.538754 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 18:28:09.541703 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.538768 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.538788 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.538794 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538848 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538852 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538856 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538859 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538864 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538868 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538871 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538875 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538878 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538881 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538884 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538886 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538889 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538892 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538894 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538897 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.542127 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538900 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538902 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538905 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538907 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538910 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538912 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538915 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538918 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538921 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538924 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538927 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538929 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538932 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538935 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538938 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538941 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538943 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538946 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538949 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538951 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.542609 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538954 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538957 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538959 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538962 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538964 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538967 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538970 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538973 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538975 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538978 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538981 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538983 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538986 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538988 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538992 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538995 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.538999 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539001 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539004 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539007 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.543094 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539009 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539012 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539015 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539018 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539020 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539024 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539027 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539029 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539032 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539035 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539038 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539040 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539044 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539047 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539050 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539052 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539055 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539057 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539060 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.543598 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539063 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539065 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539068 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539070 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539073 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539075 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539078 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539081 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539083 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539086 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539089 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539091 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539094 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539096 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539099 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539102 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539106 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539108 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539112 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539114 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.544056 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539117 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539120 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539122 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539125 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.539130 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539240 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539246 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539249 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539252 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539255 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539258 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539261 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539265 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539269 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539273 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:09.544777 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539275 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539278 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539281 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539284 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539287 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539290 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539293 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539295 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539298 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539301 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539304 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539306 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539309 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539311 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539315 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539317 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539321 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539323 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539326 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539328 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:09.545148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539331 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539333 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539336 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539339 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539341 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539345 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539348 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539351 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539354 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539357 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539360 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539363 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539366 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539369 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539372 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539374 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539377 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539380 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539382 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539385 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:09.545637 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539387 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539390 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539392 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539395 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539398 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539400 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539403 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539406 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539409 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539412 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539415 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539417 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539420 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539423 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539425 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539428 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539431 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539435 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539437 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539440 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:09.546120 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539442 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539445 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539448 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539451 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539454 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539456 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539459 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539461 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539478 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539482 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539485 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539488 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539490 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539493 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539496 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539498 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539501 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539504 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539506 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539509 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:09.546638 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539513 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539516 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539519 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539522 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539524 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539527 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539530 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539532 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:09.539535 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.539540 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.539654 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.541708 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.543339 2568 server.go:1019] "Starting client certificate rotation" Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.543438 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:28:09.547124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.543481 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:28:09.547500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.546373 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:28:09.548460 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.548446 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:28:09.557673 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.557654 2568 log.go:25] "Validated CRI v1 runtime API" Jun 11 18:28:09.561526 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.561502 2568 log.go:25] "Validated CRI v1 image API" Jun 11 18:28:09.562322 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.562306 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 18:28:09.564959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.564940 2568 fs.go:135] Filesystem UUIDs: map[242e91bd-4b16-4856-be4f-d9f7b8116bdd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc1514b4-58c0-4383-83c2-a05bf74e17b1:/dev/nvme0n1p3] Jun 11 18:28:09.565007 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.564960 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 18:28:09.570122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.570017 2568 manager.go:216] Machine: {Timestamp:2026-06-11 18:28:09.569544786 +0000 UTC m=+0.365701934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099211 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279bc08cee52016db0d1870991680a SystemUUID:ec279bc0-8cee-5201-6db0-d1870991680a BootID:852e9c1e-9d03-4c37-b0b3-55dd74a91426 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:66:7f:99:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:66:7f:99:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:c8:98:4c:44:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 18:28:09.570122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.570121 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 18:28:09.570236 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.570225 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 18:28:09.573955 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.573909 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 18:28:09.574095 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.573955 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 18:28:09.574693 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.574683 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 18:28:09.574734 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.574695 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 18:28:09.574734 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.574703 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:28:09.574734 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.574714 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:28:09.576137 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.576127 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 18:28:09.576701 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.576684 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:28:09.579198 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579186 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:28:09.579312 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579302 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 18:28:09.579362 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579333 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 11 18:28:09.579362 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579346 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 18:28:09.579442 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579370 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 18:28:09.579442 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579380 2568 kubelet.go:398] "Adding apiserver pod source" Jun 11 18:28:09.579442 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579389 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 18:28:09.579793 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579781 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:28:09.579836 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.579800 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:28:09.582257 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.582236 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 18:28:09.583716 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583704 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 18:28:09.583754 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583733 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 18:28:09.583891 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583882 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 18:28:09.583921 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583899 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 18:28:09.583921 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583905 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 18:28:09.583921 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583910 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 18:28:09.583921 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583919 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 18:28:09.584026 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.583925 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 18:28:09.584364 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584356 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 18:28:09.584396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584365 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 18:28:09.584396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584373 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 18:28:09.584396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584378 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 18:28:09.584396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584390 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 18:28:09.584515 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.584398 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 18:28:09.586081 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.586069 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 18:28:09.586081 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.586081 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 18:28:09.589279 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.589265 2568 server.go:1268] "Started kubelet" Jun 11 18:28:09.589448 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.589378 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 18:28:09.589518 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.589438 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 18:28:09.589577 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.589520 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 18:28:09.590174 ip-10-0-143-116 systemd[1]: Started Kubernetes Kubelet. Jun 11 18:28:09.590569 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.590496 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 18:28:09.590569 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.590525 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 18:28:09.590728 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.590644 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 18:28:09.591374 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.591359 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 18:28:09.596155 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.596134 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 11 18:28:09.597203 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.597177 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 18:28:09.599825 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.599809 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b6bc4" Jun 11 18:28:09.601499 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.601463 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 18:28:09.601606 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.601481 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 18:28:09.601758 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.601739 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:09.602289 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.601176 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-116.ec2.internal.18b81a3a210213a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-116.ec2.internal,UID:ip-10-0-143-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-116.ec2.internal,},FirstTimestamp:2026-06-11 18:28:09.589240744 +0000 UTC m=+0.385397872,LastTimestamp:2026-06-11 18:28:09.589240744 +0000 UTC m=+0.385397872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-116.ec2.internal,}" Jun 11 18:28:09.602395 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602325 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 18:28:09.602395 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602352 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 18:28:09.602514 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602447 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 18:28:09.602666 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602644 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 18:28:09.602666 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602663 2568 factory.go:55] Registering systemd factory Jun 11 18:28:09.602666 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602670 2568 factory.go:223] Registration of the systemd container factory successfully Jun 11 18:28:09.602868 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602719 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 11 18:28:09.602868 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602730 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 11 18:28:09.602964 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602956 2568 factory.go:153] Registering CRI-O factory Jun 11 18:28:09.603015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602968 2568 factory.go:223] Registration of the crio container factory successfully Jun 11 18:28:09.603015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.602992 2568 factory.go:103] Registering Raw factory Jun 11 18:28:09.603015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.603005 2568 manager.go:1196] Started watching for new ooms in manager Jun 11 18:28:09.603506 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.603490 2568 manager.go:349] Starting recovery of all containers Jun 11 18:28:09.606744 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.606716 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 18:28:09.606857 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.606837 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 18:28:09.608058 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.608034 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b6bc4" Jun 11 18:28:09.614058 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.614039 2568 manager.go:354] Recovery completed Jun 11 18:28:09.618070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.618056 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.619873 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.619857 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.619937 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.619890 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.619937 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.619906 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.620433 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.620421 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 18:28:09.620433 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.620431 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 18:28:09.620548 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.620437 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.620548 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.620446 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:28:09.621497 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.621485 2568 policy_none.go:49] "None policy: Start" Jun 11 18:28:09.621550 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.621499 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 18:28:09.621550 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.621510 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 18:28:09.622193 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.622116 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-116.ec2.internal.18b81a3a22d57d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-116.ec2.internal,UID:ip-10-0-143-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-116.ec2.internal,},FirstTimestamp:2026-06-11 18:28:09.619873139 +0000 UTC m=+0.416030269,LastTimestamp:2026-06-11 18:28:09.619873139 +0000 UTC m=+0.416030269,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-116.ec2.internal,}" Jun 11 18:28:09.622273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.622258 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.622323 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.622294 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.622323 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.622321 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.622509 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.622496 2568 policy_none.go:47] "Start" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.659940 2568 manager.go:337] "Starting Device Plugin manager" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.660146 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660158 2568 server.go:87] "Starting device plugin registration server" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660363 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660372 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660489 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660575 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.660584 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.661162 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.661208 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.665001 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.666110 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.666145 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.666165 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 18:28:09.667247 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.666200 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 18:28:09.668528 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.668502 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:09.761179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.761151 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.762124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.762103 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.762229 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.762136 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.762229 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.762147 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.762229 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.762170 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.766998 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.766981 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal"] Jun 11 18:28:09.767052 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.767044 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.767831 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.767815 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.767898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.767841 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.767898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.767852 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.769024 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.769011 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.769195 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.769179 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.769258 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.769216 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.769364 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.769351 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.769395 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.769371 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-116.ec2.internal\": node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:09.770358 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770311 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.770358 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770335 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.770358 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770349 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.770560 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770378 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.770560 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770398 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.770560 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.770408 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.771555 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.771542 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.771600 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.771572 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:09.772354 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.772331 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:09.772443 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.772358 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:09.772443 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.772376 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:09.784487 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.784447 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:09.790045 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.790031 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-116.ec2.internal\" not found" node="ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.794445 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.794431 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-116.ec2.internal\" not found" node="ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.884541 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.884502 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:09.904358 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.904334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.904515 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.904362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.904515 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:09.904381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81c97266164387c531fda220849e753b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-116.ec2.internal\" (UID: \"81c97266164387c531fda220849e753b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:09.985125 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:09.985073 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.005532 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.005631 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81c97266164387c531fda220849e753b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-116.ec2.internal\" (UID: \"81c97266164387c531fda220849e753b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.005631 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.005631 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.005744 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92efee55cff1223126921915ef1002db-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal\" (UID: \"92efee55cff1223126921915ef1002db\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.005744 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.005625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81c97266164387c531fda220849e753b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-116.ec2.internal\" (UID: \"81c97266164387c531fda220849e753b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.085989 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.085942 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.092107 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.092086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.098174 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.098152 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:10.186893 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.186852 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.287484 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.287419 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.387975 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.387893 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.442122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.442094 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:10.488219 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.488177 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.542697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.542670 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 18:28:10.543170 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.542826 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:28:10.543170 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.542880 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:28:10.589184 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.589155 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.613113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.613060 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 18:23:09 +0000 UTC" deadline="2028-03-25 10:30:53.399303198 +0000 UTC" Jun 11 18:28:10.613113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.613103 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15664h2m42.786205244s" Jun 11 18:28:10.682855 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:10.682811 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92efee55cff1223126921915ef1002db.slice/crio-c03304df84452fb9dbbfed92c2358215d149129690ac9cceb7ec775878c43193 WatchSource:0}: Error finding container c03304df84452fb9dbbfed92c2358215d149129690ac9cceb7ec775878c43193: Status 404 returned error can't find the container with id c03304df84452fb9dbbfed92c2358215d149129690ac9cceb7ec775878c43193 Jun 11 18:28:10.683245 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:10.683220 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c97266164387c531fda220849e753b.slice/crio-823c786ea382c718c373c37bcec194e81253d7451bc78b33e8a641b1e1f8f522 WatchSource:0}: Error finding container 823c786ea382c718c373c37bcec194e81253d7451bc78b33e8a641b1e1f8f522: Status 404 returned error can't find the container with id 823c786ea382c718c373c37bcec194e81253d7451bc78b33e8a641b1e1f8f522 Jun 11 18:28:10.688218 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.688203 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:28:10.689871 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.689853 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.737628 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:10.737593 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:10.790916 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.790893 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.891535 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.891489 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:10.992007 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:10.991924 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-116.ec2.internal\" not found" Jun 11 18:28:11.024100 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.024071 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:11.102134 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.102103 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" Jun 11 18:28:11.114818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.114656 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:28:11.121701 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.121404 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" Jun 11 18:28:11.132454 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.132397 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:28:11.580450 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.580411 2568 apiserver.go:52] "Watching apiserver" Jun 11 18:28:11.587827 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.587797 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 18:28:11.590028 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.589996 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-6mjc2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal","openshift-multus/multus-ms4tc","openshift-image-registry/node-ca-xwdph","openshift-multus/multus-additional-cni-plugins-gnvx5","openshift-multus/network-metrics-daemon-2pf29","openshift-network-diagnostics/network-check-target-rtl68","openshift-network-operator/iptables-alerter-zzs2q","openshift-ovn-kubernetes/ovnkube-node-zp8xt","kube-system/global-pull-secret-syncer-b2w26","kube-system/konnectivity-agent-knjm7","kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r","openshift-cluster-node-tuning-operator/tuned-d78kq"] Jun 11 18:28:11.591623 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.591595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:11.591741 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.591697 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:11.592918 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.592895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.594583 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.594561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.595308 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.595286 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 18:28:11.595308 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.595302 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8855z\"" Jun 11 18:28:11.595443 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.595292 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.595739 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.595716 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.595982 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.595965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.596979 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.596960 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 18:28:11.597070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.597036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xnbw2\"" Jun 11 18:28:11.597070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.597050 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 18:28:11.597263 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.597245 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.597502 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.597485 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.597597 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.597489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.598348 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.598331 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.598435 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.598351 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.598435 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.598379 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9p2lk\"" Jun 11 18:28:11.598570 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.598459 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 18:28:11.599147 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.599100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.599263 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.599182 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:11.599895 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.599876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 18:28:11.599895 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.599889 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 18:28:11.600034 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.599914 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cz6x6\"" Jun 11 18:28:11.600606 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.600588 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.601823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.601802 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 18:28:11.602230 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.602214 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.603110 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.602936 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 18:28:11.603110 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.602946 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 18:28:11.603689 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603488 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 18:28:11.603689 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603538 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.603689 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603498 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.603689 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603622 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f294x\"" Jun 11 18:28:11.603919 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.604003 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.603859 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 18:28:11.604893 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.604874 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.605038 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.605016 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-649f5\"" Jun 11 18:28:11.605129 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.605070 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.605737 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.605716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.605891 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.605818 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:11.606206 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.606183 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.606293 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.606236 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nlxbl\"" Jun 11 18:28:11.606459 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.606444 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.610035 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.609997 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.610943 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.610590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.612776 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.612756 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 18:28:11.612875 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.612797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrbfz\"" Jun 11 18:28:11.612946 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.612930 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 18:28:11.613015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.613005 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 18:28:11.613070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.613009 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:11.613119 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.613074 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4vgsk\"" Jun 11 18:28:11.613352 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.613336 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:11.615368 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-lib-modules\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.615486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.615486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64d37b91-8e59-46cf-a224-2b7ae49175ac-hosts-file\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.615486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615436 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-kubelet\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.615486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-sys-fs\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615502 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b11f73-8ed0-4dda-9f78-44277270153d-serviceca\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4snjs\" (UniqueName: \"kubernetes.io/projected/64d37b91-8e59-46cf-a224-2b7ae49175ac-kube-api-access-4snjs\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-run\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-tuned\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjv7\" (UniqueName: \"kubernetes.io/projected/e05fa631-9ece-4219-bf41-844420df3e6c-kube-api-access-5hjv7\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615659 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-netns\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.615690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-var-lib-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ztg\" (UniqueName: \"kubernetes.io/projected/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kube-api-access-f2ztg\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-hostroot\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-systemd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-node-log\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-config\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-conf\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-tmp\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovn-node-metrics-cert\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615924 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-script-lib\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-netns\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.615991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-multus\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-log-socket\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-bin\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-etc-kubernetes\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-var-lib-kubelet\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-os-release\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-etc-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616185 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-env-overrides\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-cnibin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616280 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-os-release\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-multus-certs\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-kubernetes\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.616500 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-system-cni-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-netd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-device-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-socket-dir-parent\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3b11f73-8ed0-4dda-9f78-44277270153d-host\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-multus-daemon-config\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-systemd\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-cnibin\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-registration-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z766k\" (UniqueName: \"kubernetes.io/projected/a3b11f73-8ed0-4dda-9f78-44277270153d-kube-api-access-z766k\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-bin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-conf-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617273 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprr8\" (UniqueName: \"kubernetes.io/projected/a58d6039-360c-47a3-820e-00e92dc94330-kube-api-access-fprr8\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.616972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-systemd-units\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-host\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617039 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-kubelet\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-socket-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-k8s-cni-cncf-io\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617161 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-modprobe-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-sys\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617204 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57dq\" (UniqueName: \"kubernetes.io/projected/b987acf2-53b4-47aa-aea3-373b50b4c913-kube-api-access-z57dq\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysconfig\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617277 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22sqm\" (UniqueName: \"kubernetes.io/projected/fb3974e2-2083-4164-97a4-c80a654c41f1-kube-api-access-22sqm\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-slash\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-ovn\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.617915 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vcd\" (UniqueName: \"kubernetes.io/projected/1ba5358e-4daf-4103-b55c-60c7ec4bf022-kube-api-access-g4vcd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.618627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-system-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.618627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-cni-binary-copy\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.618627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.617516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d37b91-8e59-46cf-a224-2b7ae49175ac-tmp-dir\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.638719 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.638694 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmkxt" Jun 11 18:28:11.646530 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.646510 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmkxt" Jun 11 18:28:11.671458 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.671406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" event={"ID":"81c97266164387c531fda220849e753b","Type":"ContainerStarted","Data":"823c786ea382c718c373c37bcec194e81253d7451bc78b33e8a641b1e1f8f522"} Jun 11 18:28:11.672762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.672726 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" event={"ID":"92efee55cff1223126921915ef1002db","Type":"ContainerStarted","Data":"c03304df84452fb9dbbfed92c2358215d149129690ac9cceb7ec775878c43193"} Jun 11 18:28:11.703105 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.703069 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 18:28:11.717894 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.717869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-conf\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.717894 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.717896 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-tmp\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.717914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovn-node-metrics-cert\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.717963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-script-lib\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.717998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-netns\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718053 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-multus\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-log-socket\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718098 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-conf\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-bin\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-multus\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-bin\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718190 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-etc-kubernetes\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-var-lib-kubelet\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-os-release\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-etc-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718280 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-log-socket\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-var-lib-kubelet\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-env-overrides\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8snt\" (UniqueName: \"kubernetes.io/projected/5aa00645-96d5-480f-b2fd-8690d11e7580-kube-api-access-g8snt\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-cnibin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718403 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-os-release\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718430 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-multus-certs\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.718529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718495 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-kubernetes\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-system-cni-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-netd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-dbus\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-device-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-script-lib\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-socket-dir-parent\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3b11f73-8ed0-4dda-9f78-44277270153d-host\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-os-release\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718771 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-kubernetes\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718753 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-multus-daemon-config\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-etc-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-systemd\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.719300 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-netns\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-cnibin\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718842 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718853 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-registration-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718854 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-etc-kubernetes\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z766k\" (UniqueName: \"kubernetes.io/projected/a3b11f73-8ed0-4dda-9f78-44277270153d-kube-api-access-z766k\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718896 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-device-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718903 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718914 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-cnibin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-bin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718959 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-os-release\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-conf-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprr8\" (UniqueName: \"kubernetes.io/projected/a58d6039-360c-47a3-820e-00e92dc94330-kube-api-access-fprr8\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719003 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-multus-certs\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-systemd-units\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.720143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-host\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-kubelet\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-system-cni-dir\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-socket-dir-parent\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-socket-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719148 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-cni-netd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.718682 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-env-overrides\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.719163 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.719243 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:12.219205668 +0000 UTC m=+3.015362809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719266 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-socket-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-k8s-cni-cncf-io\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-host\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-kubelet\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e05fa631-9ece-4219-bf41-844420df3e6c-cnibin\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-registration-dir\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysctl-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.720846 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-etc-selinux\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-run-k8s-cni-cncf-io\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-modprobe-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719513 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-multus-conf-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-cni-bin\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719527 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-sys\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-systemd-units\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719571 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3b11f73-8ed0-4dda-9f78-44277270153d-host\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719607 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-systemd\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719642 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-modprobe-d\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57dq\" (UniqueName: \"kubernetes.io/projected/b987acf2-53b4-47aa-aea3-373b50b4c913-kube-api-access-z57dq\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719729 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.719660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-sys\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysconfig\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22sqm\" (UniqueName: \"kubernetes.io/projected/fb3974e2-2083-4164-97a4-c80a654c41f1-kube-api-access-22sqm\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.721661 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-slash\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-ovn\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-multus-daemon-config\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-sysconfig\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vcd\" (UniqueName: \"kubernetes.io/projected/1ba5358e-4daf-4103-b55c-60c7ec4bf022-kube-api-access-g4vcd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720157 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-ovn\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de7dd93b-016f-4bc0-a0ab-a569c69135f0-konnectivity-ca\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720180 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-slash\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-system-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-cni-binary-copy\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d37b91-8e59-46cf-a224-2b7ae49175ac-tmp-dir\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720287 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-system-cni-dir\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aa00645-96d5-480f-b2fd-8690d11e7580-host-slash\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-lib-modules\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.722556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64d37b91-8e59-46cf-a224-2b7ae49175ac-hosts-file\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720461 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aa00645-96d5-480f-b2fd-8690d11e7580-iptables-alerter-script\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720504 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-kubelet\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-sys-fs\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b11f73-8ed0-4dda-9f78-44277270153d-serviceca\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64d37b91-8e59-46cf-a224-2b7ae49175ac-tmp-dir\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4snjs\" (UniqueName: \"kubernetes.io/projected/64d37b91-8e59-46cf-a224-2b7ae49175ac-kube-api-access-4snjs\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-kubelet-config\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de7dd93b-016f-4bc0-a0ab-a569c69135f0-agent-certs\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-run\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6413be8b-fb37-4229-b9f7-2d0b6342fd29-sys-fs\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-tuned\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjv7\" (UniqueName: \"kubernetes.io/projected/e05fa631-9ece-4219-bf41-844420df3e6c-kube-api-access-5hjv7\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720719 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-lib-modules\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-netns\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-var-lib-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ztg\" (UniqueName: \"kubernetes.io/projected/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kube-api-access-f2ztg\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.723303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-hostroot\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a58d6039-360c-47a3-820e-00e92dc94330-cni-binary-copy\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-systemd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720880 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-node-log\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-config\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.720631 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64d37b91-8e59-46cf-a224-2b7ae49175ac-hosts-file\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-host-var-lib-kubelet\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721231 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3b11f73-8ed0-4dda-9f78-44277270153d-serviceca\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a58d6039-360c-47a3-820e-00e92dc94330-hostroot\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-run-systemd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721300 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-var-lib-openvswitch\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-host-run-netns\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovnkube-config\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fb3974e2-2083-4164-97a4-c80a654c41f1-run\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ba5358e-4daf-4103-b55c-60c7ec4bf022-node-log\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.721829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e05fa631-9ece-4219-bf41-844420df3e6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.724113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.723078 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ba5358e-4daf-4103-b55c-60c7ec4bf022-ovn-node-metrics-cert\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.724792 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.723304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-tmp\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.724792 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.723539 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fb3974e2-2083-4164-97a4-c80a654c41f1-etc-tuned\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.727625 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.727560 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:11.727625 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.727585 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:11.727625 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.727601 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:11.727856 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.727660 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:12.227642943 +0000 UTC m=+3.023800077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:11.730483 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.730443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vcd\" (UniqueName: \"kubernetes.io/projected/1ba5358e-4daf-4103-b55c-60c7ec4bf022-kube-api-access-g4vcd\") pod \"ovnkube-node-zp8xt\" (UID: \"1ba5358e-4daf-4103-b55c-60c7ec4bf022\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.730930 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.730904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ztg\" (UniqueName: \"kubernetes.io/projected/6413be8b-fb37-4229-b9f7-2d0b6342fd29-kube-api-access-f2ztg\") pod \"aws-ebs-csi-driver-node-xg56r\" (UID: \"6413be8b-fb37-4229-b9f7-2d0b6342fd29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.731037 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.731008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjv7\" (UniqueName: \"kubernetes.io/projected/e05fa631-9ece-4219-bf41-844420df3e6c-kube-api-access-5hjv7\") pod \"multus-additional-cni-plugins-gnvx5\" (UID: \"e05fa631-9ece-4219-bf41-844420df3e6c\") " pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.731127 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.731103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprr8\" (UniqueName: \"kubernetes.io/projected/a58d6039-360c-47a3-820e-00e92dc94330-kube-api-access-fprr8\") pod \"multus-ms4tc\" (UID: \"a58d6039-360c-47a3-820e-00e92dc94330\") " pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.732646 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.732599 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z766k\" (UniqueName: \"kubernetes.io/projected/a3b11f73-8ed0-4dda-9f78-44277270153d-kube-api-access-z766k\") pod \"node-ca-xwdph\" (UID: \"a3b11f73-8ed0-4dda-9f78-44277270153d\") " pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.732905 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.732885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4snjs\" (UniqueName: \"kubernetes.io/projected/64d37b91-8e59-46cf-a224-2b7ae49175ac-kube-api-access-4snjs\") pod \"node-resolver-6mjc2\" (UID: \"64d37b91-8e59-46cf-a224-2b7ae49175ac\") " pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.732987 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.732929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57dq\" (UniqueName: \"kubernetes.io/projected/b987acf2-53b4-47aa-aea3-373b50b4c913-kube-api-access-z57dq\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:11.733072 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.733057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22sqm\" (UniqueName: \"kubernetes.io/projected/fb3974e2-2083-4164-97a4-c80a654c41f1-kube-api-access-22sqm\") pod \"tuned-d78kq\" (UID: \"fb3974e2-2083-4164-97a4-c80a654c41f1\") " pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.820771 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.820742 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:11.821953 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.821928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de7dd93b-016f-4bc0-a0ab-a569c69135f0-konnectivity-ca\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.822085 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.821959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aa00645-96d5-480f-b2fd-8690d11e7580-host-slash\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.822085 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.821975 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aa00645-96d5-480f-b2fd-8690d11e7580-iptables-alerter-script\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.822085 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.821993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-kubelet-config\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.822085 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aa00645-96d5-480f-b2fd-8690d11e7580-host-slash\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.822282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-kubelet-config\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.822282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822103 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de7dd93b-016f-4bc0-a0ab-a569c69135f0-agent-certs\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.822282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.822282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822175 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8snt\" (UniqueName: \"kubernetes.io/projected/5aa00645-96d5-480f-b2fd-8690d11e7580-kube-api-access-g8snt\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.822282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-dbus\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.822534 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.822302 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:11.822534 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:11.822360 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:12.322347387 +0000 UTC m=+3.118504505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:11.822534 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34dd40f8-a2bc-46b4-9246-d18019b93c02-dbus\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:11.822534 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aa00645-96d5-480f-b2fd-8690d11e7580-iptables-alerter-script\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.822662 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.822574 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de7dd93b-016f-4bc0-a0ab-a569c69135f0-konnectivity-ca\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.824568 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.824548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de7dd93b-016f-4bc0-a0ab-a569c69135f0-agent-certs\") pod \"konnectivity-agent-knjm7\" (UID: \"de7dd93b-016f-4bc0-a0ab-a569c69135f0\") " pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.832578 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.832526 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8snt\" (UniqueName: \"kubernetes.io/projected/5aa00645-96d5-480f-b2fd-8690d11e7580-kube-api-access-g8snt\") pod \"iptables-alerter-zzs2q\" (UID: \"5aa00645-96d5-480f-b2fd-8690d11e7580\") " pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:11.905513 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.905452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" Jun 11 18:28:11.913255 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.913226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ms4tc" Jun 11 18:28:11.921331 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.921314 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwdph" Jun 11 18:28:11.928438 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.928419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" Jun 11 18:28:11.934316 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.934298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:11.941867 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.941843 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mjc2" Jun 11 18:28:11.948393 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.948375 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d78kq" Jun 11 18:28:11.954910 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.954892 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:11.960560 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:11.960537 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzs2q" Jun 11 18:28:12.224714 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.224600 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:12.224884 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.224726 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:12.224884 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.224795 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:13.224775445 +0000 UTC m=+4.020932574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:12.325172 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.325129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:12.325349 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.325205 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:12.325349 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325328 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:12.325457 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325399 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:13.325384401 +0000 UTC m=+4.121541515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:12.325457 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325333 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:12.325457 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325452 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:12.325638 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325484 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:12.325638 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:12.325537 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:13.325519631 +0000 UTC m=+4.121676748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:12.481577 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.481520 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba5358e_4daf_4103_b55c_60c7ec4bf022.slice/crio-4d699e80df641431b927d2c1ca8bba396ac179795f0bccfce0d9857ff0d1df0f WatchSource:0}: Error finding container 4d699e80df641431b927d2c1ca8bba396ac179795f0bccfce0d9857ff0d1df0f: Status 404 returned error can't find the container with id 4d699e80df641431b927d2c1ca8bba396ac179795f0bccfce0d9857ff0d1df0f Jun 11 18:28:12.482997 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.482958 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6413be8b_fb37_4229_b9f7_2d0b6342fd29.slice/crio-19084ff382c0ccc6fd53332043b13d8a5501f622f73eb574d03b5517fea521d2 WatchSource:0}: Error finding container 19084ff382c0ccc6fd53332043b13d8a5501f622f73eb574d03b5517fea521d2: Status 404 returned error can't find the container with id 19084ff382c0ccc6fd53332043b13d8a5501f622f73eb574d03b5517fea521d2 Jun 11 18:28:12.485870 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.485842 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d37b91_8e59_46cf_a224_2b7ae49175ac.slice/crio-5d0d74037a87281e76c751e5bec1611b3018832a86d40abb8fdddfa01baac3fb WatchSource:0}: Error finding container 5d0d74037a87281e76c751e5bec1611b3018832a86d40abb8fdddfa01baac3fb: Status 404 returned error can't find the container with id 5d0d74037a87281e76c751e5bec1611b3018832a86d40abb8fdddfa01baac3fb Jun 11 18:28:12.486551 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.486438 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7dd93b_016f_4bc0_a0ab_a569c69135f0.slice/crio-ef6b15e497d1fc536689523d70926915d87b2c2e47accef94b3012aa04defdfc WatchSource:0}: Error finding container ef6b15e497d1fc536689523d70926915d87b2c2e47accef94b3012aa04defdfc: Status 404 returned error can't find the container with id ef6b15e497d1fc536689523d70926915d87b2c2e47accef94b3012aa04defdfc Jun 11 18:28:12.488235 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.488142 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b11f73_8ed0_4dda_9f78_44277270153d.slice/crio-07e00ff1f073006c05ed06d044bc1e720b3328328071204cf6845850bebe26b7 WatchSource:0}: Error finding container 07e00ff1f073006c05ed06d044bc1e720b3328328071204cf6845850bebe26b7: Status 404 returned error can't find the container with id 07e00ff1f073006c05ed06d044bc1e720b3328328071204cf6845850bebe26b7 Jun 11 18:28:12.488816 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.488792 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58d6039_360c_47a3_820e_00e92dc94330.slice/crio-437bcd712bd2e4eca1f0990a03f4dd03abe4e425fe906a06b686d5f53bc84bd8 WatchSource:0}: Error finding container 437bcd712bd2e4eca1f0990a03f4dd03abe4e425fe906a06b686d5f53bc84bd8: Status 404 returned error can't find the container with id 437bcd712bd2e4eca1f0990a03f4dd03abe4e425fe906a06b686d5f53bc84bd8 Jun 11 18:28:12.490646 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.490627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa00645_96d5_480f_b2fd_8690d11e7580.slice/crio-f02a9ce497dc37eb54ddc6a83e84cd894fcb73c436dd8912eb02558fd57a08ef WatchSource:0}: Error finding container f02a9ce497dc37eb54ddc6a83e84cd894fcb73c436dd8912eb02558fd57a08ef: Status 404 returned error can't find the container with id f02a9ce497dc37eb54ddc6a83e84cd894fcb73c436dd8912eb02558fd57a08ef Jun 11 18:28:12.491533 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.491511 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3974e2_2083_4164_97a4_c80a654c41f1.slice/crio-f9c5b9dbf4c83a6b00992642409bd368c5eb6b438bb34e190bd704dec6392fb3 WatchSource:0}: Error finding container f9c5b9dbf4c83a6b00992642409bd368c5eb6b438bb34e190bd704dec6392fb3: Status 404 returned error can't find the container with id f9c5b9dbf4c83a6b00992642409bd368c5eb6b438bb34e190bd704dec6392fb3 Jun 11 18:28:12.492686 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:12.492662 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05fa631_9ece_4219_bf41_844420df3e6c.slice/crio-2ad2ab526a9ad03ce2eb91f15dc216acf163014beacb8e6ee99d56142a0a9fcc WatchSource:0}: Error finding container 2ad2ab526a9ad03ce2eb91f15dc216acf163014beacb8e6ee99d56142a0a9fcc: Status 404 returned error can't find the container with id 2ad2ab526a9ad03ce2eb91f15dc216acf163014beacb8e6ee99d56142a0a9fcc Jun 11 18:28:12.648723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.648687 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:23:11 +0000 UTC" deadline="2028-02-23 11:22:29.495980112 +0000 UTC" Jun 11 18:28:12.648723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.648719 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14920h54m16.847264866s" Jun 11 18:28:12.677508 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.677456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" event={"ID":"81c97266164387c531fda220849e753b","Type":"ContainerStarted","Data":"97b1b8e5f0a057fb8b50c0db68556b99407d087da0c74eb14951f2b3a6b1bbb2"} Jun 11 18:28:12.679207 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.679181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzs2q" event={"ID":"5aa00645-96d5-480f-b2fd-8690d11e7580","Type":"ContainerStarted","Data":"f02a9ce497dc37eb54ddc6a83e84cd894fcb73c436dd8912eb02558fd57a08ef"} Jun 11 18:28:12.680265 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.680242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d78kq" event={"ID":"fb3974e2-2083-4164-97a4-c80a654c41f1","Type":"ContainerStarted","Data":"f9c5b9dbf4c83a6b00992642409bd368c5eb6b438bb34e190bd704dec6392fb3"} Jun 11 18:28:12.681525 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.681498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mjc2" event={"ID":"64d37b91-8e59-46cf-a224-2b7ae49175ac","Type":"ContainerStarted","Data":"5d0d74037a87281e76c751e5bec1611b3018832a86d40abb8fdddfa01baac3fb"} Jun 11 18:28:12.682716 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.682697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" event={"ID":"6413be8b-fb37-4229-b9f7-2d0b6342fd29","Type":"ContainerStarted","Data":"19084ff382c0ccc6fd53332043b13d8a5501f622f73eb574d03b5517fea521d2"} Jun 11 18:28:12.683852 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.683832 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"4d699e80df641431b927d2c1ca8bba396ac179795f0bccfce0d9857ff0d1df0f"} Jun 11 18:28:12.684833 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.684813 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerStarted","Data":"2ad2ab526a9ad03ce2eb91f15dc216acf163014beacb8e6ee99d56142a0a9fcc"} Jun 11 18:28:12.686932 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.686914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-knjm7" event={"ID":"de7dd93b-016f-4bc0-a0ab-a569c69135f0","Type":"ContainerStarted","Data":"ef6b15e497d1fc536689523d70926915d87b2c2e47accef94b3012aa04defdfc"} Jun 11 18:28:12.687935 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.687915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ms4tc" event={"ID":"a58d6039-360c-47a3-820e-00e92dc94330","Type":"ContainerStarted","Data":"437bcd712bd2e4eca1f0990a03f4dd03abe4e425fe906a06b686d5f53bc84bd8"} Jun 11 18:28:12.689627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:12.689197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwdph" event={"ID":"a3b11f73-8ed0-4dda-9f78-44277270153d","Type":"ContainerStarted","Data":"07e00ff1f073006c05ed06d044bc1e720b3328328071204cf6845850bebe26b7"} Jun 11 18:28:13.122157 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.122121 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:13.232672 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.232186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:13.232672 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.232364 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:13.232672 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.232430 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:15.232411552 +0000 UTC m=+6.028568685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.332598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.332684 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.332847 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.332911 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:15.332892039 +0000 UTC m=+6.129049154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.333353 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.333372 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.333384 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:13.333486 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.333428 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:15.333413928 +0000 UTC m=+6.129571044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:13.649536 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.649410 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:23:11 +0000 UTC" deadline="2028-03-15 08:08:30.709339268 +0000 UTC" Jun 11 18:28:13.649536 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.649484 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15421h40m17.059859772s" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.666610 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.666744 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.667134 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.667241 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.667311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:13.667724 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:13.667386 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:13.716770 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.716733 2568 generic.go:356] "Generic (PLEG): container finished" podID="92efee55cff1223126921915ef1002db" containerID="2d712c31b358f6bbbb314477fa61c0d4c21e2d4f1318911cf77e1c89a4f95a13" exitCode=0 Jun 11 18:28:13.717732 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.717698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" event={"ID":"92efee55cff1223126921915ef1002db","Type":"ContainerDied","Data":"2d712c31b358f6bbbb314477fa61c0d4c21e2d4f1318911cf77e1c89a4f95a13"} Jun 11 18:28:13.735265 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:13.735203 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-116.ec2.internal" podStartSLOduration=2.7351821210000002 podStartE2EDuration="2.735182121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:12.693387581 +0000 UTC m=+3.489544696" watchObservedRunningTime="2026-06-11 18:28:13.735182121 +0000 UTC m=+4.531339260" Jun 11 18:28:14.760342 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:14.759577 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" event={"ID":"92efee55cff1223126921915ef1002db","Type":"ContainerStarted","Data":"8f82e776c829822cb96065c517dd96cb115d3ba50c125e37ccb073af5e112f8f"} Jun 11 18:28:14.775709 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:14.775647 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-116.ec2.internal" podStartSLOduration=3.77562683 podStartE2EDuration="3.77562683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:14.774709413 +0000 UTC m=+5.570866552" watchObservedRunningTime="2026-06-11 18:28:14.77562683 +0000 UTC m=+5.571783971" Jun 11 18:28:15.248461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.248422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:15.248673 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.248617 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:15.248748 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.248685 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.248667463 +0000 UTC m=+10.044824578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:15.349416 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.349378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:15.349604 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.349449 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:15.349604 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.349582 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:15.349728 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.349643 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.349625659 +0000 UTC m=+10.145782775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:15.350078 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.350055 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:15.350187 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.350084 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:15.350187 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.350096 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:15.350187 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.350142 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.350126668 +0000 UTC m=+10.146283790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:15.666872 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.666837 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:15.667089 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.666990 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:15.667415 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.667394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:15.667620 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.667516 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:15.667697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:15.667643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:15.667783 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:15.667723 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:17.667496 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:17.667237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:17.667496 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:17.667388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:17.667496 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:17.667397 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:17.668085 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:17.667528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:17.668085 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:17.667590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:17.668085 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:17.667661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:19.284052 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.284004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:19.284568 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.284242 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:19.284568 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.284317 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:27.284297477 +0000 UTC m=+18.080454607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:19.385206 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.385164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:19.385397 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.385248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:19.385397 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385378 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:19.385537 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385407 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:19.385537 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385422 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:19.385537 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385503 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:27.385481532 +0000 UTC m=+18.181638662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:19.385537 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385386 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:19.385745 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.385586 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:27.385570978 +0000 UTC m=+18.181728093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.667398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.667528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.667593 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.667679 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:19.668051 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:19.668208 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:19.668157 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:21.666987 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:21.666950 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:21.666987 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:21.666993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:21.667529 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:21.666950 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:21.667529 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:21.667088 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:21.667529 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:21.667203 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:21.667529 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:21.667285 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:23.666880 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:23.666840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:23.667325 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:23.666840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:23.667325 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:23.666976 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:23.667325 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:23.666848 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:23.667325 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:23.667042 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:23.667325 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:23.667121 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:25.666913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:25.666864 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:25.667401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:25.666875 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:25.667401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:25.666997 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:25.667401 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:25.666997 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:25.667401 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:25.667154 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:25.667401 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:25.667226 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:27.347392 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.347351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:27.347943 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.347541 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:27.347943 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.347630 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:43.347608403 +0000 UTC m=+34.143765534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:27.447708 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.447672 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:27.447898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.447745 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:27.447898 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447830 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:27.447898 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447856 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:27.447898 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447869 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:27.447898 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447884 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:27.448115 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447903 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:43.447882095 +0000 UTC m=+34.244039215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:27.448115 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.447932 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:43.447918779 +0000 UTC m=+34.244075911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:27.666919 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.666820 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:27.667097 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.666820 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:27.667097 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.666956 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:27.667097 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:27.666972 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:27.667255 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.667090 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:27.667255 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:27.667181 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:29.671337 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:29.671305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:29.671806 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:29.671313 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:29.671806 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:29.671702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:29.671806 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:29.671717 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:29.671806 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:29.671797 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:29.671955 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:29.671882 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:31.666848 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.666551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:31.667362 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.666551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:31.667362 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:31.666921 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:31.667362 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:31.667032 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:31.667362 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.666625 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:31.667362 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:31.667132 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:31.798606 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.798562 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="be609eeb87b5d1cb0e6e7dd1538d04495afded6f4b53345b62db5531f6fc33d3" exitCode=0 Jun 11 18:28:31.798769 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.798653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"be609eeb87b5d1cb0e6e7dd1538d04495afded6f4b53345b62db5531f6fc33d3"} Jun 11 18:28:31.800418 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.800392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-knjm7" event={"ID":"de7dd93b-016f-4bc0-a0ab-a569c69135f0","Type":"ContainerStarted","Data":"9a3539d4778a3c465045bbcdb55c7ca09981c28a27fe143ae767044956fbc711"} Jun 11 18:28:31.802636 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.802603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ms4tc" event={"ID":"a58d6039-360c-47a3-820e-00e92dc94330","Type":"ContainerStarted","Data":"dd7cb001b1f9671462fefc451448974bc7b16d1e8403e4dd6433ae0a3b620823"} Jun 11 18:28:31.804633 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.804572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwdph" event={"ID":"a3b11f73-8ed0-4dda-9f78-44277270153d","Type":"ContainerStarted","Data":"482c8c83cf14e69aeadb35da4fffb2b3a626e29a141cf7481e9c552c3fbf93dd"} Jun 11 18:28:31.806322 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.806292 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d78kq" event={"ID":"fb3974e2-2083-4164-97a4-c80a654c41f1","Type":"ContainerStarted","Data":"6438c407ff8fa5f2514226b3a61764f14db233c5fbe45b91cefd6c5a8ccb2bc0"} Jun 11 18:28:31.808015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.807993 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mjc2" event={"ID":"64d37b91-8e59-46cf-a224-2b7ae49175ac","Type":"ContainerStarted","Data":"6969ff2b1241aaa80bbfe6e1305987238252d51f6227fb51ee7d8f83bbe05a7c"} Jun 11 18:28:31.809864 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.809838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" event={"ID":"6413be8b-fb37-4229-b9f7-2d0b6342fd29","Type":"ContainerStarted","Data":"0acc373cfe244289147c2be78faafe19df8768f724585ed7958c66898e39e3ab"} Jun 11 18:28:31.813396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"1a19c72aa1753c3fbb78c0a472a89b50b0fc71d6c95bfc4819f5ce095788702b"} Jun 11 18:28:31.813512 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813446 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"030415fd73ecd7e55eae3c012eef9de291b950204335167a21f6be10ed85b30d"} Jun 11 18:28:31.813512 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813511 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"a6e78909ea8edacf0b77f4d22bfa86f8f176df7a3546a8cbf42397270f851f68"} Jun 11 18:28:31.813641 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813560 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"1cb70cc34ae75445838e5f8522b8ad11f04444cc096ce41862623750464bf0b5"} Jun 11 18:28:31.813641 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"d8e2e75fcf07021656956ccaa4dea733a28ecb04a2a5da6bb764477a3bd287d0"} Jun 11 18:28:31.813753 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.813665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"cb0ddf9424d4357fc41fc9c9a7bda8a2e6e6c1bd32953ef80e6d99469a4f5ac5"} Jun 11 18:28:31.835784 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.835729 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6mjc2" podStartSLOduration=4.283973654 podStartE2EDuration="22.835710299s" totalImagesPullingTime="18.551736645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.835427381 +0000 UTC m=+22.631584519" watchObservedRunningTime="2026-06-11 18:28:31.835710299 +0000 UTC m=+22.631867439" Jun 11 18:28:31.852070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.852021 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d78kq" podStartSLOduration=4.304419969 podStartE2EDuration="22.852007746s" totalImagesPullingTime="18.547587777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.851870245 +0000 UTC m=+22.648027383" watchObservedRunningTime="2026-06-11 18:28:31.852007746 +0000 UTC m=+22.648164883" Jun 11 18:28:31.868388 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.868339 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-knjm7" podStartSLOduration=8.668708206 podStartE2EDuration="22.868323513s" totalImagesPullingTime="14.199615307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.867647927 +0000 UTC m=+22.663805063" watchObservedRunningTime="2026-06-11 18:28:31.868323513 +0000 UTC m=+22.664480650" Jun 11 18:28:31.887762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.887718 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ms4tc" podStartSLOduration=4.2608795950000005 podStartE2EDuration="22.887704016s" totalImagesPullingTime="18.626824421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.887004593 +0000 UTC m=+22.683161749" watchObservedRunningTime="2026-06-11 18:28:31.887704016 +0000 UTC m=+22.683861152" Jun 11 18:28:31.901444 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:31.901402 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xwdph" podStartSLOduration=4.35099997 podStartE2EDuration="22.901388457s" totalImagesPullingTime="18.550388487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.900986261 +0000 UTC m=+22.697143398" watchObservedRunningTime="2026-06-11 18:28:31.901388457 +0000 UTC m=+22.697545594" Jun 11 18:28:32.622095 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.622063 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 18:28:32.672714 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.672587 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T18:28:32.622089491Z","UUID":"0e075e16-2a33-41dc-ae14-cc6b01c03841","Handler":null,"Name":"","Endpoint":""} Jun 11 18:28:32.674674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.674551 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 18:28:32.674674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.674592 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 18:28:32.746651 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.746617 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:32.747282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.747261 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:32.818413 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.818372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzs2q" event={"ID":"5aa00645-96d5-480f-b2fd-8690d11e7580","Type":"ContainerStarted","Data":"110a01b0353c37ff3c16e651a4cac8ed99358cac79ba9df5d06da7874138bc0b"} Jun 11 18:28:32.820511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.820458 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" event={"ID":"6413be8b-fb37-4229-b9f7-2d0b6342fd29","Type":"ContainerStarted","Data":"39ab9b8db4872db30ed08576934ce499f5c666e176df8740940883f791c78046"} Jun 11 18:28:32.821299 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.821242 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:32.821668 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.821634 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-knjm7" Jun 11 18:28:32.834843 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:32.834755 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zzs2q" podStartSLOduration=5.287643 podStartE2EDuration="23.834740712s" totalImagesPullingTime="18.547097712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:32.834172149 +0000 UTC m=+23.630329289" watchObservedRunningTime="2026-06-11 18:28:32.834740712 +0000 UTC m=+23.630897849" Jun 11 18:28:33.667194 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:33.667159 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:33.667194 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:33.667198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:33.667576 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:33.667169 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:33.667576 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:33.667287 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:33.667576 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:33.667383 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:33.667576 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:33.667491 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:33.825450 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:33.825423 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" event={"ID":"6413be8b-fb37-4229-b9f7-2d0b6342fd29","Type":"ContainerStarted","Data":"758aeb04fa3612c61256f628140862844dc5609344ecbb58d36c0fddee7f6f6a"} Jun 11 18:28:33.842746 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:33.842694 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xg56r" podStartSLOduration=4.150573872 podStartE2EDuration="24.842672383s" totalImagesPullingTime="20.692098511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:33.842280235 +0000 UTC m=+24.638437371" watchObservedRunningTime="2026-06-11 18:28:33.842672383 +0000 UTC m=+24.638829521" Jun 11 18:28:34.833150 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:34.833111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"80b78a60b721d94c50a98e39e80a3b3583ebdb43813742c553041769c9fd39c0"} Jun 11 18:28:35.667246 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:35.667203 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:35.667434 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:35.667210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:35.667434 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:35.667338 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:35.667434 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:35.667413 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:35.667434 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:35.667210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:35.667644 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:35.667521 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:36.842190 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.842020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" event={"ID":"1ba5358e-4daf-4103-b55c-60c7ec4bf022","Type":"ContainerStarted","Data":"6a72ac7128f7e282db015dd37c4696b28a7980e87ba9809f8ac4599f1435d8ac"} Jun 11 18:28:36.842903 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.842594 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:36.842903 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.842662 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:36.842903 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.842707 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:36.844665 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.844641 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerStarted","Data":"0403762e19b61f55d8726a25114f9642b2d07c672f7eb37bfe7c130090e0b797"} Jun 11 18:28:36.858437 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.858410 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:36.858656 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.858617 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:28:36.872107 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:36.870272 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" podStartSLOduration=9.233787269 podStartE2EDuration="27.870252487s" totalImagesPullingTime="18.636465218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:36.867815459 +0000 UTC m=+27.663972610" watchObservedRunningTime="2026-06-11 18:28:36.870252487 +0000 UTC m=+27.666409625" Jun 11 18:28:37.666518 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:37.666458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:37.666758 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:37.666458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:37.666758 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:37.666612 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:37.666758 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:37.666653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:37.666758 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:37.666752 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:37.667035 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:37.666870 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:37.849143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:37.848963 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="0403762e19b61f55d8726a25114f9642b2d07c672f7eb37bfe7c130090e0b797" exitCode=0 Jun 11 18:28:37.849567 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:37.849037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"0403762e19b61f55d8726a25114f9642b2d07c672f7eb37bfe7c130090e0b797"} Jun 11 18:28:38.436566 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.436528 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2w26"] Jun 11 18:28:38.436784 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.436658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:38.436844 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:38.436778 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:38.439339 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.439315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtl68"] Jun 11 18:28:38.439514 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.439402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:38.439606 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:38.439539 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:38.440087 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.440058 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pf29"] Jun 11 18:28:38.440192 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.440143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:38.440256 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:38.440230 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:38.853434 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.853399 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="fa9af6be70b0f164a43fd3b2e246cc1b6788018a8328775e33100fc9426e4554" exitCode=0 Jun 11 18:28:38.853912 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:38.853450 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"fa9af6be70b0f164a43fd3b2e246cc1b6788018a8328775e33100fc9426e4554"} Jun 11 18:28:39.667280 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:39.667220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:39.667454 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:39.667330 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:40.667372 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:40.667345 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:40.667733 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:40.667482 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:40.667733 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:40.667496 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:40.667733 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:40.667635 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:40.860131 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:40.860049 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="12ee65f48260cfc9f6c95e6b77a3b92d2c9ab928f602f90e07b3a4445849ddc4" exitCode=0 Jun 11 18:28:40.860131 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:40.860098 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"12ee65f48260cfc9f6c95e6b77a3b92d2c9ab928f602f90e07b3a4445849ddc4"} Jun 11 18:28:41.666990 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:41.666951 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:41.667186 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:41.667142 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:42.666511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:42.666458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:42.666942 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:42.666460 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:42.666942 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:42.666602 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b2w26" podUID="34dd40f8-a2bc-46b4-9246-d18019b93c02" Jun 11 18:28:42.666942 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:42.666726 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:28:43.367501 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.367450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:43.367690 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.367670 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:43.367755 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.367744 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:15.367726693 +0000 UTC m=+66.163883808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:43.468066 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.468026 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.468091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468167 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468175 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468188 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468200 2568 projected.go:196] Error preparing data for projected volume kube-api-access-g754h for pod openshift-network-diagnostics/network-check-target-rtl68: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468238 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret podName:34dd40f8-a2bc-46b4-9246-d18019b93c02 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:15.468219423 +0000 UTC m=+66.264376542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret") pod "global-pull-secret-syncer-b2w26" (UID: "34dd40f8-a2bc-46b4-9246-d18019b93c02") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:43.468260 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.468252 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h podName:b089645b-14bf-4931-afe3-81aea1d98b21 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:15.468246495 +0000 UTC m=+66.264403611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g754h" (UniqueName: "kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h") pod "network-check-target-rtl68" (UID: "b089645b-14bf-4931-afe3-81aea1d98b21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:43.667422 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.667242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:43.667810 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:43.667543 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rtl68" podUID="b089645b-14bf-4931-afe3-81aea1d98b21" Jun 11 18:28:43.932558 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.932479 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-116.ec2.internal" event="NodeReady" Jun 11 18:28:43.932709 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.932635 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 18:28:43.980093 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.980044 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7xk77"] Jun 11 18:28:43.985075 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.985048 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jz966"] Jun 11 18:28:43.985212 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.985183 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:43.986698 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.986675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:43.987924 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.987895 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 18:28:43.988049 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.988016 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:28:43.988380 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.988365 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 18:28:43.989096 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.989080 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rkrwn\"" Jun 11 18:28:43.989302 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.989282 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 18:28:43.989371 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.989322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 18:28:43.989568 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.989553 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 18:28:43.992312 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.992292 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz966"] Jun 11 18:28:43.996513 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:43.996280 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xk77"] Jun 11 18:28:44.072654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.072654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e45fcb05-37e4-40ef-a025-65efa8a866f2-config-volume\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.072889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072687 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45fcb05-37e4-40ef-a025-65efa8a866f2-tmp-dir\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.072889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rz6\" (UniqueName: \"kubernetes.io/projected/e45fcb05-37e4-40ef-a025-65efa8a866f2-kube-api-access-95rz6\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.072889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b13a704-4238-416e-8b90-f250ccab9209-cert\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.073015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.072888 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s7m5\" (UniqueName: \"kubernetes.io/projected/1b13a704-4238-416e-8b90-f250ccab9209-kube-api-access-5s7m5\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.173593 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s7m5\" (UniqueName: \"kubernetes.io/projected/1b13a704-4238-416e-8b90-f250ccab9209-kube-api-access-5s7m5\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.173790 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173632 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.173790 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e45fcb05-37e4-40ef-a025-65efa8a866f2-config-volume\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.173790 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45fcb05-37e4-40ef-a025-65efa8a866f2-tmp-dir\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.173790 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rz6\" (UniqueName: \"kubernetes.io/projected/e45fcb05-37e4-40ef-a025-65efa8a866f2-kube-api-access-95rz6\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.174008 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.173856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b13a704-4238-416e-8b90-f250ccab9209-cert\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.174008 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:44.173983 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:44.174108 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:44.174051 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:44.674029262 +0000 UTC m=+35.470186400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:28:44.174556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.174274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45fcb05-37e4-40ef-a025-65efa8a866f2-tmp-dir\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.174556 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.174456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e45fcb05-37e4-40ef-a025-65efa8a866f2-config-volume\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.178460 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.178439 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b13a704-4238-416e-8b90-f250ccab9209-cert\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.182854 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.182772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s7m5\" (UniqueName: \"kubernetes.io/projected/1b13a704-4238-416e-8b90-f250ccab9209-kube-api-access-5s7m5\") pod \"ingress-canary-jz966\" (UID: \"1b13a704-4238-416e-8b90-f250ccab9209\") " pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.185854 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.185831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rz6\" (UniqueName: \"kubernetes.io/projected/e45fcb05-37e4-40ef-a025-65efa8a866f2-kube-api-access-95rz6\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.305234 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.305195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz966" Jun 11 18:28:44.666723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.666685 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:28:44.666909 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.666686 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:28:44.669654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.669629 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:28:44.669654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.669639 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:28:44.670151 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.669686 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:28:44.678240 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:44.678172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:44.678373 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:44.678348 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:44.678502 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:44.678434 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:45.678414087 +0000 UTC m=+36.474571204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:28:45.251691 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.251641 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz966"] Jun 11 18:28:45.257706 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:28:45.257662 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b13a704_4238_416e_8b90_f250ccab9209.slice/crio-2c79257fced0692f98343b79c9a78c50b777605a6f3f230c2cb11aeb823f6c94 WatchSource:0}: Error finding container 2c79257fced0692f98343b79c9a78c50b777605a6f3f230c2cb11aeb823f6c94: Status 404 returned error can't find the container with id 2c79257fced0692f98343b79c9a78c50b777605a6f3f230c2cb11aeb823f6c94 Jun 11 18:28:45.667782 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.667507 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:28:45.670528 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.670496 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:28:45.671171 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.670544 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:28:45.671171 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.670504 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:28:45.687498 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.687455 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:45.687625 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:45.687584 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:45.687672 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:45.687652 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:47.687632451 +0000 UTC m=+38.483789580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:28:45.875172 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.875134 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="65d889980223f8bd3fde1aa90218b348404434278e3e54227c02a24696ee0775" exitCode=0 Jun 11 18:28:45.875345 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.875221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"65d889980223f8bd3fde1aa90218b348404434278e3e54227c02a24696ee0775"} Jun 11 18:28:45.876669 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:45.876644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz966" event={"ID":"1b13a704-4238-416e-8b90-f250ccab9209","Type":"ContainerStarted","Data":"2c79257fced0692f98343b79c9a78c50b777605a6f3f230c2cb11aeb823f6c94"} Jun 11 18:28:46.882721 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:46.882687 2568 generic.go:356] "Generic (PLEG): container finished" podID="e05fa631-9ece-4219-bf41-844420df3e6c" containerID="f067ce414208b03957499355cb47e0b81a4304854e1097a7e78569ede0c7a6e1" exitCode=0 Jun 11 18:28:46.883094 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:46.882739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerDied","Data":"f067ce414208b03957499355cb47e0b81a4304854e1097a7e78569ede0c7a6e1"} Jun 11 18:28:47.703289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:47.703251 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:47.703490 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:47.703369 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:47.703490 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:47.703425 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:51.703409684 +0000 UTC m=+42.499566801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:28:47.886430 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:47.886393 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz966" event={"ID":"1b13a704-4238-416e-8b90-f250ccab9209","Type":"ContainerStarted","Data":"9c6d91e97fcb9fca24ca4aae53877e9347ba03e756829f6af3ace03a076c2d64"} Jun 11 18:28:47.891717 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:47.891690 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" event={"ID":"e05fa631-9ece-4219-bf41-844420df3e6c","Type":"ContainerStarted","Data":"51427b0f9329b152d1ecdc26c656cb710c6770984b728211f0a916d964bf2e94"} Jun 11 18:28:47.902004 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:47.901961 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jz966" podStartSLOduration=3.192456039 podStartE2EDuration="4.90194825s" totalImagesPullingTime="1.709492211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:47.901761404 +0000 UTC m=+38.697918563" watchObservedRunningTime="2026-06-11 18:28:47.90194825 +0000 UTC m=+38.698105386" Jun 11 18:28:47.923780 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:47.923734 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gnvx5" podStartSLOduration=9.161204995 podStartE2EDuration="38.92371758s" totalImagesPullingTime="29.762512585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:47.923150659 +0000 UTC m=+38.719307816" watchObservedRunningTime="2026-06-11 18:28:47.92371758 +0000 UTC m=+38.719874716" Jun 11 18:28:51.730638 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:51.730601 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:51.731044 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:51.730753 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:51.731044 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:51.730822 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:59.730806754 +0000 UTC m=+50.526963870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:28:59.789050 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:28:59.789000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:28:59.789636 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:59.789149 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:59.789636 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:28:59.789215 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:15.789198516 +0000 UTC m=+66.585355631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:29:00.972859 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.972824 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9"] Jun 11 18:29:00.992709 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.992663 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl"] Jun 11 18:29:00.992938 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.992830 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:00.995438 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995411 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 18:29:00.995587 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995411 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 18:29:00.995587 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995458 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 18:29:00.995764 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995749 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 18:29:00.995876 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995859 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 18:29:00.995972 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.995954 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 18:29:00.996062 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:00.996048 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 18:29:01.010674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.010653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl"] Jun 11 18:29:01.010759 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.010690 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9"] Jun 11 18:29:01.010759 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.010698 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.013828 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.013808 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 18:29:01.097774 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.097774 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.098035 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd785\" (UniqueName: \"kubernetes.io/projected/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-kube-api-access-qd785\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.098035 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097924 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.098035 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.098035 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.097986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198418 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198418 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198642 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198642 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198642 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd785\" (UniqueName: \"kubernetes.io/projected/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-kube-api-access-qd785\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.198762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7b6865d3-0434-4bba-bda7-f2d9358758e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.198762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bns4l\" (UniqueName: \"kubernetes.io/projected/7b6865d3-0434-4bba-bda7-f2d9358758e7-kube-api-access-bns4l\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.198762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198721 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6865d3-0434-4bba-bda7-f2d9358758e7-tmp\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.198908 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.198825 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.199278 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.199252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.202240 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.202213 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-ca\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.202439 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.202418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.202511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.202487 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.202555 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.202531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.208086 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.208062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd785\" (UniqueName: \"kubernetes.io/projected/7ec9402b-5bb9-4869-ab39-ea38cc11f5cb-kube-api-access-qd785\") pod \"cluster-proxy-proxy-agent-7bd7554cdb-pv2p9\" (UID: \"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.299205 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.299170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7b6865d3-0434-4bba-bda7-f2d9358758e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.299394 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.299210 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bns4l\" (UniqueName: \"kubernetes.io/projected/7b6865d3-0434-4bba-bda7-f2d9358758e7-kube-api-access-bns4l\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.299394 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.299242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6865d3-0434-4bba-bda7-f2d9358758e7-tmp\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.299687 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.299663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6865d3-0434-4bba-bda7-f2d9358758e7-tmp\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.301718 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.301698 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7b6865d3-0434-4bba-bda7-f2d9358758e7-klusterlet-config\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.308322 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.308301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bns4l\" (UniqueName: \"kubernetes.io/projected/7b6865d3-0434-4bba-bda7-f2d9358758e7-kube-api-access-bns4l\") pod \"klusterlet-addon-workmgr-5ffff95f64-22vhl\" (UID: \"7b6865d3-0434-4bba-bda7-f2d9358758e7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.314159 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.314131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:29:01.321289 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.321272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:01.481694 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.481661 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9"] Jun 11 18:29:01.507730 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.507704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl"] Jun 11 18:29:01.510596 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:29:01.510574 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6865d3_0434_4bba_bda7_f2d9358758e7.slice/crio-572f7ca83099ee1c88b4acc74e67e35dcb01aba32995edf51f6d6b2e6cad3f08 WatchSource:0}: Error finding container 572f7ca83099ee1c88b4acc74e67e35dcb01aba32995edf51f6d6b2e6cad3f08: Status 404 returned error can't find the container with id 572f7ca83099ee1c88b4acc74e67e35dcb01aba32995edf51f6d6b2e6cad3f08 Jun 11 18:29:01.924936 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.924894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerStarted","Data":"f514c0aada1921add6820b9a49021d8c144434d6cd9876ce11be133f82da7701"} Jun 11 18:29:01.925946 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:01.925918 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerStarted","Data":"572f7ca83099ee1c88b4acc74e67e35dcb01aba32995edf51f6d6b2e6cad3f08"} Jun 11 18:29:06.942978 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.942938 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerStarted","Data":"c4a9669adc7447ac57656c57364f24f73f820e0494e4a9bb5f0624ba905b824d"} Jun 11 18:29:06.943401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.943000 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerStarted","Data":"23e8a3176a00db9279ca7bd63d81e34cdcecc5ccddb0ec2106b2a822af907d02"} Jun 11 18:29:06.943401 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.943021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerStarted","Data":"89796b4de1f046f9a6756beb13c6b9991ded103391ec54afdc98e4239758a033"} Jun 11 18:29:06.944403 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.944371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerStarted","Data":"f1fa7016ebb9ad67ab0315fc2e6c01dae0bb5a5b48b428d3f809daa029ac7a68"} Jun 11 18:29:06.944574 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.944556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:06.946080 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.946038 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:29:06.963181 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.963132 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" podStartSLOduration=1.718145225 podStartE2EDuration="6.963120189s" totalImagesPullingTime="5.244974964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:06.962591544 +0000 UTC m=+57.758748692" watchObservedRunningTime="2026-06-11 18:29:06.963120189 +0000 UTC m=+57.759277325" Jun 11 18:29:06.978130 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:06.978084 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" podStartSLOduration=1.757635718 podStartE2EDuration="6.978069198s" totalImagesPullingTime="5.22043348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:06.977276193 +0000 UTC m=+57.773433331" watchObservedRunningTime="2026-06-11 18:29:06.978069198 +0000 UTC m=+57.774226334" Jun 11 18:29:08.868305 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:08.868278 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp8xt" Jun 11 18:29:15.393896 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.393836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:29:15.396677 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.396654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:29:15.405028 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:15.405006 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:29:15.405132 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:15.405091 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:19.405068776 +0000 UTC m=+130.201225891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : secret "metrics-daemon-secret" not found Jun 11 18:29:15.494742 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.494706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:29:15.494908 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.494787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:29:15.497704 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.497680 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:29:15.497795 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.497680 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:29:15.508043 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.508012 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34dd40f8-a2bc-46b4-9246-d18019b93c02-original-pull-secret\") pod \"global-pull-secret-syncer-b2w26\" (UID: \"34dd40f8-a2bc-46b4-9246-d18019b93c02\") " pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:29:15.508357 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.508341 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:29:15.518776 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.518751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g754h\" (UniqueName: \"kubernetes.io/projected/b089645b-14bf-4931-afe3-81aea1d98b21-kube-api-access-g754h\") pod \"network-check-target-rtl68\" (UID: \"b089645b-14bf-4931-afe3-81aea1d98b21\") " pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:29:15.578822 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.578784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b2w26" Jun 11 18:29:15.681670 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.681644 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:29:15.689767 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.689742 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:29:15.700905 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.700868 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b2w26"] Jun 11 18:29:15.704900 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:29:15.704856 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dd40f8_a2bc_46b4_9246_d18019b93c02.slice/crio-7ece99441b9be7f6391248884dc801c5234490be9ababbde14048c735896890d WatchSource:0}: Error finding container 7ece99441b9be7f6391248884dc801c5234490be9ababbde14048c735896890d: Status 404 returned error can't find the container with id 7ece99441b9be7f6391248884dc801c5234490be9ababbde14048c735896890d Jun 11 18:29:15.796989 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.796958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:29:15.797141 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:15.797072 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:15.797141 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:15.797134 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:47.797118996 +0000 UTC m=+98.593276110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:29:15.817421 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.817383 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rtl68"] Jun 11 18:29:15.820942 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:29:15.820910 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb089645b_14bf_4931_afe3_81aea1d98b21.slice/crio-d631a41e9eadb5352d3ea53fb44fd161fe15a37a3bd2986ced39c04641c1fd42 WatchSource:0}: Error finding container d631a41e9eadb5352d3ea53fb44fd161fe15a37a3bd2986ced39c04641c1fd42: Status 404 returned error can't find the container with id d631a41e9eadb5352d3ea53fb44fd161fe15a37a3bd2986ced39c04641c1fd42 Jun 11 18:29:15.969910 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.969814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtl68" event={"ID":"b089645b-14bf-4931-afe3-81aea1d98b21","Type":"ContainerStarted","Data":"d631a41e9eadb5352d3ea53fb44fd161fe15a37a3bd2986ced39c04641c1fd42"} Jun 11 18:29:15.970869 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:15.970838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2w26" event={"ID":"34dd40f8-a2bc-46b4-9246-d18019b93c02","Type":"ContainerStarted","Data":"7ece99441b9be7f6391248884dc801c5234490be9ababbde14048c735896890d"} Jun 11 18:29:20.986077 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:20.986021 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b2w26" event={"ID":"34dd40f8-a2bc-46b4-9246-d18019b93c02","Type":"ContainerStarted","Data":"3d6d88b328bcddec795ed0fb8240a5c50d7ed94619cff9c6005677f8edb507f9"} Jun 11 18:29:20.987461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:20.987436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rtl68" event={"ID":"b089645b-14bf-4931-afe3-81aea1d98b21","Type":"ContainerStarted","Data":"9019a20d19b7e05a6f0d4c8293c7cf8dfbed8b06d84f8bc9ef5f00e7d52a3b39"} Jun 11 18:29:20.987588 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:20.987549 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:29:21.002272 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:21.002223 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b2w26" podStartSLOduration=67.543390574 podStartE2EDuration="1m12.002184555s" totalImagesPullingTime="4.458793981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:21.001297429 +0000 UTC m=+71.797454591" watchObservedRunningTime="2026-06-11 18:29:21.002184555 +0000 UTC m=+71.798341691" Jun 11 18:29:21.016572 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:21.016527 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rtl68" podStartSLOduration=67.677462278 podStartE2EDuration="1m12.016511051s" totalImagesPullingTime="4.339048773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:21.015917787 +0000 UTC m=+71.812074926" watchObservedRunningTime="2026-06-11 18:29:21.016511051 +0000 UTC m=+71.812668187" Jun 11 18:29:47.808651 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:47.808516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:29:47.808651 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:47.808649 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:47.809156 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:29:47.808706 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:51.808690698 +0000 UTC m=+162.604847813 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:29:51.993094 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:29:51.993058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rtl68" Jun 11 18:30:19.431078 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:30:19.431046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:30:19.431561 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:19.431181 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:30:19.431561 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:19.431245 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs podName:b987acf2-53b4-47aa-aea3-373b50b4c913 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:21.431228537 +0000 UTC m=+252.227385652 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs") pod "network-metrics-daemon-2pf29" (UID: "b987acf2-53b4-47aa-aea3-373b50b4c913") : secret "metrics-daemon-secret" not found Jun 11 18:30:47.000714 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:47.000675 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7xk77" podUID="e45fcb05-37e4-40ef-a025-65efa8a866f2" Jun 11 18:30:47.235594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:30:47.235564 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xk77" Jun 11 18:30:47.685509 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:47.685461 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2pf29" podUID="b987acf2-53b4-47aa-aea3-373b50b4c913" Jun 11 18:30:51.843627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:30:51.843586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:30:51.844034 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:51.843712 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:30:51.844034 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:30:51.843772 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls podName:e45fcb05-37e4-40ef-a025-65efa8a866f2 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:53.843759212 +0000 UTC m=+284.639916326 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls") pod "dns-default-7xk77" (UID: "e45fcb05-37e4-40ef-a025-65efa8a866f2") : secret "dns-default-metrics-tls" not found Jun 11 18:31:00.666749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:00.666663 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:31:06.945813 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:06.945769 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" podUID="7b6865d3-0434-4bba-bda7-f2d9358758e7" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 11 18:31:07.294822 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:07.294720 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b6865d3-0434-4bba-bda7-f2d9358758e7" containerID="f1fa7016ebb9ad67ab0315fc2e6c01dae0bb5a5b48b428d3f809daa029ac7a68" exitCode=1 Jun 11 18:31:07.294822 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:07.294786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerDied","Data":"f1fa7016ebb9ad67ab0315fc2e6c01dae0bb5a5b48b428d3f809daa029ac7a68"} Jun 11 18:31:07.295197 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:07.295165 2568 scope.go:117] "RemoveContainer" containerID="f1fa7016ebb9ad67ab0315fc2e6c01dae0bb5a5b48b428d3f809daa029ac7a68" Jun 11 18:31:08.299202 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:08.299165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerStarted","Data":"982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63"} Jun 11 18:31:08.299674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:08.299448 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:31:08.300086 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:08.300071 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:31:46.068704 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.068671 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pctcb"] Jun 11 18:31:46.071880 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.071860 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.074180 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.074158 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 18:31:46.074306 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.074280 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 18:31:46.074624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.074607 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 18:31:46.074717 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.074612 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 18:31:46.075389 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.075376 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrdf4\"" Jun 11 18:31:46.083925 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.083903 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pctcb"] Jun 11 18:31:46.119081 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.119052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.119081 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.119085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82374c23-7c3b-4ff9-bd89-08320f49240a-crio-socket\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.119244 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.119110 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82374c23-7c3b-4ff9-bd89-08320f49240a-data-volume\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.119244 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.119188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.119244 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.119232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7h4j\" (UniqueName: \"kubernetes.io/projected/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-api-access-n7h4j\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220377 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7h4j\" (UniqueName: \"kubernetes.io/projected/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-api-access-n7h4j\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82374c23-7c3b-4ff9-bd89-08320f49240a-crio-socket\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220442 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82374c23-7c3b-4ff9-bd89-08320f49240a-data-volume\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.220517 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82374c23-7c3b-4ff9-bd89-08320f49240a-crio-socket\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.220594 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.220592 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.220888 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.220617 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.72059768 +0000 UTC m=+217.516754794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.220888 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.220637 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.720626162 +0000 UTC m=+217.516783277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.220888 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.220851 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82374c23-7c3b-4ff9-bd89-08320f49240a-data-volume\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.229988 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.229958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7h4j\" (UniqueName: \"kubernetes.io/projected/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-api-access-n7h4j\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.723484 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.723431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.723648 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:46.723543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:46.723648 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.723559 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.723648 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.723635 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.723618722 +0000 UTC m=+218.519775843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.723648 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.723640 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.723793 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:46.723692 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.723676525 +0000 UTC m=+218.519833662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:47.731143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:47.731101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:47.731555 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:47.731230 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:47.731555 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:47.731291 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.731273674 +0000 UTC m=+220.527430791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:47.731555 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:47.731540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:47.731689 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:47.731640 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:47.731725 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:47.731693 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.731681393 +0000 UTC m=+220.527838508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:48.652360 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:48.652335 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mjc2_64d37b91-8e59-46cf-a224-2b7ae49175ac/dns-node-resolver/0.log" Jun 11 18:31:49.746325 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:49.746298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:49.746720 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:49.746332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:49.746720 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:49.746409 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:49.746720 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:49.746444 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:49.746720 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:49.746486 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.74645278 +0000 UTC m=+224.542609895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:49.746720 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:49.746514 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.746503843 +0000 UTC m=+224.542660976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:50.049735 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:50.049711 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwdph_a3b11f73-8ed0-4dda-9f78-44277270153d/node-ca/0.log" Jun 11 18:31:50.850777 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:50.850753 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz966_1b13a704-4238-416e-8b90-f250ccab9209/serve-healthcheck-canary/0.log" Jun 11 18:31:53.773766 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:53.773733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:53.774281 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:31:53.773810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:31:53.774281 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:53.773868 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:53.774281 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:53.773899 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:53.774281 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:53.773956 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.773936101 +0000 UTC m=+232.570093217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:53.774281 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:31:53.773978 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls podName:82374c23-7c3b-4ff9-bd89-08320f49240a nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.773969764 +0000 UTC m=+232.570126886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pctcb" (UID: "82374c23-7c3b-4ff9-bd89-08320f49240a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:32:01.830432 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:01.830386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:32:01.830889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:01.830488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:32:01.830889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:01.830864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82374c23-7c3b-4ff9-bd89-08320f49240a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:32:01.832565 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:01.832549 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82374c23-7c3b-4ff9-bd89-08320f49240a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pctcb\" (UID: \"82374c23-7c3b-4ff9-bd89-08320f49240a\") " pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:32:01.980592 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:01.980555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pctcb" Jun 11 18:32:02.098029 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:02.097949 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pctcb"] Jun 11 18:32:02.100862 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:02.100833 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82374c23_7c3b_4ff9_bd89_08320f49240a.slice/crio-8f5fdfca0c0c5a0832baf56c2a4c46a8c5c8b4e3833f1aed867c613221830811 WatchSource:0}: Error finding container 8f5fdfca0c0c5a0832baf56c2a4c46a8c5c8b4e3833f1aed867c613221830811: Status 404 returned error can't find the container with id 8f5fdfca0c0c5a0832baf56c2a4c46a8c5c8b4e3833f1aed867c613221830811 Jun 11 18:32:02.452976 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:02.452899 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pctcb" event={"ID":"82374c23-7c3b-4ff9-bd89-08320f49240a","Type":"ContainerStarted","Data":"8f5fdfca0c0c5a0832baf56c2a4c46a8c5c8b4e3833f1aed867c613221830811"} Jun 11 18:32:06.466381 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:06.466348 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pctcb" event={"ID":"82374c23-7c3b-4ff9-bd89-08320f49240a","Type":"ContainerStarted","Data":"bcf17201b614fdc63eef160a2de3bd7e02633a8b3e8af35bec85730fa6b0d1b1"} Jun 11 18:32:06.466766 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:06.466407 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pctcb" event={"ID":"82374c23-7c3b-4ff9-bd89-08320f49240a","Type":"ContainerStarted","Data":"fff4c28efd052f27a7b010953303795f81cad138fb9a4e987ea7296b4656eb4d"} Jun 11 18:32:08.473960 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:08.473926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pctcb" event={"ID":"82374c23-7c3b-4ff9-bd89-08320f49240a","Type":"ContainerStarted","Data":"e3e776dff6f9f1386b1653cfb6276253cabec5a769cb0b7c4c174fbb38cd4920"} Jun 11 18:32:08.491420 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:08.491376 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pctcb" podStartSLOduration=16.845136798 podStartE2EDuration="22.491360735s" totalImagesPullingTime="5.646223937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:31:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:08.491347761 +0000 UTC m=+239.287504922" watchObservedRunningTime="2026-06-11 18:32:08.491360735 +0000 UTC m=+239.287517863" Jun 11 18:32:09.787344 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.787312 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-kwslm"] Jun 11 18:32:09.790097 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.790081 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:09.793190 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.793168 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 18:32:09.793323 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.793304 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 18:32:09.793535 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.793522 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nxjvw\"" Jun 11 18:32:09.804015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.803994 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-kwslm"] Jun 11 18:32:09.892684 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.892655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l2p2\" (UniqueName: \"kubernetes.io/projected/1fca2e18-81dc-44c5-99c8-fdd8a4f625d0-kube-api-access-4l2p2\") pod \"downloads-694c955b9-kwslm\" (UID: \"1fca2e18-81dc-44c5-99c8-fdd8a4f625d0\") " pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:09.993296 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:09.993268 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l2p2\" (UniqueName: \"kubernetes.io/projected/1fca2e18-81dc-44c5-99c8-fdd8a4f625d0-kube-api-access-4l2p2\") pod \"downloads-694c955b9-kwslm\" (UID: \"1fca2e18-81dc-44c5-99c8-fdd8a4f625d0\") " pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:10.006448 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:10.006418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l2p2\" (UniqueName: \"kubernetes.io/projected/1fca2e18-81dc-44c5-99c8-fdd8a4f625d0-kube-api-access-4l2p2\") pod \"downloads-694c955b9-kwslm\" (UID: \"1fca2e18-81dc-44c5-99c8-fdd8a4f625d0\") " pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:10.097974 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:10.097949 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:10.217209 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:10.217179 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-kwslm"] Jun 11 18:32:10.219797 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:10.219771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca2e18_81dc_44c5_99c8_fdd8a4f625d0.slice/crio-7c4d7d684f4bf5b9e67e1ed3212468812a8a999a5f9a703f3a7f169528f29ba2 WatchSource:0}: Error finding container 7c4d7d684f4bf5b9e67e1ed3212468812a8a999a5f9a703f3a7f169528f29ba2: Status 404 returned error can't find the container with id 7c4d7d684f4bf5b9e67e1ed3212468812a8a999a5f9a703f3a7f169528f29ba2 Jun 11 18:32:10.480250 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:10.480167 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-kwslm" event={"ID":"1fca2e18-81dc-44c5-99c8-fdd8a4f625d0","Type":"ContainerStarted","Data":"7c4d7d684f4bf5b9e67e1ed3212468812a8a999a5f9a703f3a7f169528f29ba2"} Jun 11 18:32:13.775845 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.775809 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:32:13.779605 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.779583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.782456 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.782430 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:32:13.782744 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.782722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:32:13.782856 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.782771 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rx75w\"" Jun 11 18:32:13.783627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.783572 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:32:13.783734 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.783704 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:32:13.783892 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.783873 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:32:13.788276 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.788249 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:32:13.924114 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.924262 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.924262 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zmg\" (UniqueName: \"kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.924262 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.924262 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:13.924394 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:13.924271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025480 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025480 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zmg\" (UniqueName: \"kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.025723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.025694 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.026461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.026401 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.026613 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.026538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.026613 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.026556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.028249 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.028205 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.028249 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.028217 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.034233 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.034210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zmg\" (UniqueName: \"kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg\") pod \"console-7f5c456d76-x4pfp\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.090252 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.090226 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:14.216562 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.216516 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:32:14.220171 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:14.220139 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4185f89_cd80_43f7_8e18_27222e1d6452.slice/crio-3fedba19e55aafbe917601614a24614cbec4def89608daee98e38e10face17f8 WatchSource:0}: Error finding container 3fedba19e55aafbe917601614a24614cbec4def89608daee98e38e10face17f8: Status 404 returned error can't find the container with id 3fedba19e55aafbe917601614a24614cbec4def89608daee98e38e10face17f8 Jun 11 18:32:14.494535 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:14.494498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c456d76-x4pfp" event={"ID":"d4185f89-cd80-43f7-8e18-27222e1d6452","Type":"ContainerStarted","Data":"3fedba19e55aafbe917601614a24614cbec4def89608daee98e38e10face17f8"} Jun 11 18:32:17.505906 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:17.505876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c456d76-x4pfp" event={"ID":"d4185f89-cd80-43f7-8e18-27222e1d6452","Type":"ContainerStarted","Data":"2d4c270a7aa2a95eeb643c9fe300b83a476f3e1707b084c1c878a4edd77dfe7c"} Jun 11 18:32:17.528961 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:17.528902 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5c456d76-x4pfp" podStartSLOduration=1.327664833 podStartE2EDuration="4.528881086s" totalImagesPullingTime="3.201216253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:17.528164007 +0000 UTC m=+248.324321186" watchObservedRunningTime="2026-06-11 18:32:17.528881086 +0000 UTC m=+248.325038225" Jun 11 18:32:21.483947 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:21.483909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:32:21.486126 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:21.486106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b987acf2-53b4-47aa-aea3-373b50b4c913-metrics-certs\") pod \"network-metrics-daemon-2pf29\" (UID: \"b987acf2-53b4-47aa-aea3-373b50b4c913\") " pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:32:21.670043 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:21.670003 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:32:21.677264 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:21.677231 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2pf29" Jun 11 18:32:21.803159 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:21.803128 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2pf29"] Jun 11 18:32:21.806486 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:21.806445 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb987acf2_53b4_47aa_aea3_373b50b4c913.slice/crio-3b56ea2b2efdcdd7fbb901d40d27ee18d7686e2cc5fcdef43c7aa4ac44029545 WatchSource:0}: Error finding container 3b56ea2b2efdcdd7fbb901d40d27ee18d7686e2cc5fcdef43c7aa4ac44029545: Status 404 returned error can't find the container with id 3b56ea2b2efdcdd7fbb901d40d27ee18d7686e2cc5fcdef43c7aa4ac44029545 Jun 11 18:32:22.527295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:22.527243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pf29" event={"ID":"b987acf2-53b4-47aa-aea3-373b50b4c913","Type":"ContainerStarted","Data":"3b56ea2b2efdcdd7fbb901d40d27ee18d7686e2cc5fcdef43c7aa4ac44029545"} Jun 11 18:32:23.532749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:23.532718 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pf29" event={"ID":"b987acf2-53b4-47aa-aea3-373b50b4c913","Type":"ContainerStarted","Data":"004b8abfff55072d98252834a99c4289b911e959a98edd1537be68416acc315d"} Jun 11 18:32:23.533130 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:23.532770 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2pf29" event={"ID":"b987acf2-53b4-47aa-aea3-373b50b4c913","Type":"ContainerStarted","Data":"59f3991e505a27f78e49b22545e01b49085ceb93a663497f3855bb0683f2826a"} Jun 11 18:32:23.550738 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:23.550696 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2pf29" podStartSLOduration=253.65460941 podStartE2EDuration="4m14.550683164s" totalImagesPullingTime="896.073754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:23.549577205 +0000 UTC m=+254.345734364" watchObservedRunningTime="2026-06-11 18:32:23.550683164 +0000 UTC m=+254.346840278" Jun 11 18:32:24.091113 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.091075 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:24.091394 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.091144 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:32:24.092768 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.092743 2568 patch_prober.go:28] interesting pod/console-7f5c456d76-x4pfp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 11 18:32:24.092882 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.092793 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f5c456d76-x4pfp" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 11 18:32:24.178249 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.178212 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dd5r"] Jun 11 18:32:24.182608 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.182585 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.185574 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.185549 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 18:32:24.185574 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.185550 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w5qd2\"" Jun 11 18:32:24.185797 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.185591 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 18:32:24.185797 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.185605 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 18:32:24.186542 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.186518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 18:32:24.186654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.186610 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 18:32:24.186654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.186620 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 18:32:24.303697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-textfile\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303722 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-metrics-client-ca\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303786 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-wtmp\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5fnx\" (UniqueName: \"kubernetes.io/projected/fd2d4a57-3940-4733-96ec-2add59ada1b2-kube-api-access-j5fnx\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-sys\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.303931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-root\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.304183 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.303945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-tls\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405071 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.404990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-tls\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405071 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-textfile\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405077 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-metrics-client-ca\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-wtmp\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405508 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405346 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5fnx\" (UniqueName: \"kubernetes.io/projected/fd2d4a57-3940-4733-96ec-2add59ada1b2-kube-api-access-j5fnx\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405508 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-sys\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405508 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-root\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405508 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405492 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-textfile\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405722 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405609 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-wtmp\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405722 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-sys\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd2d4a57-3940-4733-96ec-2add59ada1b2-root\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405761 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.405910 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.405829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd2d4a57-3940-4733-96ec-2add59ada1b2-metrics-client-ca\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.407821 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.407800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-tls\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.408052 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.408024 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd2d4a57-3940-4733-96ec-2add59ada1b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.414348 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.414328 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5fnx\" (UniqueName: \"kubernetes.io/projected/fd2d4a57-3940-4733-96ec-2add59ada1b2-kube-api-access-j5fnx\") pod \"node-exporter-8dd5r\" (UID: \"fd2d4a57-3940-4733-96ec-2add59ada1b2\") " pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:24.493227 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:24.493200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dd5r" Jun 11 18:32:28.915683 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:28.914198 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:32:29.372167 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.372131 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t"] Jun 11 18:32:29.380606 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.380578 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.383618 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383381 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 18:32:29.383618 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383386 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 18:32:29.383618 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383436 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 18:32:29.383618 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383500 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vjgjl\"" Jun 11 18:32:29.383618 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 18:32:29.383950 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.383745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 18:32:29.386613 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.386585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t"] Jun 11 18:32:29.388898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.388876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 18:32:29.551455 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551455 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dkdt\" (UniqueName: \"kubernetes.io/projected/45544c37-40be-43c3-9190-bf1348071c0b-kube-api-access-9dkdt\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-serving-certs-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551601 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-metrics-client-ca\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.551726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.551686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-federate-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652490 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-federate-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652490 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652432 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dkdt\" (UniqueName: \"kubernetes.io/projected/45544c37-40be-43c3-9190-bf1348071c0b-kube-api-access-9dkdt\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-serving-certs-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652877 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652877 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-metrics-client-ca\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.652877 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.652811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.653492 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.653422 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-serving-certs-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.653622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.653566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-metrics-client-ca\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.653823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.653801 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.655591 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.655569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.655772 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.655752 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-federate-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.655816 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.655802 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.655960 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.655935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45544c37-40be-43c3-9190-bf1348071c0b-telemeter-client-tls\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.664250 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.664206 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dkdt\" (UniqueName: \"kubernetes.io/projected/45544c37-40be-43c3-9190-bf1348071c0b-kube-api-access-9dkdt\") pod \"telemeter-client-5fc8c5bc4c-jn56t\" (UID: \"45544c37-40be-43c3-9190-bf1348071c0b\") " pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:29.692950 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:29.692916 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" Jun 11 18:32:30.596083 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:30.596051 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2d4a57_3940_4733_96ec_2add59ada1b2.slice/crio-0c3f95bd3114243ca71264596aaeb586178a9938800aa8b2bdceb735790f83e4 WatchSource:0}: Error finding container 0c3f95bd3114243ca71264596aaeb586178a9938800aa8b2bdceb735790f83e4: Status 404 returned error can't find the container with id 0c3f95bd3114243ca71264596aaeb586178a9938800aa8b2bdceb735790f83e4 Jun 11 18:32:30.720153 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:30.720131 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t"] Jun 11 18:32:30.723148 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:30.723125 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45544c37_40be_43c3_9190_bf1348071c0b.slice/crio-c38a5ee4c81ae142ba24244d6d3fa7dd28554ec9e4a1cf043e4f919763153e73 WatchSource:0}: Error finding container c38a5ee4c81ae142ba24244d6d3fa7dd28554ec9e4a1cf043e4f919763153e73: Status 404 returned error can't find the container with id c38a5ee4c81ae142ba24244d6d3fa7dd28554ec9e4a1cf043e4f919763153e73 Jun 11 18:32:31.565773 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.565688 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dd5r" event={"ID":"fd2d4a57-3940-4733-96ec-2add59ada1b2","Type":"ContainerStarted","Data":"0c3f95bd3114243ca71264596aaeb586178a9938800aa8b2bdceb735790f83e4"} Jun 11 18:32:31.567439 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.567351 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" event={"ID":"45544c37-40be-43c3-9190-bf1348071c0b","Type":"ContainerStarted","Data":"c38a5ee4c81ae142ba24244d6d3fa7dd28554ec9e4a1cf043e4f919763153e73"} Jun 11 18:32:31.577493 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.577452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-kwslm" event={"ID":"1fca2e18-81dc-44c5-99c8-fdd8a4f625d0","Type":"ContainerStarted","Data":"f6fe27186f7423dd3b92c093bf9916c1d34e6802b83f1b230516aba85f5ab61d"} Jun 11 18:32:31.577937 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.577878 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:31.588596 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.588573 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-kwslm" Jun 11 18:32:31.597044 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:31.596998 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-kwslm" podStartSLOduration=2.134377667 podStartE2EDuration="22.596985026s" totalImagesPullingTime="20.462607359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:31.595945973 +0000 UTC m=+262.392103112" watchObservedRunningTime="2026-06-11 18:32:31.596985026 +0000 UTC m=+262.393142164" Jun 11 18:32:32.583569 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:32.583514 2568 generic.go:356] "Generic (PLEG): container finished" podID="fd2d4a57-3940-4733-96ec-2add59ada1b2" containerID="78588a39da5214e1c32d8b5d98d5dadc32fd0f8d72815c7cd4160cd3c3edb906" exitCode=0 Jun 11 18:32:32.583896 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:32.583608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dd5r" event={"ID":"fd2d4a57-3940-4733-96ec-2add59ada1b2","Type":"ContainerDied","Data":"78588a39da5214e1c32d8b5d98d5dadc32fd0f8d72815c7cd4160cd3c3edb906"} Jun 11 18:32:33.591165 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:33.591121 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dd5r" event={"ID":"fd2d4a57-3940-4733-96ec-2add59ada1b2","Type":"ContainerStarted","Data":"6d3948b096599c54783bc59b76a5be2afbba21d53743db583d5fd3ac9ef4b95b"} Jun 11 18:32:33.591640 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:33.591198 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dd5r" event={"ID":"fd2d4a57-3940-4733-96ec-2add59ada1b2","Type":"ContainerStarted","Data":"9b58b8d91f25fd323c7ca37e2b4139ba5b1fc84a32832bf2d39ec6405b665c56"} Jun 11 18:32:33.592942 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:33.592913 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" event={"ID":"45544c37-40be-43c3-9190-bf1348071c0b","Type":"ContainerStarted","Data":"1868989e8a24309ed13d41d76a1a29ca7287391d752e7f056d59b63c6b86fcf8"} Jun 11 18:32:33.610935 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:33.610877 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dd5r" podStartSLOduration=8.01580284 podStartE2EDuration="9.610856814s" totalImagesPullingTime="1.507647541s" totalInitContainerRuntime="87.406433ms" isStatefulPod=true podCreationTimestamp="2026-06-11 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:33.6097362 +0000 UTC m=+264.405893382" watchObservedRunningTime="2026-06-11 18:32:33.610856814 +0000 UTC m=+264.407013953" Jun 11 18:32:35.602965 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:35.602935 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" event={"ID":"45544c37-40be-43c3-9190-bf1348071c0b","Type":"ContainerStarted","Data":"e5d8ebec3e800f3c7d805c5e2cfd90a3185d126d764192d056482fc018ebcf54"} Jun 11 18:32:36.608908 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.608874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" event={"ID":"45544c37-40be-43c3-9190-bf1348071c0b","Type":"ContainerStarted","Data":"06e97de77660b24bdf823e77b2f02076ac6ecf6357c35c326baa7e1f8b73f8cf"} Jun 11 18:32:36.632072 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.632022 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fc8c5bc4c-jn56t" podStartSLOduration=3.218108279 podStartE2EDuration="7.632002777s" totalImagesPullingTime="4.413894498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:36.629561396 +0000 UTC m=+267.425718560" watchObservedRunningTime="2026-06-11 18:32:36.632002777 +0000 UTC m=+267.428159916" Jun 11 18:32:36.749070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.749035 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:32:36.785788 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.785755 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:32:36.786012 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.785813 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.794723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.794691 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:32:36.811945 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.811917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812068 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.811956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812068 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.812020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812165 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.812102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812165 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.812155 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.812182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjssx\" (UniqueName: \"kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.812247 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.812215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913439 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913439 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913454 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjssx\" (UniqueName: \"kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.913663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.913597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.914188 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.914141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.914411 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.914386 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.914876 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.914847 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.915031 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.915008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.916357 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.916330 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.916482 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.916416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:36.924318 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:36.924293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjssx\" (UniqueName: \"kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx\") pod \"console-65945cdd78-vr7r5\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:37.101802 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:37.101768 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:37.292056 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:37.292029 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:32:37.294875 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:37.294852 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb65f074_b2b9_45b5_b6a3_05a2d32164e8.slice/crio-8b5af6a4944f22ac027aa3f88099abb0248af2218eef94d4b1c4c90dfe1ce1e8 WatchSource:0}: Error finding container 8b5af6a4944f22ac027aa3f88099abb0248af2218eef94d4b1c4c90dfe1ce1e8: Status 404 returned error can't find the container with id 8b5af6a4944f22ac027aa3f88099abb0248af2218eef94d4b1c4c90dfe1ce1e8 Jun 11 18:32:37.615132 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:37.615094 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945cdd78-vr7r5" event={"ID":"db65f074-b2b9-45b5-b6a3-05a2d32164e8","Type":"ContainerStarted","Data":"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2"} Jun 11 18:32:37.615632 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:37.615151 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945cdd78-vr7r5" event={"ID":"db65f074-b2b9-45b5-b6a3-05a2d32164e8","Type":"ContainerStarted","Data":"8b5af6a4944f22ac027aa3f88099abb0248af2218eef94d4b1c4c90dfe1ce1e8"} Jun 11 18:32:37.636634 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:37.636578 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65945cdd78-vr7r5" podStartSLOduration=1.636550159 podStartE2EDuration="1.636550159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:37.634265765 +0000 UTC m=+268.430422934" watchObservedRunningTime="2026-06-11 18:32:37.636550159 +0000 UTC m=+268.432707296" Jun 11 18:32:47.102442 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:47.102407 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:47.102933 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:47.102462 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:32:47.103723 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:47.103701 2568 patch_prober.go:28] interesting pod/console-65945cdd78-vr7r5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 11 18:32:47.103818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:47.103741 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65945cdd78-vr7r5" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 11 18:32:50.236122 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:32:50.236080 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7xk77" podUID="e45fcb05-37e4-40ef-a025-65efa8a866f2" Jun 11 18:32:50.661647 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:50.661619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xk77" Jun 11 18:32:53.931012 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:53.930978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:32:53.933287 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:53.933257 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e45fcb05-37e4-40ef-a025-65efa8a866f2-metrics-tls\") pod \"dns-default-7xk77\" (UID: \"e45fcb05-37e4-40ef-a025-65efa8a866f2\") " pod="openshift-dns/dns-default-7xk77" Jun 11 18:32:53.937379 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:53.937344 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5c456d76-x4pfp" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerName="console" containerID="cri-o://2d4c270a7aa2a95eeb643c9fe300b83a476f3e1707b084c1c878a4edd77dfe7c" gracePeriod=15 Jun 11 18:32:53.965726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:53.965701 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:32:53.973928 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:53.973910 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xk77" Jun 11 18:32:54.147616 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:54.147589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xk77"] Jun 11 18:32:54.150977 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:32:54.150955 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45fcb05_37e4_40ef_a025_65efa8a866f2.slice/crio-9fbd9cbe86d45e68d1d9618605a26a2d38deb05248f0888daf9f45822b628f7f WatchSource:0}: Error finding container 9fbd9cbe86d45e68d1d9618605a26a2d38deb05248f0888daf9f45822b628f7f: Status 404 returned error can't find the container with id 9fbd9cbe86d45e68d1d9618605a26a2d38deb05248f0888daf9f45822b628f7f Jun 11 18:32:54.676513 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:54.676458 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xk77" event={"ID":"e45fcb05-37e4-40ef-a025-65efa8a866f2","Type":"ContainerStarted","Data":"9fbd9cbe86d45e68d1d9618605a26a2d38deb05248f0888daf9f45822b628f7f"} Jun 11 18:32:55.682119 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:55.682061 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xk77" event={"ID":"e45fcb05-37e4-40ef-a025-65efa8a866f2","Type":"ContainerStarted","Data":"4d2b9b5021965899151a8398de84885de61ab3f1046f18d232a89ba05d4c14e2"} Jun 11 18:32:55.682119 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:55.682118 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xk77" event={"ID":"e45fcb05-37e4-40ef-a025-65efa8a866f2","Type":"ContainerStarted","Data":"ae31625d4735020294b0e6d6ba66c2280a996d1d3d40c8e7d9eb656ed741e913"} Jun 11 18:32:55.682446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:55.682243 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7xk77" Jun 11 18:32:55.703540 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:55.703486 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7xk77" podStartSLOduration=251.3503022 podStartE2EDuration="4m12.703447636s" totalImagesPullingTime="1.353145436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:55.702627581 +0000 UTC m=+286.498784719" watchObservedRunningTime="2026-06-11 18:32:55.703447636 +0000 UTC m=+286.499604774" Jun 11 18:32:57.102176 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:57.102141 2568 patch_prober.go:28] interesting pod/console-65945cdd78-vr7r5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 11 18:32:57.102564 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:32:57.102204 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65945cdd78-vr7r5" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 11 18:33:01.315788 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:01.315747 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" podUID="7ec9402b-5bb9-4869-ab39-ea38cc11f5cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 18:33:02.706365 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.706331 2568 generic.go:356] "Generic (PLEG): container finished" podID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerID="2d4c270a7aa2a95eeb643c9fe300b83a476f3e1707b084c1c878a4edd77dfe7c" exitCode=0 Jun 11 18:33:02.706690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.706378 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c456d76-x4pfp" event={"ID":"d4185f89-cd80-43f7-8e18-27222e1d6452","Type":"ContainerDied","Data":"2d4c270a7aa2a95eeb643c9fe300b83a476f3e1707b084c1c878a4edd77dfe7c"} Jun 11 18:33:02.824189 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.824160 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:33:02.893844 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.893775 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.893844 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.893811 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.894023 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.893859 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.894023 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.893990 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2zmg\" (UniqueName: \"kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.894102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894036 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.894102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894074 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config\") pod \"d4185f89-cd80-43f7-8e18-27222e1d6452\" (UID: \"d4185f89-cd80-43f7-8e18-27222e1d6452\") " Jun 11 18:33:02.894234 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894208 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:02.894234 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894216 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:02.894390 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894292 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-service-ca\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:02.894390 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894309 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-oauth-serving-cert\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:02.894519 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.894498 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config" (OuterVolumeSpecName: "console-config") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:02.896083 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.896052 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:02.896083 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.896073 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:02.896215 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.896100 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg" (OuterVolumeSpecName: "kube-api-access-v2zmg") pod "d4185f89-cd80-43f7-8e18-27222e1d6452" (UID: "d4185f89-cd80-43f7-8e18-27222e1d6452"). InnerVolumeSpecName "kube-api-access-v2zmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:02.995622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.995586 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2zmg\" (UniqueName: \"kubernetes.io/projected/d4185f89-cd80-43f7-8e18-27222e1d6452-kube-api-access-v2zmg\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:02.995622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.995615 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4185f89-cd80-43f7-8e18-27222e1d6452-console-config\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:02.995622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.995626 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-oauth-config\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:02.995838 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:02.995636 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4185f89-cd80-43f7-8e18-27222e1d6452-console-serving-cert\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:33:03.711264 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:03.711234 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c456d76-x4pfp" event={"ID":"d4185f89-cd80-43f7-8e18-27222e1d6452","Type":"ContainerDied","Data":"3fedba19e55aafbe917601614a24614cbec4def89608daee98e38e10face17f8"} Jun 11 18:33:03.711264 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:03.711265 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c456d76-x4pfp" Jun 11 18:33:03.711709 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:03.711290 2568 scope.go:117] "RemoveContainer" containerID="2d4c270a7aa2a95eeb643c9fe300b83a476f3e1707b084c1c878a4edd77dfe7c" Jun 11 18:33:03.728097 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:03.728077 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:33:03.732209 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:03.732189 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5c456d76-x4pfp"] Jun 11 18:33:05.671413 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:05.671379 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" path="/var/lib/kubelet/pods/d4185f89-cd80-43f7-8e18-27222e1d6452/volumes" Jun 11 18:33:05.688316 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:05.688291 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7xk77" Jun 11 18:33:07.106360 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.106334 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:33:07.110314 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.110296 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:33:07.726323 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.726289 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b6865d3-0434-4bba-bda7-f2d9358758e7" containerID="982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63" exitCode=1 Jun 11 18:33:07.726481 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.726360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerDied","Data":"982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63"} Jun 11 18:33:07.726481 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.726410 2568 scope.go:117] "RemoveContainer" containerID="f1fa7016ebb9ad67ab0315fc2e6c01dae0bb5a5b48b428d3f809daa029ac7a68" Jun 11 18:33:07.726813 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:07.726794 2568 scope.go:117] "RemoveContainer" containerID="982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63" Jun 11 18:33:07.727036 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:33:07.727004 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5ffff95f64-22vhl_open-cluster-management-agent-addon(7b6865d3-0434-4bba-bda7-f2d9358758e7)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" podUID="7b6865d3-0434-4bba-bda7-f2d9358758e7" Jun 11 18:33:08.299643 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:08.299609 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:33:08.731612 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:08.731539 2568 scope.go:117] "RemoveContainer" containerID="982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63" Jun 11 18:33:08.731750 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:33:08.731726 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5ffff95f64-22vhl_open-cluster-management-agent-addon(7b6865d3-0434-4bba-bda7-f2d9358758e7)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" podUID="7b6865d3-0434-4bba-bda7-f2d9358758e7" Jun 11 18:33:09.621516 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:09.621492 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 18:33:11.155649 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.155590 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/init-textfile/0.log" Jun 11 18:33:11.315090 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.315054 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" podUID="7ec9402b-5bb9-4869-ab39-ea38cc11f5cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 18:33:11.322213 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.322194 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:33:11.322576 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.322561 2568 scope.go:117] "RemoveContainer" containerID="982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63" Jun 11 18:33:11.322768 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:33:11.322746 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5ffff95f64-22vhl_open-cluster-management-agent-addon(7b6865d3-0434-4bba-bda7-f2d9358758e7)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" podUID="7b6865d3-0434-4bba-bda7-f2d9358758e7" Jun 11 18:33:11.354785 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.354767 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/node-exporter/0.log" Jun 11 18:33:11.555187 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:11.555163 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/kube-rbac-proxy/0.log" Jun 11 18:33:15.555346 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:15.555319 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/telemeter-client/0.log" Jun 11 18:33:15.754640 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:15.754605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/reload/0.log" Jun 11 18:33:15.955542 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:15.955457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/kube-rbac-proxy/0.log" Jun 11 18:33:17.955888 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:17.955852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65945cdd78-vr7r5_db65f074-b2b9-45b5-b6a3-05a2d32164e8/console/0.log" Jun 11 18:33:18.356643 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:18.356613 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-kwslm_1fca2e18-81dc-44c5-99c8-fdd8a4f625d0/download-server/0.log" Jun 11 18:33:19.355889 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:19.355862 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xk77_e45fcb05-37e4-40ef-a025-65efa8a866f2/dns/0.log" Jun 11 18:33:19.557344 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:19.557312 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xk77_e45fcb05-37e4-40ef-a025-65efa8a866f2/kube-rbac-proxy/0.log" Jun 11 18:33:19.757431 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:19.757346 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mjc2_64d37b91-8e59-46cf-a224-2b7ae49175ac/dns-node-resolver/0.log" Jun 11 18:33:21.160155 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.160130 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwdph_a3b11f73-8ed0-4dda-9f78-44277270153d/node-ca/0.log" Jun 11 18:33:21.315350 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.315308 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" podUID="7ec9402b-5bb9-4869-ab39-ea38cc11f5cb" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 18:33:21.315564 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.315398 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" Jun 11 18:33:21.315966 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.315931 2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c4a9669adc7447ac57656c57364f24f73f820e0494e4a9bb5f0624ba905b824d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 18:33:21.316066 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.315991 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" podUID="7ec9402b-5bb9-4869-ab39-ea38cc11f5cb" containerName="service-proxy" containerID="cri-o://c4a9669adc7447ac57656c57364f24f73f820e0494e4a9bb5f0624ba905b824d" gracePeriod=30 Jun 11 18:33:21.779353 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.779264 2568 generic.go:356] "Generic (PLEG): container finished" podID="7ec9402b-5bb9-4869-ab39-ea38cc11f5cb" containerID="c4a9669adc7447ac57656c57364f24f73f820e0494e4a9bb5f0624ba905b824d" exitCode=2 Jun 11 18:33:21.779353 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.779333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerDied","Data":"c4a9669adc7447ac57656c57364f24f73f820e0494e4a9bb5f0624ba905b824d"} Jun 11 18:33:21.779566 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.779379 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bd7554cdb-pv2p9" event={"ID":"7ec9402b-5bb9-4869-ab39-ea38cc11f5cb","Type":"ContainerStarted","Data":"e8648bc85e0cc6b5e185734d3aae846171b1117e8f8ccfd688c4b3e3c64eeed4"} Jun 11 18:33:21.955021 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:21.954994 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz966_1b13a704-4238-416e-8b90-f250ccab9209/serve-healthcheck-canary/0.log" Jun 11 18:33:22.667070 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:22.667039 2568 scope.go:117] "RemoveContainer" containerID="982efe8b70acfdc835892717bbdaabdcab0cc7cf83e33d67b8c4a4c38b19ef63" Jun 11 18:33:22.785382 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:22.785338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" event={"ID":"7b6865d3-0434-4bba-bda7-f2d9358758e7","Type":"ContainerStarted","Data":"4c89129fdc346e0263e7851381f72f050f3fd3b63660da1e51f5912ea623e24a"} Jun 11 18:33:22.785870 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:22.785728 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:33:22.787154 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:33:22.787126 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5ffff95f64-22vhl" Jun 11 18:34:15.149595 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:15.149520 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:34:40.168643 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.168601 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65945cdd78-vr7r5" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" containerID="cri-o://cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2" gracePeriod=15 Jun 11 18:34:40.408078 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.408055 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:34:40.482908 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.482838 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.482908 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.482894 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483076 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.482918 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483076 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.482954 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483076 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.482996 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483076 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483028 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjssx\" (UniqueName: \"kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483076 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483064 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config\") pod \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\" (UID: \"db65f074-b2b9-45b5-b6a3-05a2d32164e8\") " Jun 11 18:34:40.483420 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483318 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:34:40.483420 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483351 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:34:40.483420 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483388 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config" (OuterVolumeSpecName: "console-config") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:34:40.483606 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.483458 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:34:40.485281 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.485251 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx" (OuterVolumeSpecName: "kube-api-access-pjssx") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "kube-api-access-pjssx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:34:40.485281 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.485264 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:34:40.485446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.485346 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "db65f074-b2b9-45b5-b6a3-05a2d32164e8" (UID: "db65f074-b2b9-45b5-b6a3-05a2d32164e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:34:40.584245 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584213 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-trusted-ca-bundle\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584245 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584237 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-serving-cert\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584245 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584247 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjssx\" (UniqueName: \"kubernetes.io/projected/db65f074-b2b9-45b5-b6a3-05a2d32164e8-kube-api-access-pjssx\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584256 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-oauth-config\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584268 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-oauth-serving-cert\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584277 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-service-ca\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:40.584461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:40.584285 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db65f074-b2b9-45b5-b6a3-05a2d32164e8-console-config\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:34:41.046357 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.046321 2568 generic.go:356] "Generic (PLEG): container finished" podID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerID="cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2" exitCode=0 Jun 11 18:34:41.046357 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.046354 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65945cdd78-vr7r5" Jun 11 18:34:41.046586 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.046402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945cdd78-vr7r5" event={"ID":"db65f074-b2b9-45b5-b6a3-05a2d32164e8","Type":"ContainerDied","Data":"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2"} Jun 11 18:34:41.046586 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.046450 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65945cdd78-vr7r5" event={"ID":"db65f074-b2b9-45b5-b6a3-05a2d32164e8","Type":"ContainerDied","Data":"8b5af6a4944f22ac027aa3f88099abb0248af2218eef94d4b1c4c90dfe1ce1e8"} Jun 11 18:34:41.046586 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.046486 2568 scope.go:117] "RemoveContainer" containerID="cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2" Jun 11 18:34:41.054646 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.054537 2568 scope.go:117] "RemoveContainer" containerID="cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2" Jun 11 18:34:41.054863 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:34:41.054840 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2\": container with ID starting with cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2 not found: ID does not exist" containerID="cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2" Jun 11 18:34:41.054947 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.054874 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2"} err="failed to get container status \"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2\": rpc error: code = NotFound desc = could not find container \"cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2\": container with ID starting with cfd1c9b3b1f1f065191d71e8f0f9a3dac32aed54d4143b4b1d9cbfb68a6216a2 not found: ID does not exist" Jun 11 18:34:41.067895 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.067871 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:34:41.071911 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.071890 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65945cdd78-vr7r5"] Jun 11 18:34:41.670645 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:34:41.670613 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" path="/var/lib/kubelet/pods/db65f074-b2b9-45b5-b6a3-05a2d32164e8/volumes" Jun 11 18:35:06.414142 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414107 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq"] Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414346 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414358 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414376 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerName="console" Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414381 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerName="console" Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414432 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db65f074-b2b9-45b5-b6a3-05a2d32164e8" containerName="console" Jun 11 18:35:06.414627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.414442 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4185f89-cd80-43f7-8e18-27222e1d6452" containerName="console" Jun 11 18:35:06.416381 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.416364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.418855 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.418837 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 18:35:06.418984 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.418860 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:35:06.419033 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.418978 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k9hcb\"" Jun 11 18:35:06.432628 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.432595 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq"] Jun 11 18:35:06.455446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.455416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtn8\" (UniqueName: \"kubernetes.io/projected/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-kube-api-access-xhtn8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.455587 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.455460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.556150 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.556111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.556307 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.556184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtn8\" (UniqueName: \"kubernetes.io/projected/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-kube-api-access-xhtn8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.556519 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.556496 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.567794 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.567763 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtn8\" (UniqueName: \"kubernetes.io/projected/8877c47d-c531-4a1e-b3a6-9021fb85d7c6-kube-api-access-xhtn8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4wjlq\" (UID: \"8877c47d-c531-4a1e-b3a6-9021fb85d7c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.725602 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.725509 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" Jun 11 18:35:06.867100 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.867042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq"] Jun 11 18:35:06.869890 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:35:06.869856 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8877c47d_c531_4a1e_b3a6_9021fb85d7c6.slice/crio-b8e468d1e410f9590b0af3217332cba00d930030126f49facddd1c07ac2cd6ef WatchSource:0}: Error finding container b8e468d1e410f9590b0af3217332cba00d930030126f49facddd1c07ac2cd6ef: Status 404 returned error can't find the container with id b8e468d1e410f9590b0af3217332cba00d930030126f49facddd1c07ac2cd6ef Jun 11 18:35:06.872521 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:06.872503 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:35:07.133244 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:07.133207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" event={"ID":"8877c47d-c531-4a1e-b3a6-9021fb85d7c6","Type":"ContainerStarted","Data":"b8e468d1e410f9590b0af3217332cba00d930030126f49facddd1c07ac2cd6ef"} Jun 11 18:35:11.150149 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:11.150108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" event={"ID":"8877c47d-c531-4a1e-b3a6-9021fb85d7c6","Type":"ContainerStarted","Data":"39f65369f39acd02c86ed040a2bc91d86ea3a7d466e43dbded0dbdfd10d58cc1"} Jun 11 18:35:11.173255 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:11.173187 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4wjlq" podStartSLOduration=1.640446813 podStartE2EDuration="5.173168974s" totalImagesPullingTime="3.532722161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:11.172108342 +0000 UTC m=+421.968265498" watchObservedRunningTime="2026-06-11 18:35:11.173168974 +0000 UTC m=+421.969326111" Jun 11 18:35:22.606588 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.606053 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-t4b9r"] Jun 11 18:35:22.610252 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.610222 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.612744 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.612721 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 18:35:22.613862 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.613839 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hmz75\"" Jun 11 18:35:22.614006 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.613877 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 18:35:22.617928 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.617902 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-t4b9r"] Jun 11 18:35:22.672156 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.672124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-bound-sa-token\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.672291 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.672166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gwl\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-kube-api-access-59gwl\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.772852 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.772813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-bound-sa-token\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.773008 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.772864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gwl\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-kube-api-access-59gwl\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.781057 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.781023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-bound-sa-token\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.781303 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.781279 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gwl\" (UniqueName: \"kubernetes.io/projected/89b0c6a6-3957-4376-a36e-33ac897b43ae-kube-api-access-59gwl\") pod \"cert-manager-59c77684cc-t4b9r\" (UID: \"89b0c6a6-3957-4376-a36e-33ac897b43ae\") " pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:22.919525 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:22.919408 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-t4b9r" Jun 11 18:35:23.040903 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:23.040795 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-t4b9r"] Jun 11 18:35:23.043515 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:35:23.043484 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89b0c6a6_3957_4376_a36e_33ac897b43ae.slice/crio-41ede3d98feb32ba0e2159cbcba29d762c7a8d0fea8b31655ca1017b880bbcaf WatchSource:0}: Error finding container 41ede3d98feb32ba0e2159cbcba29d762c7a8d0fea8b31655ca1017b880bbcaf: Status 404 returned error can't find the container with id 41ede3d98feb32ba0e2159cbcba29d762c7a8d0fea8b31655ca1017b880bbcaf Jun 11 18:35:23.191225 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:23.191139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-t4b9r" event={"ID":"89b0c6a6-3957-4376-a36e-33ac897b43ae","Type":"ContainerStarted","Data":"41ede3d98feb32ba0e2159cbcba29d762c7a8d0fea8b31655ca1017b880bbcaf"} Jun 11 18:35:25.784172 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.784092 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz"] Jun 11 18:35:25.787082 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.787066 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:25.789537 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.789518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 18:35:25.790616 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.790604 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:35:25.790616 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.790610 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9fv5w\"" Jun 11 18:35:25.795966 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.795946 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz"] Jun 11 18:35:25.898502 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.898451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760c6c9-b72f-43b0-8c6e-e3154f010e59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:25.898662 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.898544 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9h97\" (UniqueName: \"kubernetes.io/projected/3760c6c9-b72f-43b0-8c6e-e3154f010e59-kube-api-access-f9h97\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:25.999449 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.999409 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9h97\" (UniqueName: \"kubernetes.io/projected/3760c6c9-b72f-43b0-8c6e-e3154f010e59-kube-api-access-f9h97\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:25.999449 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.999453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760c6c9-b72f-43b0-8c6e-e3154f010e59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:25.999828 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:25.999808 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760c6c9-b72f-43b0-8c6e-e3154f010e59-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:26.007411 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:26.007391 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9h97\" (UniqueName: \"kubernetes.io/projected/3760c6c9-b72f-43b0-8c6e-e3154f010e59-kube-api-access-f9h97\") pod \"openshift-lws-operator-fd8ccff4c-2jjpz\" (UID: \"3760c6c9-b72f-43b0-8c6e-e3154f010e59\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:26.096245 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:26.096209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" Jun 11 18:35:26.206916 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:26.206885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-t4b9r" event={"ID":"89b0c6a6-3957-4376-a36e-33ac897b43ae","Type":"ContainerStarted","Data":"c6358f9553a9b0613f7904aa848bb96d40b342d69e09ebc15528918b41781c5c"} Jun 11 18:35:26.220189 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:26.220162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz"] Jun 11 18:35:26.222443 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:26.222400 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-t4b9r" podStartSLOduration=1.7872035450000001 podStartE2EDuration="4.222386534s" totalImagesPullingTime="2.435182989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:26.221625983 +0000 UTC m=+437.017783143" watchObservedRunningTime="2026-06-11 18:35:26.222386534 +0000 UTC m=+437.018543670" Jun 11 18:35:26.223795 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:35:26.223765 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3760c6c9_b72f_43b0_8c6e_e3154f010e59.slice/crio-9e71d26f02958ee8b705d90889d21ef5e89bc0539c77ca2946214f005ad71032 WatchSource:0}: Error finding container 9e71d26f02958ee8b705d90889d21ef5e89bc0539c77ca2946214f005ad71032: Status 404 returned error can't find the container with id 9e71d26f02958ee8b705d90889d21ef5e89bc0539c77ca2946214f005ad71032 Jun 11 18:35:27.212366 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:27.212331 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" event={"ID":"3760c6c9-b72f-43b0-8c6e-e3154f010e59","Type":"ContainerStarted","Data":"9e71d26f02958ee8b705d90889d21ef5e89bc0539c77ca2946214f005ad71032"} Jun 11 18:35:30.226982 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:30.226949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" event={"ID":"3760c6c9-b72f-43b0-8c6e-e3154f010e59","Type":"ContainerStarted","Data":"0ceca23b0f3b7d3ef078c5dcb3b969490746e35f375a10b7ddcb2289fea40783"} Jun 11 18:35:30.242031 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:30.241974 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjpz" podStartSLOduration=2.266487539 podStartE2EDuration="5.241953765s" totalImagesPullingTime="2.975466226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:30.241689532 +0000 UTC m=+441.037846670" watchObservedRunningTime="2026-06-11 18:35:30.241953765 +0000 UTC m=+441.038110902" Jun 11 18:35:49.715405 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.715367 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv"] Jun 11 18:35:49.720719 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.720700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.723426 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.723401 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 18:35:49.723426 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.723417 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 18:35:49.723675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.723463 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 18:35:49.723675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.723495 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 18:35:49.723675 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.723486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sgm5f\"" Jun 11 18:35:49.735374 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.735351 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv"] Jun 11 18:35:49.891181 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.891147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.891398 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.891186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.891398 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.891301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.891398 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.891341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.891398 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.891369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfj8\" (UniqueName: \"kubernetes.io/projected/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-kube-api-access-dvfj8\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.992856 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.992769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.992856 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.992809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.992856 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.992844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.993094 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.992861 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.993094 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.992877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfj8\" (UniqueName: \"kubernetes.io/projected/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-kube-api-access-dvfj8\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.993256 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.993229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.995288 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.995263 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.995397 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.995332 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:49.995397 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:49.995388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:50.000854 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:50.000825 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfj8\" (UniqueName: \"kubernetes.io/projected/7b4ec65b-d380-4fd7-ba1d-08eca39eab1f-kube-api-access-dvfj8\") pod \"opendatahub-operator-controller-manager-699bfcf455-85tlv\" (UID: \"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:50.030840 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:50.030805 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:50.162858 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:50.162832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv"] Jun 11 18:35:50.165457 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:35:50.165430 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4ec65b_d380_4fd7_ba1d_08eca39eab1f.slice/crio-6cd70b937a11f4e9198e52f265e245ad1a02c7a38524c91c41b3a1558659ef12 WatchSource:0}: Error finding container 6cd70b937a11f4e9198e52f265e245ad1a02c7a38524c91c41b3a1558659ef12: Status 404 returned error can't find the container with id 6cd70b937a11f4e9198e52f265e245ad1a02c7a38524c91c41b3a1558659ef12 Jun 11 18:35:50.310093 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:50.310056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" event={"ID":"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f","Type":"ContainerStarted","Data":"6cd70b937a11f4e9198e52f265e245ad1a02c7a38524c91c41b3a1558659ef12"} Jun 11 18:35:54.327857 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:54.327821 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" event={"ID":"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f","Type":"ContainerStarted","Data":"22270f8f4e420f4c5828b09e41042d662da9eca88431fb9c710b1dcd290dc7bd"} Jun 11 18:35:55.332458 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:55.332425 2568 generic.go:356] "Generic (PLEG): container finished" podID="7b4ec65b-d380-4fd7-ba1d-08eca39eab1f" containerID="22270f8f4e420f4c5828b09e41042d662da9eca88431fb9c710b1dcd290dc7bd" exitCode=0 Jun 11 18:35:55.332857 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:55.332499 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" event={"ID":"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f","Type":"ContainerDied","Data":"22270f8f4e420f4c5828b09e41042d662da9eca88431fb9c710b1dcd290dc7bd"} Jun 11 18:35:56.338100 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:56.338068 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" event={"ID":"7b4ec65b-d380-4fd7-ba1d-08eca39eab1f","Type":"ContainerStarted","Data":"3a39b766f46102224649ba2a131d0a0dd2ca7003f5f832fd018885ed317470dd"} Jun 11 18:35:56.338538 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:56.338174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:35:56.359566 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:35:56.359514 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" podStartSLOduration=2.773743234 podStartE2EDuration="7.35949869s" totalImagesPullingTime="3.615726558s" totalInitContainerRuntime="970.028898ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:56.357132887 +0000 UTC m=+467.153290036" watchObservedRunningTime="2026-06-11 18:35:56.35949869 +0000 UTC m=+467.155655892" Jun 11 18:36:07.344000 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:07.343969 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-85tlv" Jun 11 18:36:14.689795 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.689761 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s"] Jun 11 18:36:14.693296 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.693278 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.696027 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.696003 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 18:36:14.697054 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.697025 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 18:36:14.697169 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.697067 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 18:36:14.697169 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.697112 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7txr4\"" Jun 11 18:36:14.697287 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.697189 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 18:36:14.702335 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.702303 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s"] Jun 11 18:36:14.765793 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.765763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tmp\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.765987 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.765820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.765987 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.765882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjt9\" (UniqueName: \"kubernetes.io/projected/3109dd71-4d43-4375-a0dc-4bb2ba22e760-kube-api-access-qcjt9\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.834913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.834877 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tcj4v"] Jun 11 18:36:14.837029 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.837012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:14.839767 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.839739 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8rhbf\"" Jun 11 18:36:14.839886 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.839790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 18:36:14.853133 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.853109 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tcj4v"] Jun 11 18:36:14.866172 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.866147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.866312 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.866192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjt9\" (UniqueName: \"kubernetes.io/projected/3109dd71-4d43-4375-a0dc-4bb2ba22e760-kube-api-access-qcjt9\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.866312 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.866223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:14.866431 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.866330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tmp\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.866431 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.866368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dslld\" (UniqueName: \"kubernetes.io/projected/c842f212-48d2-49da-8fc4-4fc6dc061864-kube-api-access-dslld\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:14.868721 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.868700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tmp\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.868952 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.868932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3109dd71-4d43-4375-a0dc-4bb2ba22e760-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.877511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.877462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjt9\" (UniqueName: \"kubernetes.io/projected/3109dd71-4d43-4375-a0dc-4bb2ba22e760-kube-api-access-qcjt9\") pod \"kube-auth-proxy-576bcbdbd6-rdt9s\" (UID: \"3109dd71-4d43-4375-a0dc-4bb2ba22e760\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:14.966979 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.966892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:14.966979 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.966939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dslld\" (UniqueName: \"kubernetes.io/projected/c842f212-48d2-49da-8fc4-4fc6dc061864-kube-api-access-dslld\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:14.967175 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:14.967029 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 18:36:14.967175 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:14.967099 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert podName:c842f212-48d2-49da-8fc4-4fc6dc061864 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:15.467080874 +0000 UTC m=+486.263237989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert") pod "odh-model-controller-6dc94f689f-tcj4v" (UID: "c842f212-48d2-49da-8fc4-4fc6dc061864") : secret "odh-model-controller-webhook-cert" not found Jun 11 18:36:14.977957 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:14.977923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dslld\" (UniqueName: \"kubernetes.io/projected/c842f212-48d2-49da-8fc4-4fc6dc061864-kube-api-access-dslld\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:15.003320 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.003292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" Jun 11 18:36:15.130796 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.130760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s"] Jun 11 18:36:15.133665 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:15.133641 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3109dd71_4d43_4375_a0dc_4bb2ba22e760.slice/crio-c67ff3ac9996927286475ec18285efa045732813cead38d09b32b879f859c5ad WatchSource:0}: Error finding container c67ff3ac9996927286475ec18285efa045732813cead38d09b32b879f859c5ad: Status 404 returned error can't find the container with id c67ff3ac9996927286475ec18285efa045732813cead38d09b32b879f859c5ad Jun 11 18:36:15.326102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.326071 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9674k"] Jun 11 18:36:15.328507 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.328491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.330989 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.330968 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 18:36:15.339370 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.339347 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9674k"] Jun 11 18:36:15.370861 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.370824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdhhd\" (UniqueName: \"kubernetes.io/projected/53bd802e-2fdf-487f-83f1-411543b86d0b-kube-api-access-gdhhd\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.371019 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.370913 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.412415 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.412380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" event={"ID":"3109dd71-4d43-4375-a0dc-4bb2ba22e760","Type":"ContainerStarted","Data":"c67ff3ac9996927286475ec18285efa045732813cead38d09b32b879f859c5ad"} Jun 11 18:36:15.472050 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.472017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:15.472221 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.472061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.472221 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.472097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdhhd\" (UniqueName: \"kubernetes.io/projected/53bd802e-2fdf-487f-83f1-411543b86d0b-kube-api-access-gdhhd\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.472221 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:15.472215 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 18:36:15.472324 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:15.472279 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs podName:53bd802e-2fdf-487f-83f1-411543b86d0b nodeName:}" failed. No retries permitted until 2026-06-11 18:36:15.972260873 +0000 UTC m=+486.768417987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs") pod "model-serving-api-5dd488fc48-9674k" (UID: "53bd802e-2fdf-487f-83f1-411543b86d0b") : secret "model-serving-api-tls" not found Jun 11 18:36:15.474646 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.474620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c842f212-48d2-49da-8fc4-4fc6dc061864-cert\") pod \"odh-model-controller-6dc94f689f-tcj4v\" (UID: \"c842f212-48d2-49da-8fc4-4fc6dc061864\") " pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:15.480231 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.480208 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdhhd\" (UniqueName: \"kubernetes.io/projected/53bd802e-2fdf-487f-83f1-411543b86d0b-kube-api-access-gdhhd\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.747194 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.747097 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:15.914137 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.914019 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tcj4v"] Jun 11 18:36:15.916569 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:15.916519 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc842f212_48d2_49da_8fc4_4fc6dc061864.slice/crio-5ade31742ea82a84f8126a5bc5b439dc865b4116829dfcf229212ff68130d9b2 WatchSource:0}: Error finding container 5ade31742ea82a84f8126a5bc5b439dc865b4116829dfcf229212ff68130d9b2: Status 404 returned error can't find the container with id 5ade31742ea82a84f8126a5bc5b439dc865b4116829dfcf229212ff68130d9b2 Jun 11 18:36:15.974983 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.974936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:15.977898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:15.977870 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53bd802e-2fdf-487f-83f1-411543b86d0b-tls-certs\") pod \"model-serving-api-5dd488fc48-9674k\" (UID: \"53bd802e-2fdf-487f-83f1-411543b86d0b\") " pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:16.239054 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:16.239013 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:16.397005 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:16.396968 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9674k"] Jun 11 18:36:16.400987 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:16.400951 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bd802e_2fdf_487f_83f1_411543b86d0b.slice/crio-e8a49388f916dd6ae071dab3346347dadd96aa5061594d5127ee913fa8c5a9c2 WatchSource:0}: Error finding container e8a49388f916dd6ae071dab3346347dadd96aa5061594d5127ee913fa8c5a9c2: Status 404 returned error can't find the container with id e8a49388f916dd6ae071dab3346347dadd96aa5061594d5127ee913fa8c5a9c2 Jun 11 18:36:16.418869 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:16.418839 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" event={"ID":"c842f212-48d2-49da-8fc4-4fc6dc061864","Type":"ContainerStarted","Data":"5ade31742ea82a84f8126a5bc5b439dc865b4116829dfcf229212ff68130d9b2"} Jun 11 18:36:16.420200 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:16.420174 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9674k" event={"ID":"53bd802e-2fdf-487f-83f1-411543b86d0b","Type":"ContainerStarted","Data":"e8a49388f916dd6ae071dab3346347dadd96aa5061594d5127ee913fa8c5a9c2"} Jun 11 18:36:20.441824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.441786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" event={"ID":"c842f212-48d2-49da-8fc4-4fc6dc061864","Type":"ContainerStarted","Data":"1e6f8af1f0ab30efa988582e9735c6aac3b02889220e197a6c62765f35898946"} Jun 11 18:36:20.442385 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.441900 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:20.443591 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.443559 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" event={"ID":"3109dd71-4d43-4375-a0dc-4bb2ba22e760","Type":"ContainerStarted","Data":"0e479ee3df1e3ba7c61af0ab9bc6a94568f48fe5b21e858de42c2b61302753aa"} Jun 11 18:36:20.445033 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.445014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9674k" event={"ID":"53bd802e-2fdf-487f-83f1-411543b86d0b","Type":"ContainerStarted","Data":"9f10a8e23299589d669286447eb4ac88194c485eea206eb2de16e929fd858839"} Jun 11 18:36:20.445142 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.445128 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:20.460193 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.460156 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" podStartSLOduration=2.350607898 podStartE2EDuration="6.460143084s" totalImagesPullingTime="4.109535186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:20.458625171 +0000 UTC m=+491.254782308" watchObservedRunningTime="2026-06-11 18:36:20.460143084 +0000 UTC m=+491.256300244" Jun 11 18:36:20.477547 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.477505 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-rdt9s" podStartSLOduration=1.5870791359999998 podStartE2EDuration="6.477491121s" totalImagesPullingTime="4.890411985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:20.476325023 +0000 UTC m=+491.272482160" watchObservedRunningTime="2026-06-11 18:36:20.477491121 +0000 UTC m=+491.273648268" Jun 11 18:36:20.494736 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:20.494688 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9674k" podStartSLOduration=1.8804259779999999 podStartE2EDuration="5.494669392s" totalImagesPullingTime="3.614243414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:20.493714495 +0000 UTC m=+491.289871634" watchObservedRunningTime="2026-06-11 18:36:20.494669392 +0000 UTC m=+491.290826539" Jun 11 18:36:25.784550 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.784513 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7b5km"] Jun 11 18:36:25.787396 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.787379 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt"] Jun 11 18:36:25.787525 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.787504 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:25.790603 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.790583 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.791223 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.791204 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 18:36:25.791590 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.791570 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-crhg6\"" Jun 11 18:36:25.793695 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.793667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 18:36:25.793791 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.793729 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gxgqp\"" Jun 11 18:36:25.808263 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.808239 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt"] Jun 11 18:36:25.809953 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.809933 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7b5km"] Jun 11 18:36:25.853890 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.853859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkcl\" (UniqueName: \"kubernetes.io/projected/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-kube-api-access-zxkcl\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.854080 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.853906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.854080 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.854018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcwl\" (UniqueName: \"kubernetes.io/projected/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-kube-api-access-bpcwl\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:25.854080 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.854052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:25.954906 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.954865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.954930 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcwl\" (UniqueName: \"kubernetes.io/projected/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-kube-api-access-bpcwl\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.954960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.954994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkcl\" (UniqueName: \"kubernetes.io/projected/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-kube-api-access-zxkcl\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:25.955036 2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:25.955094 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 11 18:36:25.955122 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:25.955116 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert podName:0dab78fa-7e44-4e90-b6b4-82a2efe82eb6 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:26.455094767 +0000 UTC m=+497.251251882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert") pod "llmisvc-controller-manager-864bfd7bc9-hxnnt" (UID: "0dab78fa-7e44-4e90-b6b4-82a2efe82eb6") : secret "llmisvc-webhook-server-cert" not found Jun 11 18:36:25.955376 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:36:25.955143 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert podName:4c5f0287-15c2-406d-99d0-4b0f454fb2f1 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:26.455127939 +0000 UTC m=+497.251285054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert") pod "kserve-controller-manager-69fc866d76-7b5km" (UID: "4c5f0287-15c2-406d-99d0-4b0f454fb2f1") : secret "kserve-webhook-server-cert" not found Jun 11 18:36:25.968009 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.967983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkcl\" (UniqueName: \"kubernetes.io/projected/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-kube-api-access-zxkcl\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:25.968688 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:25.968652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcwl\" (UniqueName: \"kubernetes.io/projected/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-kube-api-access-bpcwl\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:26.458272 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.458229 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:26.458516 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.458293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:26.460777 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.460751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dab78fa-7e44-4e90-b6b4-82a2efe82eb6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hxnnt\" (UID: \"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:26.460777 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.460762 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c5f0287-15c2-406d-99d0-4b0f454fb2f1-cert\") pod \"kserve-controller-manager-69fc866d76-7b5km\" (UID: \"4c5f0287-15c2-406d-99d0-4b0f454fb2f1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:26.699372 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.699337 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:26.704575 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.704556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:26.847768 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.847673 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7b5km"] Jun 11 18:36:26.850642 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:26.850605 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5f0287_15c2_406d_99d0_4b0f454fb2f1.slice/crio-2d8d69c7963fa1607bf5f18b8c237ce7f3dae599aad1cbf71f4a715eb87dd6db WatchSource:0}: Error finding container 2d8d69c7963fa1607bf5f18b8c237ce7f3dae599aad1cbf71f4a715eb87dd6db: Status 404 returned error can't find the container with id 2d8d69c7963fa1607bf5f18b8c237ce7f3dae599aad1cbf71f4a715eb87dd6db Jun 11 18:36:26.862524 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:26.862495 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt"] Jun 11 18:36:26.865051 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:26.865025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0dab78fa_7e44_4e90_b6b4_82a2efe82eb6.slice/crio-2c8462682cc4d4af3d366c3ef20dc5843f650bd8a31aa6c63cce327e5b602eab WatchSource:0}: Error finding container 2c8462682cc4d4af3d366c3ef20dc5843f650bd8a31aa6c63cce327e5b602eab: Status 404 returned error can't find the container with id 2c8462682cc4d4af3d366c3ef20dc5843f650bd8a31aa6c63cce327e5b602eab Jun 11 18:36:27.474175 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:27.474137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" event={"ID":"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6","Type":"ContainerStarted","Data":"2c8462682cc4d4af3d366c3ef20dc5843f650bd8a31aa6c63cce327e5b602eab"} Jun 11 18:36:27.475158 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:27.475134 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" event={"ID":"4c5f0287-15c2-406d-99d0-4b0f454fb2f1","Type":"ContainerStarted","Data":"2d8d69c7963fa1607bf5f18b8c237ce7f3dae599aad1cbf71f4a715eb87dd6db"} Jun 11 18:36:30.490184 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:30.490140 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" event={"ID":"4c5f0287-15c2-406d-99d0-4b0f454fb2f1","Type":"ContainerStarted","Data":"a99618c7d736512a484af65db789e0904444d9322e86e75bf58bf003a4f58f3a"} Jun 11 18:36:30.490677 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:30.490283 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:36:30.530126 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:30.530060 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" podStartSLOduration=2.834811801 podStartE2EDuration="5.530041205s" totalImagesPullingTime="2.695229404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:30.528545798 +0000 UTC m=+501.324702966" watchObservedRunningTime="2026-06-11 18:36:30.530041205 +0000 UTC m=+501.326198343" Jun 11 18:36:31.452067 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.451973 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-tcj4v" Jun 11 18:36:31.454259 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.454235 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9674k" Jun 11 18:36:31.496253 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.496210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" event={"ID":"0dab78fa-7e44-4e90-b6b4-82a2efe82eb6","Type":"ContainerStarted","Data":"182e1b7c71fc70e27f511e6189b6aa71684c406f73de24752b7cdae34af5924f"} Jun 11 18:36:31.542518 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.542434 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" podStartSLOduration=2.2578101950000002 podStartE2EDuration="6.542409687s" totalImagesPullingTime="4.284599492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:31.540649012 +0000 UTC m=+502.336806151" watchObservedRunningTime="2026-06-11 18:36:31.542409687 +0000 UTC m=+502.338566825" Jun 11 18:36:31.631587 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.631551 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk"] Jun 11 18:36:31.635164 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.635144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.638393 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.638371 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 18:36:31.638393 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.638387 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-tjs7l\"" Jun 11 18:36:31.638589 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.638385 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 18:36:31.651818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.651794 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk"] Jun 11 18:36:31.702655 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.702563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjh6\" (UniqueName: \"kubernetes.io/projected/cf942c05-5375-4511-ac4c-104a9fe17f28-kube-api-access-drjh6\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.702798 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.702657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf942c05-5375-4511-ac4c-104a9fe17f28-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.803660 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.803620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf942c05-5375-4511-ac4c-104a9fe17f28-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.803660 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.803667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjh6\" (UniqueName: \"kubernetes.io/projected/cf942c05-5375-4511-ac4c-104a9fe17f28-kube-api-access-drjh6\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.806125 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.806099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf942c05-5375-4511-ac4c-104a9fe17f28-operator-config\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.818913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.818887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjh6\" (UniqueName: \"kubernetes.io/projected/cf942c05-5375-4511-ac4c-104a9fe17f28-kube-api-access-drjh6\") pod \"servicemesh-operator3-57f65f65fb-rg5vk\" (UID: \"cf942c05-5375-4511-ac4c-104a9fe17f28\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:31.944599 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:31.944561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:32.113538 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:32.113502 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk"] Jun 11 18:36:32.117930 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:32.117896 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf942c05_5375_4511_ac4c_104a9fe17f28.slice/crio-f3f5daa7198f977ce2634826353fd8f059bf6fa2e583259f71d81ec03647dc26 WatchSource:0}: Error finding container f3f5daa7198f977ce2634826353fd8f059bf6fa2e583259f71d81ec03647dc26: Status 404 returned error can't find the container with id f3f5daa7198f977ce2634826353fd8f059bf6fa2e583259f71d81ec03647dc26 Jun 11 18:36:32.501991 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:32.501952 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" event={"ID":"cf942c05-5375-4511-ac4c-104a9fe17f28","Type":"ContainerStarted","Data":"f3f5daa7198f977ce2634826353fd8f059bf6fa2e583259f71d81ec03647dc26"} Jun 11 18:36:32.502510 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:32.502200 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:36:35.518609 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:35.518569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" event={"ID":"cf942c05-5375-4511-ac4c-104a9fe17f28","Type":"ContainerStarted","Data":"7c35c6ebf85f1d8faf9be476afb6037551ca1e1dca9d402fa431c50305853f57"} Jun 11 18:36:35.518985 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:35.518688 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:35.571767 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:35.571710 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" podStartSLOduration=1.783995926 podStartE2EDuration="4.571692321s" totalImagesPullingTime="2.787696395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:35.569629085 +0000 UTC m=+506.365786247" watchObservedRunningTime="2026-06-11 18:36:35.571692321 +0000 UTC m=+506.367849457" Jun 11 18:36:46.042542 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.042509 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp"] Jun 11 18:36:46.045700 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.045680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.049421 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.049393 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 18:36:46.049569 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.049393 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 18:36:46.049569 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.049482 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nw8tc\"" Jun 11 18:36:46.049569 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.049557 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 18:36:46.049712 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.049626 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 18:36:46.060295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.060271 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp"] Jun 11 18:36:46.119848 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.119814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.119848 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.119852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26964d51-81ec-4686-86b9-4944bce2054d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.120060 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.119880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.120060 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.119952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.120060 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.119996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.120060 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.120028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.120185 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.120102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drgpj\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-kube-api-access-drgpj\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.220883 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.220841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.220883 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.220882 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.220927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.220969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drgpj\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-kube-api-access-drgpj\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.221118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221305 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.221166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26964d51-81ec-4686-86b9-4944bce2054d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221305 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.221198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.221947 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.221915 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.223534 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.223502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.223534 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.223529 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.223697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.223525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26964d51-81ec-4686-86b9-4944bce2054d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.223697 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.223629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26964d51-81ec-4686-86b9-4944bce2054d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.228826 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.228793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.228949 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.228926 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drgpj\" (UniqueName: \"kubernetes.io/projected/26964d51-81ec-4686-86b9-4944bce2054d-kube-api-access-drgpj\") pod \"istiod-openshift-gateway-75c67f8887-4hmtp\" (UID: \"26964d51-81ec-4686-86b9-4944bce2054d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.354810 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.354756 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:46.496531 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.496504 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp"] Jun 11 18:36:46.499291 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:46.499265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26964d51_81ec_4686_86b9_4944bce2054d.slice/crio-c1e89ef2d982d890f71ffd3ab36aa7345e438445d397887180f5c1ea6104bad7 WatchSource:0}: Error finding container c1e89ef2d982d890f71ffd3ab36aa7345e438445d397887180f5c1ea6104bad7: Status 404 returned error can't find the container with id c1e89ef2d982d890f71ffd3ab36aa7345e438445d397887180f5c1ea6104bad7 Jun 11 18:36:46.524863 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.524843 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-rg5vk" Jun 11 18:36:46.572184 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:46.572146 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" event={"ID":"26964d51-81ec-4686-86b9-4944bce2054d","Type":"ContainerStarted","Data":"c1e89ef2d982d890f71ffd3ab36aa7345e438445d397887180f5c1ea6104bad7"} Jun 11 18:36:49.149372 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:49.149329 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 18:36:49.149783 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:49.149410 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 11 18:36:49.587485 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:49.587433 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" event={"ID":"26964d51-81ec-4686-86b9-4944bce2054d","Type":"ContainerStarted","Data":"8bf69e0c0cdfce626a4d71ca12b7265c7f62ca06726a53236f06520a5263e8f0"} Jun 11 18:36:49.587641 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:49.587537 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:49.610746 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:49.610684 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" podStartSLOduration=0.963244974 podStartE2EDuration="3.610662595s" totalImagesPullingTime="2.647417621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:49.609748823 +0000 UTC m=+520.405905960" watchObservedRunningTime="2026-06-11 18:36:49.610662595 +0000 UTC m=+520.406819733" Jun 11 18:36:50.593394 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:50.593364 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4hmtp" Jun 11 18:36:55.248871 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.248840 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-2nmlk"] Jun 11 18:36:55.252541 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.252522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.255313 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.255291 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtn5v\"" Jun 11 18:36:55.255446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.255340 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 18:36:55.260122 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.259901 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-2nmlk"] Jun 11 18:36:55.404488 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.404435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5be84ffb-3614-4997-852e-c93fd814dc14-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.404663 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.404547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5578\" (UniqueName: \"kubernetes.io/projected/5be84ffb-3614-4997-852e-c93fd814dc14-kube-api-access-s5578\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.505627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.505524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5be84ffb-3614-4997-852e-c93fd814dc14-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.505627 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.505605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5578\" (UniqueName: \"kubernetes.io/projected/5be84ffb-3614-4997-852e-c93fd814dc14-kube-api-access-s5578\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.506242 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.506221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5be84ffb-3614-4997-852e-c93fd814dc14-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.514039 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.514020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5578\" (UniqueName: \"kubernetes.io/projected/5be84ffb-3614-4997-852e-c93fd814dc14-kube-api-access-s5578\") pod \"dashboard-redirect-5cc9d4d789-2nmlk\" (UID: \"5be84ffb-3614-4997-852e-c93fd814dc14\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.564179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.564144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" Jun 11 18:36:55.699215 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:55.699176 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-2nmlk"] Jun 11 18:36:55.702315 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:36:55.702280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be84ffb_3614_4997_852e_c93fd814dc14.slice/crio-94f2bba4273fca6e58a5ec1594b83daf1d1bbd55f275dd405f03347df05097c8 WatchSource:0}: Error finding container 94f2bba4273fca6e58a5ec1594b83daf1d1bbd55f275dd405f03347df05097c8: Status 404 returned error can't find the container with id 94f2bba4273fca6e58a5ec1594b83daf1d1bbd55f275dd405f03347df05097c8 Jun 11 18:36:56.622141 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:56.622095 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" event={"ID":"5be84ffb-3614-4997-852e-c93fd814dc14","Type":"ContainerStarted","Data":"94f2bba4273fca6e58a5ec1594b83daf1d1bbd55f275dd405f03347df05097c8"} Jun 11 18:36:57.628913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:57.628872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" event={"ID":"5be84ffb-3614-4997-852e-c93fd814dc14","Type":"ContainerStarted","Data":"3dbbe0e37754b4e9904cad7b7ea9c03f2ebfd463d136c47707dd991dcc52c973"} Jun 11 18:36:57.647267 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:36:57.647218 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cc9d4d789-2nmlk" podStartSLOduration=0.931022344 podStartE2EDuration="2.647203247s" totalImagesPullingTime="1.716180903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:57.646779089 +0000 UTC m=+528.442936228" watchObservedRunningTime="2026-06-11 18:36:57.647203247 +0000 UTC m=+528.443360384" Jun 11 18:37:01.501706 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:01.501627 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7b5km" Jun 11 18:37:03.510192 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:03.510159 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hxnnt" Jun 11 18:37:41.717461 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.717426 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b96795c-chtl7"] Jun 11 18:37:41.728588 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.728554 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.732307 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732282 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:37:41.732446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:37:41.732446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732360 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:37:41.732758 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732735 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:37:41.732865 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rx75w\"" Jun 11 18:37:41.732865 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.732783 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:37:41.736605 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.736584 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:37:41.737857 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.737830 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b96795c-chtl7"] Jun 11 18:37:41.797377 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797602 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-oauth-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797602 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797602 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797501 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-service-ca\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797602 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-trusted-ca-bundle\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797764 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-oauth-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.797764 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.797646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7msn2\" (UniqueName: \"kubernetes.io/projected/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-kube-api-access-7msn2\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898413 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7msn2\" (UniqueName: \"kubernetes.io/projected/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-kube-api-access-7msn2\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898425 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-oauth-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898807 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-service-ca\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898807 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-trusted-ca-bundle\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.898807 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.898784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-oauth-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.899278 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.899252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-service-ca\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.899379 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.899252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.899443 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.899398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-oauth-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.899865 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.899845 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-trusted-ca-bundle\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.900957 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.900936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-oauth-config\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.901074 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.901057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-console-serving-cert\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:41.910102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:41.910074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7msn2\" (UniqueName: \"kubernetes.io/projected/a44b6ccd-cbf9-44e9-9e1c-396f7d747589-kube-api-access-7msn2\") pod \"console-75b96795c-chtl7\" (UID: \"a44b6ccd-cbf9-44e9-9e1c-396f7d747589\") " pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:42.039682 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:42.039576 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:42.187318 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:42.187291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b96795c-chtl7"] Jun 11 18:37:42.189846 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:37:42.189821 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44b6ccd_cbf9_44e9_9e1c_396f7d747589.slice/crio-365416dfea1e3de65f96788a894710a35b718c58e8be324c23328416e45bf1d0 WatchSource:0}: Error finding container 365416dfea1e3de65f96788a894710a35b718c58e8be324c23328416e45bf1d0: Status 404 returned error can't find the container with id 365416dfea1e3de65f96788a894710a35b718c58e8be324c23328416e45bf1d0 Jun 11 18:37:42.827407 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:42.827371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b96795c-chtl7" event={"ID":"a44b6ccd-cbf9-44e9-9e1c-396f7d747589","Type":"ContainerStarted","Data":"7e6946707efa4236fca46ba83c2824de1aadbad15f41a387ff6adb127c3befa9"} Jun 11 18:37:42.827813 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:42.827424 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b96795c-chtl7" event={"ID":"a44b6ccd-cbf9-44e9-9e1c-396f7d747589","Type":"ContainerStarted","Data":"365416dfea1e3de65f96788a894710a35b718c58e8be324c23328416e45bf1d0"} Jun 11 18:37:42.854959 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:42.854900 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b96795c-chtl7" podStartSLOduration=1.8548829740000001 podStartE2EDuration="1.854882974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:42.854648836 +0000 UTC m=+573.650806043" watchObservedRunningTime="2026-06-11 18:37:42.854882974 +0000 UTC m=+573.651040151" Jun 11 18:37:51.809562 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.809527 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg"] Jun 11 18:37:51.812985 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.812962 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:51.815852 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.815830 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:37:51.815852 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.815846 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zxgmh\"" Jun 11 18:37:51.815998 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.815831 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:37:51.828652 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.828629 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg"] Jun 11 18:37:51.997419 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.997380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sf8t\" (UniqueName: \"kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:51.997616 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:51.997491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.040669 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.040634 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:52.040844 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.040733 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:52.045515 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.045486 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:52.098722 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.098633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sf8t\" (UniqueName: \"kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.098891 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.098720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.099157 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.099135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.111425 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.111394 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sf8t\" (UniqueName: \"kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.123123 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.123100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:52.259040 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.258819 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg"] Jun 11 18:37:52.262068 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:37:52.262041 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8ecb3c_1112_4ec8_b909_a820be884c96.slice/crio-ee5933a678db251c23f930d25eb7f9f798c90c75049de9eb2b309ad707a25b40 WatchSource:0}: Error finding container ee5933a678db251c23f930d25eb7f9f798c90c75049de9eb2b309ad707a25b40: Status 404 returned error can't find the container with id ee5933a678db251c23f930d25eb7f9f798c90c75049de9eb2b309ad707a25b40 Jun 11 18:37:52.875077 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.875037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" event={"ID":"db8ecb3c-1112-4ec8-b909-a820be884c96","Type":"ContainerStarted","Data":"ee5933a678db251c23f930d25eb7f9f798c90c75049de9eb2b309ad707a25b40"} Jun 11 18:37:52.879118 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:52.879092 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b96795c-chtl7" Jun 11 18:37:59.912101 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:59.912052 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" event={"ID":"db8ecb3c-1112-4ec8-b909-a820be884c96","Type":"ContainerStarted","Data":"52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e"} Jun 11 18:37:59.912647 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:59.912584 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:37:59.939091 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:37:59.939037 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" podStartSLOduration=2.189350247 podStartE2EDuration="8.939021963s" totalImagesPullingTime="6.749671716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:59.936525383 +0000 UTC m=+590.732682537" watchObservedRunningTime="2026-06-11 18:37:59.939021963 +0000 UTC m=+590.735179101" Jun 11 18:38:10.919124 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:10.919092 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:11.988163 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:11.988131 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g"] Jun 11 18:38:11.996002 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:11.995971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.008510 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.008463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g"] Jun 11 18:38:12.058295 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.058264 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.058463 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.058309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn568\" (UniqueName: \"kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.158884 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.158844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.159045 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.158895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn568\" (UniqueName: \"kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.159251 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.159233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.169092 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.169063 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn568\" (UniqueName: \"kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.306744 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.306709 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.465227 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.465203 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g"] Jun 11 18:38:12.467719 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:38:12.467688 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf4697c_604f_4d98_8f23_aec399d75ed8.slice/crio-466a3da51acc372b80d9018ac513c39a8021e771b573d0d60e42e321d839f566 WatchSource:0}: Error finding container 466a3da51acc372b80d9018ac513c39a8021e771b573d0d60e42e321d839f566: Status 404 returned error can't find the container with id 466a3da51acc372b80d9018ac513c39a8021e771b573d0d60e42e321d839f566 Jun 11 18:38:12.590033 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.589944 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g"] Jun 11 18:38:12.596397 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.596373 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g"] Jun 11 18:38:12.609051 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.609025 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg"] Jun 11 18:38:12.609288 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.609238 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" containerName="manager" containerID="cri-o://52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e" gracePeriod=2 Jun 11 18:38:12.618293 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.618262 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:12.618721 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.618705 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" containerName="manager" Jun 11 18:38:12.618800 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.618725 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" containerName="manager" Jun 11 18:38:12.618852 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.618837 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" containerName="manager" Jun 11 18:38:12.621806 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.621708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.627501 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.627460 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg"] Jun 11 18:38:12.634073 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.634043 2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"db8ecb3c-1112-4ec8-b909-a820be884c96\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-w54wg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.637185 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.637160 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:12.642332 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.642300 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:12.642726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.642707 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" containerName="manager" Jun 11 18:38:12.642726 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.642727 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" containerName="manager" Jun 11 18:38:12.642887 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.642874 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" containerName="manager" Jun 11 18:38:12.645741 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.645719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.664930 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.664893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqpw\" (UniqueName: \"kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.665062 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.664951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.665537 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.665516 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:12.670671 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.670636 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.672822 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.672788 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.765886 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.765851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqpw\" (UniqueName: \"kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.766059 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.765893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.766059 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.765935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.766059 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.766022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx4qp\" (UniqueName: \"kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.766315 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.766294 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.783291 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.783255 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqpw\" (UniqueName: \"kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k6n55\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.854200 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.854173 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.856639 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.856612 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.867067 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.867043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx4qp\" (UniqueName: \"kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.867166 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.867101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.867449 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.867430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.876412 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.876387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx4qp\" (UniqueName: \"kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x8h4p\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:12.967800 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.967771 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sf8t\" (UniqueName: \"kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t\") pod \"db8ecb3c-1112-4ec8-b909-a820be884c96\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " Jun 11 18:38:12.967970 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.967821 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume\") pod \"db8ecb3c-1112-4ec8-b909-a820be884c96\" (UID: \"db8ecb3c-1112-4ec8-b909-a820be884c96\") " Jun 11 18:38:12.968230 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.968200 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db8ecb3c-1112-4ec8-b909-a820be884c96" (UID: "db8ecb3c-1112-4ec8-b909-a820be884c96"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:38:12.970086 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.970062 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t" (OuterVolumeSpecName: "kube-api-access-8sf8t") pod "db8ecb3c-1112-4ec8-b909-a820be884c96" (UID: "db8ecb3c-1112-4ec8-b909-a820be884c96"). InnerVolumeSpecName "kube-api-access-8sf8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:12.973613 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.973589 2568 generic.go:356] "Generic (PLEG): container finished" podID="db8ecb3c-1112-4ec8-b909-a820be884c96" containerID="52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e" exitCode=0 Jun 11 18:38:12.973716 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.973634 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.973716 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.973690 2568 scope.go:117] "RemoveContainer" containerID="52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e" Jun 11 18:38:12.975571 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.975550 2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" container="manager" Jun 11 18:38:12.976388 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.976359 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.978586 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.978543 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.980623 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.980589 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.984208 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.984154 2568 scope.go:117] "RemoveContainer" containerID="52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e" Jun 11 18:38:12.984549 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.984516 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e\": container with ID starting with 52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e not found: ID does not exist" containerID="52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e" Jun 11 18:38:12.984641 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.984563 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e"} err="failed to get container status \"52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e\": rpc error: code = NotFound desc = could not find container \"52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e\": container with ID starting with 52b12be91c1a47032bf3bb19d0c4bc1bc496f166e1b9665d089c1f762105828e not found: ID does not exist" Jun 11 18:38:12.987633 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.987610 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w54wg\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w54wg" Jun 11 18:38:12.990023 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:12.990001 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:12.990297 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.990035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:12.996662 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:12.996641 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:13.068601 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.068550 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sf8t\" (UniqueName: \"kubernetes.io/projected/db8ecb3c-1112-4ec8-b909-a820be884c96-kube-api-access-8sf8t\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:13.068601 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.068603 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db8ecb3c-1112-4ec8-b909-a820be884c96-extensions-socket-volume\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:13.135949 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.135926 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:13.138745 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:38:13.138705 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab8f7e0_532c_4276_b6f9_10ef3c26f928.slice/crio-8450d13760ccdea3d6ee779b0562d0e28d1488c98f3fc2dcdd41765035911db2 WatchSource:0}: Error finding container 8450d13760ccdea3d6ee779b0562d0e28d1488c98f3fc2dcdd41765035911db2: Status 404 returned error can't find the container with id 8450d13760ccdea3d6ee779b0562d0e28d1488c98f3fc2dcdd41765035911db2 Jun 11 18:38:13.151426 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.151390 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:13.155716 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:38:13.155689 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda65eb90_2cc1_4797_95ed_a359611a5791.slice/crio-50f5aa192f83942e80428695db7415be7a66b796a1d8163a7ddb585464a70d7a WatchSource:0}: Error finding container 50f5aa192f83942e80428695db7415be7a66b796a1d8163a7ddb585464a70d7a: Status 404 returned error can't find the container with id 50f5aa192f83942e80428695db7415be7a66b796a1d8163a7ddb585464a70d7a Jun 11 18:38:13.673224 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.673193 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db8ecb3c-1112-4ec8-b909-a820be884c96" path="/var/lib/kubelet/pods/db8ecb3c-1112-4ec8-b909-a820be884c96/volumes" Jun 11 18:38:13.986367 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.986279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" event={"ID":"da65eb90-2cc1-4797-95ed-a359611a5791","Type":"ContainerStarted","Data":"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0"} Jun 11 18:38:13.986552 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.986366 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" event={"ID":"da65eb90-2cc1-4797-95ed-a359611a5791","Type":"ContainerStarted","Data":"50f5aa192f83942e80428695db7415be7a66b796a1d8163a7ddb585464a70d7a"} Jun 11 18:38:13.986552 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.986479 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:13.988718 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.988692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" event={"ID":"cab8f7e0-532c-4276-b6f9-10ef3c26f928","Type":"ContainerStarted","Data":"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a"} Jun 11 18:38:13.988819 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.988732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" event={"ID":"cab8f7e0-532c-4276-b6f9-10ef3c26f928","Type":"ContainerStarted","Data":"8450d13760ccdea3d6ee779b0562d0e28d1488c98f3fc2dcdd41765035911db2"} Jun 11 18:38:13.988819 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.988786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:13.990233 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:13.990212 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" containerName="manager" containerID="cri-o://4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8" gracePeriod=2 Jun 11 18:38:14.009841 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.009764 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" podStartSLOduration=2.009747098 podStartE2EDuration="2.009747098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:14.007989902 +0000 UTC m=+604.804147059" watchObservedRunningTime="2026-06-11 18:38:14.009747098 +0000 UTC m=+604.805904235" Jun 11 18:38:14.036857 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.036783 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" podStartSLOduration=2.036768738 podStartE2EDuration="2.036768738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:14.034499721 +0000 UTC m=+604.830656873" watchObservedRunningTime="2026-06-11 18:38:14.036768738 +0000 UTC m=+604.832925947" Jun 11 18:38:14.248824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.248760 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:14.251423 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:14.251398 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:14.280910 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.280880 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume\") pod \"5cf4697c-604f-4d98-8f23-aec399d75ed8\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " Jun 11 18:38:14.281015 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.280938 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn568\" (UniqueName: \"kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568\") pod \"5cf4697c-604f-4d98-8f23-aec399d75ed8\" (UID: \"5cf4697c-604f-4d98-8f23-aec399d75ed8\") " Jun 11 18:38:14.281179 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.281152 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cf4697c-604f-4d98-8f23-aec399d75ed8" (UID: "5cf4697c-604f-4d98-8f23-aec399d75ed8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:38:14.282906 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.282889 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568" (OuterVolumeSpecName: "kube-api-access-mn568") pod "5cf4697c-604f-4d98-8f23-aec399d75ed8" (UID: "5cf4697c-604f-4d98-8f23-aec399d75ed8"). InnerVolumeSpecName "kube-api-access-mn568". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:14.381448 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.381412 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4697c-604f-4d98-8f23-aec399d75ed8-extensions-socket-volume\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:14.381448 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.381443 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn568\" (UniqueName: \"kubernetes.io/projected/5cf4697c-604f-4d98-8f23-aec399d75ed8-kube-api-access-mn568\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:14.996481 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.996425 2568 generic.go:356] "Generic (PLEG): container finished" podID="5cf4697c-604f-4d98-8f23-aec399d75ed8" containerID="4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8" exitCode=2 Jun 11 18:38:14.996957 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.996491 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:14.996957 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:14.996528 2568 scope.go:117] "RemoveContainer" containerID="4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8" Jun 11 18:38:14.999195 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:14.999168 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:15.005684 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:15.005667 2568 scope.go:117] "RemoveContainer" containerID="4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8" Jun 11 18:38:15.005934 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:15.005911 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8\": container with ID starting with 4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8 not found: ID does not exist" containerID="4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8" Jun 11 18:38:15.006001 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:15.005944 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8"} err="failed to get container status \"4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8\": rpc error: code = NotFound desc = could not find container \"4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8\": container with ID starting with 4b0125eaba999e931840a5f5abe250dfd19bb0a38ed4b05e5416c998d1b94ac8 not found: ID does not exist" Jun 11 18:38:15.007235 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:15.007212 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mcm6g\" is forbidden: User \"system:node:ip-10-0-143-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-116.ec2.internal' and this object" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mcm6g" Jun 11 18:38:15.673320 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:15.673285 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf4697c-604f-4d98-8f23-aec399d75ed8" path="/var/lib/kubelet/pods/5cf4697c-604f-4d98-8f23-aec399d75ed8/volumes" Jun 11 18:38:24.999262 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:24.999231 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:24.999754 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:24.999387 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:25.075671 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.075634 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:25.075943 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.075876 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" podUID="da65eb90-2cc1-4797-95ed-a359611a5791" containerName="manager" containerID="cri-o://65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0" gracePeriod=10 Jun 11 18:38:25.325437 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.325412 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:25.481964 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.481928 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume\") pod \"da65eb90-2cc1-4797-95ed-a359611a5791\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " Jun 11 18:38:25.482143 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.482006 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx4qp\" (UniqueName: \"kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp\") pod \"da65eb90-2cc1-4797-95ed-a359611a5791\" (UID: \"da65eb90-2cc1-4797-95ed-a359611a5791\") " Jun 11 18:38:25.482290 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.482268 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "da65eb90-2cc1-4797-95ed-a359611a5791" (UID: "da65eb90-2cc1-4797-95ed-a359611a5791"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:38:25.483923 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.483903 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp" (OuterVolumeSpecName: "kube-api-access-hx4qp") pod "da65eb90-2cc1-4797-95ed-a359611a5791" (UID: "da65eb90-2cc1-4797-95ed-a359611a5791"). InnerVolumeSpecName "kube-api-access-hx4qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:25.583683 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.583602 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx4qp\" (UniqueName: \"kubernetes.io/projected/da65eb90-2cc1-4797-95ed-a359611a5791-kube-api-access-hx4qp\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:25.583683 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:25.583628 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da65eb90-2cc1-4797-95ed-a359611a5791-extensions-socket-volume\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:26.063406 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.063366 2568 generic.go:356] "Generic (PLEG): container finished" podID="da65eb90-2cc1-4797-95ed-a359611a5791" containerID="65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0" exitCode=0 Jun 11 18:38:26.063818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.063434 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" Jun 11 18:38:26.063818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.063447 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" event={"ID":"da65eb90-2cc1-4797-95ed-a359611a5791","Type":"ContainerDied","Data":"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0"} Jun 11 18:38:26.063818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.063525 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p" event={"ID":"da65eb90-2cc1-4797-95ed-a359611a5791","Type":"ContainerDied","Data":"50f5aa192f83942e80428695db7415be7a66b796a1d8163a7ddb585464a70d7a"} Jun 11 18:38:26.063818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.063547 2568 scope.go:117] "RemoveContainer" containerID="65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0" Jun 11 18:38:26.072259 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.072244 2568 scope.go:117] "RemoveContainer" containerID="65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0" Jun 11 18:38:26.072547 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:26.072526 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0\": container with ID starting with 65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0 not found: ID does not exist" containerID="65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0" Jun 11 18:38:26.072622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.072554 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0"} err="failed to get container status \"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0\": rpc error: code = NotFound desc = could not find container \"65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0\": container with ID starting with 65f8d54741ea34f21342ed01b4cbb13bd7b40f53acb6638beee6a9fd6cd635b0 not found: ID does not exist" Jun 11 18:38:26.099567 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.099534 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:26.117535 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.117507 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x8h4p"] Jun 11 18:38:26.131319 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.131294 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k"] Jun 11 18:38:26.131649 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.131636 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da65eb90-2cc1-4797-95ed-a359611a5791" containerName="manager" Jun 11 18:38:26.131690 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.131652 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="da65eb90-2cc1-4797-95ed-a359611a5791" containerName="manager" Jun 11 18:38:26.131731 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.131724 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="da65eb90-2cc1-4797-95ed-a359611a5791" containerName="manager" Jun 11 18:38:26.136056 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.136041 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.149654 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.149624 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k"] Jun 11 18:38:26.288875 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.288839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.289093 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.288905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgcx\" (UniqueName: \"kubernetes.io/projected/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-kube-api-access-8sgcx\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.390402 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.390302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgcx\" (UniqueName: \"kubernetes.io/projected/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-kube-api-access-8sgcx\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.390600 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.390459 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.390849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.390831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.399520 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.399458 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgcx\" (UniqueName: \"kubernetes.io/projected/41dde401-0864-4ad6-ba24-0f3ee1a1cc24-kube-api-access-8sgcx\") pod \"kuadrant-operator-controller-manager-86878c769f-kqr5k\" (UID: \"41dde401-0864-4ad6-ba24-0f3ee1a1cc24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.446213 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.446177 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:26.578677 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:26.578651 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k"] Jun 11 18:38:26.580858 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:38:26.580827 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41dde401_0864_4ad6_ba24_0f3ee1a1cc24.slice/crio-2aeb04d0308a338b448c7f1f4fd9bfac50549e4e60faa7f2d160656ad6e10671 WatchSource:0}: Error finding container 2aeb04d0308a338b448c7f1f4fd9bfac50549e4e60faa7f2d160656ad6e10671: Status 404 returned error can't find the container with id 2aeb04d0308a338b448c7f1f4fd9bfac50549e4e60faa7f2d160656ad6e10671 Jun 11 18:38:27.073151 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:27.073117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" event={"ID":"41dde401-0864-4ad6-ba24-0f3ee1a1cc24","Type":"ContainerStarted","Data":"951db84919658ef8b27371753f9ba540bc3c0148eb33795bee36e9004aa1ae4c"} Jun 11 18:38:27.073542 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:27.073173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" event={"ID":"41dde401-0864-4ad6-ba24-0f3ee1a1cc24","Type":"ContainerStarted","Data":"2aeb04d0308a338b448c7f1f4fd9bfac50549e4e60faa7f2d160656ad6e10671"} Jun 11 18:38:27.073542 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:27.073202 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:27.095341 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:27.094794 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" podStartSLOduration=1.094774255 podStartE2EDuration="1.094774255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:27.094086925 +0000 UTC m=+617.890244083" watchObservedRunningTime="2026-06-11 18:38:27.094774255 +0000 UTC m=+617.890931395" Jun 11 18:38:27.673357 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:27.673320 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da65eb90-2cc1-4797-95ed-a359611a5791" path="/var/lib/kubelet/pods/da65eb90-2cc1-4797-95ed-a359611a5791/volumes" Jun 11 18:38:38.080187 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.080146 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kqr5k" Jun 11 18:38:38.189897 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.189867 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:38.190086 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.190060 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" podUID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" containerName="manager" containerID="cri-o://31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a" gracePeriod=10 Jun 11 18:38:38.446178 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.446148 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:38.597779 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.597748 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume\") pod \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " Jun 11 18:38:38.597940 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.597815 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfqpw\" (UniqueName: \"kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw\") pod \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\" (UID: \"cab8f7e0-532c-4276-b6f9-10ef3c26f928\") " Jun 11 18:38:38.598099 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.598073 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cab8f7e0-532c-4276-b6f9-10ef3c26f928" (UID: "cab8f7e0-532c-4276-b6f9-10ef3c26f928"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:38:38.599765 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.599745 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw" (OuterVolumeSpecName: "kube-api-access-wfqpw") pod "cab8f7e0-532c-4276-b6f9-10ef3c26f928" (UID: "cab8f7e0-532c-4276-b6f9-10ef3c26f928"). InnerVolumeSpecName "kube-api-access-wfqpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:38.699102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.699026 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab8f7e0-532c-4276-b6f9-10ef3c26f928-extensions-socket-volume\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:38.699102 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:38.699052 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfqpw\" (UniqueName: \"kubernetes.io/projected/cab8f7e0-532c-4276-b6f9-10ef3c26f928-kube-api-access-wfqpw\") on node \"ip-10-0-143-116.ec2.internal\" DevicePath \"\"" Jun 11 18:38:39.134872 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.134841 2568 generic.go:356] "Generic (PLEG): container finished" podID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" containerID="31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a" exitCode=0 Jun 11 18:38:39.135306 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.134887 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" Jun 11 18:38:39.135306 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.134936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" event={"ID":"cab8f7e0-532c-4276-b6f9-10ef3c26f928","Type":"ContainerDied","Data":"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a"} Jun 11 18:38:39.135306 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.135008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55" event={"ID":"cab8f7e0-532c-4276-b6f9-10ef3c26f928","Type":"ContainerDied","Data":"8450d13760ccdea3d6ee779b0562d0e28d1488c98f3fc2dcdd41765035911db2"} Jun 11 18:38:39.135306 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.135040 2568 scope.go:117] "RemoveContainer" containerID="31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a" Jun 11 18:38:39.144913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.144895 2568 scope.go:117] "RemoveContainer" containerID="31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a" Jun 11 18:38:39.145235 ip-10-0-143-116 kubenswrapper[2568]: E0611 18:38:39.145216 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a\": container with ID starting with 31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a not found: ID does not exist" containerID="31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a" Jun 11 18:38:39.145326 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.145242 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a"} err="failed to get container status \"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a\": rpc error: code = NotFound desc = could not find container \"31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a\": container with ID starting with 31b853b46f6ef949120089a4bb48a0d2fc104a3b4d6f47dd42e7cf3034b9883a not found: ID does not exist" Jun 11 18:38:39.158792 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.158768 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:39.166511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.166489 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k6n55"] Jun 11 18:38:39.672479 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:39.672447 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" path="/var/lib/kubelet/pods/cab8f7e0-532c-4276-b6f9-10ef3c26f928/volumes" Jun 11 18:38:57.376451 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.376412 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:38:57.377042 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.376902 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" containerName="manager" Jun 11 18:38:57.377042 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.376922 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" containerName="manager" Jun 11 18:38:57.377042 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.377013 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab8f7e0-532c-4276-b6f9-10ef3c26f928" containerName="manager" Jun 11 18:38:57.381423 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.381402 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.383984 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.383962 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 18:38:57.384138 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.384123 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wmbv9\"" Jun 11 18:38:57.388658 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.388631 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:38:57.423079 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.423046 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:38:57.447743 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.447719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm74n\" (UniqueName: \"kubernetes.io/projected/1ce05eca-396b-498b-96ae-93cb1138758f-kube-api-access-qm74n\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.447902 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.447755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ce05eca-396b-498b-96ae-93cb1138758f-config-file\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.548923 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.548893 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ce05eca-396b-498b-96ae-93cb1138758f-config-file\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.549066 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.549016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm74n\" (UniqueName: \"kubernetes.io/projected/1ce05eca-396b-498b-96ae-93cb1138758f-kube-api-access-qm74n\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.549514 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.549494 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1ce05eca-396b-498b-96ae-93cb1138758f-config-file\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.557674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.557651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm74n\" (UniqueName: \"kubernetes.io/projected/1ce05eca-396b-498b-96ae-93cb1138758f-kube-api-access-qm74n\") pod \"limitador-limitador-54d6d988d5-htrvf\" (UID: \"1ce05eca-396b-498b-96ae-93cb1138758f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.691762 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.691688 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:38:57.831760 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:57.831728 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:38:57.835135 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:38:57.835106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce05eca_396b_498b_96ae_93cb1138758f.slice/crio-0bf9492c70a3c6540f26a29b9f1e60525b0ea591968877ddc0fc9280097a8cd0 WatchSource:0}: Error finding container 0bf9492c70a3c6540f26a29b9f1e60525b0ea591968877ddc0fc9280097a8cd0: Status 404 returned error can't find the container with id 0bf9492c70a3c6540f26a29b9f1e60525b0ea591968877ddc0fc9280097a8cd0 Jun 11 18:38:58.231307 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:38:58.231275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" event={"ID":"1ce05eca-396b-498b-96ae-93cb1138758f","Type":"ContainerStarted","Data":"0bf9492c70a3c6540f26a29b9f1e60525b0ea591968877ddc0fc9280097a8cd0"} Jun 11 18:39:01.250733 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:39:01.250695 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" event={"ID":"1ce05eca-396b-498b-96ae-93cb1138758f","Type":"ContainerStarted","Data":"e591065c56dceaea630deff2de63256603fe7bb37d0ade1c38f5315e38d8f68b"} Jun 11 18:39:01.251197 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:39:01.250815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:39:01.267434 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:39:01.267381 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" podStartSLOduration=1.860788624 podStartE2EDuration="4.267368141s" totalImagesPullingTime="2.406579517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:01.267190815 +0000 UTC m=+652.063347978" watchObservedRunningTime="2026-06-11 18:39:01.267368141 +0000 UTC m=+652.063525278" Jun 11 18:39:12.255818 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:39:12.255792 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-htrvf" Jun 11 18:41:00.806264 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:41:00.806222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:09.803863 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:09.803824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:12.807950 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.807919 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn"] Jun 11 18:42:12.811585 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.811556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.818799 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.818764 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 18:42:12.818799 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.818783 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 18:42:12.818799 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.818796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9mwhp\"" Jun 11 18:42:12.819022 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.818771 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 18:42:12.825843 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.825820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn"] Jun 11 18:42:12.918024 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.917981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646493b5-9901-487d-9096-04db1acb53dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.918203 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.918037 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2m4\" (UniqueName: \"kubernetes.io/projected/646493b5-9901-487d-9096-04db1acb53dc-kube-api-access-hq2m4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.918203 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.918115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.918203 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.918191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.918308 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.918215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:12.918308 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:12.918243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019190 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646493b5-9901-487d-9096-04db1acb53dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019190 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019190 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2m4\" (UniqueName: \"kubernetes.io/projected/646493b5-9901-487d-9096-04db1acb53dc-kube-api-access-hq2m4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019451 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019451 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019265 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019451 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019451 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019829 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.019829 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019824 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.020033 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.019849 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.021780 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.021748 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/646493b5-9901-487d-9096-04db1acb53dc-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.021911 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.021894 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/646493b5-9901-487d-9096-04db1acb53dc-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.028106 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.028082 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2m4\" (UniqueName: \"kubernetes.io/projected/646493b5-9901-487d-9096-04db1acb53dc-kube-api-access-hq2m4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6qtbn\" (UID: \"646493b5-9901-487d-9096-04db1acb53dc\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.122411 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.122329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:13.262530 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.262503 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn"] Jun 11 18:42:13.265219 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:42:13.265192 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646493b5_9901_487d_9096_04db1acb53dc.slice/crio-2e7f0c218fb5baf8d493d064ac31fe8316a26056d2a9b5a70523a9dde4a33e9a WatchSource:0}: Error finding container 2e7f0c218fb5baf8d493d064ac31fe8316a26056d2a9b5a70523a9dde4a33e9a: Status 404 returned error can't find the container with id 2e7f0c218fb5baf8d493d064ac31fe8316a26056d2a9b5a70523a9dde4a33e9a Jun 11 18:42:13.267346 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.267328 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:42:13.273341 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:13.273317 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:14.134881 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:14.134842 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" event={"ID":"646493b5-9901-487d-9096-04db1acb53dc","Type":"ContainerStarted","Data":"2e7f0c218fb5baf8d493d064ac31fe8316a26056d2a9b5a70523a9dde4a33e9a"} Jun 11 18:42:17.151913 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:17.151874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" event={"ID":"646493b5-9901-487d-9096-04db1acb53dc","Type":"ContainerStarted","Data":"a4ddfda80c1ba0c046a756f4095e16c5263aa3015915aff5b325b9549830674b"} Jun 11 18:42:19.161922 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:19.161883 2568 generic.go:356] "Generic (PLEG): container finished" podID="646493b5-9901-487d-9096-04db1acb53dc" containerID="a4ddfda80c1ba0c046a756f4095e16c5263aa3015915aff5b325b9549830674b" exitCode=0 Jun 11 18:42:19.162393 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:19.161955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" event={"ID":"646493b5-9901-487d-9096-04db1acb53dc","Type":"ContainerDied","Data":"a4ddfda80c1ba0c046a756f4095e16c5263aa3015915aff5b325b9549830674b"} Jun 11 18:42:21.174276 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:21.174242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" event={"ID":"646493b5-9901-487d-9096-04db1acb53dc","Type":"ContainerStarted","Data":"27b306546322de228799bd3af6aca6299d450ae5d8f8f664b65e352ad7cb270a"} Jun 11 18:42:21.196751 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:21.196702 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" podStartSLOduration=2.825274113 podStartE2EDuration="9.196685861s" totalImagesPullingTime="4.041307007s" totalInitContainerRuntime="2.330104741s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:21.194661833 +0000 UTC m=+851.990819009" watchObservedRunningTime="2026-06-11 18:42:21.196685861 +0000 UTC m=+851.992842993" Jun 11 18:42:23.122671 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:23.122627 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:23.123137 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:23.122730 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:23.135535 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:23.135502 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:23.194274 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:23.194244 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6qtbn" Jun 11 18:42:23.578149 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:23.578112 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:28.379348 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.379320 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5"] Jun 11 18:42:28.383622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.383601 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.388972 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.388947 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 18:42:28.396167 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.396143 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5"] Jun 11 18:42:28.439609 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.439609 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.439824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.439824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.439824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxc7x\" (UniqueName: \"kubernetes.io/projected/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kube-api-access-pxc7x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.439824 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.439774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540277 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540240 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540277 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540280 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540543 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540543 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540719 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxc7x\" (UniqueName: \"kubernetes.io/projected/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kube-api-access-pxc7x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540795 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540795 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540943 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.540943 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.540838 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.543025 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.543003 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.543197 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.543177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.549822 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.549800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxc7x\" (UniqueName: \"kubernetes.io/projected/c50b0fc7-bacd-4175-910c-0ead1aaa3d39-kube-api-access-pxc7x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5\" (UID: \"c50b0fc7-bacd-4175-910c-0ead1aaa3d39\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.694177 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.694079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:28.830561 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:28.830295 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5"] Jun 11 18:42:28.832855 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:42:28.832826 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50b0fc7_bacd_4175_910c_0ead1aaa3d39.slice/crio-f8e4bccda321836dbd865ccfdb62154ce4528a775e1bfb2499c15640ede3b376 WatchSource:0}: Error finding container f8e4bccda321836dbd865ccfdb62154ce4528a775e1bfb2499c15640ede3b376: Status 404 returned error can't find the container with id f8e4bccda321836dbd865ccfdb62154ce4528a775e1bfb2499c15640ede3b376 Jun 11 18:42:29.211747 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:29.211697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" event={"ID":"c50b0fc7-bacd-4175-910c-0ead1aaa3d39","Type":"ContainerStarted","Data":"d0794d55b8bccbdab972060d99952ff96349fbe88fe41721fb67783b097f6941"} Jun 11 18:42:29.211939 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:29.211779 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" event={"ID":"c50b0fc7-bacd-4175-910c-0ead1aaa3d39","Type":"ContainerStarted","Data":"f8e4bccda321836dbd865ccfdb62154ce4528a775e1bfb2499c15640ede3b376"} Jun 11 18:42:29.272078 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:29.272045 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:33.234637 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:33.234603 2568 generic.go:356] "Generic (PLEG): container finished" podID="c50b0fc7-bacd-4175-910c-0ead1aaa3d39" containerID="d0794d55b8bccbdab972060d99952ff96349fbe88fe41721fb67783b097f6941" exitCode=0 Jun 11 18:42:33.235046 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:33.234659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" event={"ID":"c50b0fc7-bacd-4175-910c-0ead1aaa3d39","Type":"ContainerDied","Data":"d0794d55b8bccbdab972060d99952ff96349fbe88fe41721fb67783b097f6941"} Jun 11 18:42:34.241691 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:34.241658 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" event={"ID":"c50b0fc7-bacd-4175-910c-0ead1aaa3d39","Type":"ContainerStarted","Data":"8f5a3ff1555e4ce8e6e464690e8d67309448ef88f2572e2642ee260f58d9cf0c"} Jun 11 18:42:34.264583 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:34.264529 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" podStartSLOduration=2.625424001 podStartE2EDuration="6.264513563s" totalImagesPullingTime="210.018519ms" totalInitContainerRuntime="3.429071043s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:34.262196804 +0000 UTC m=+865.058353953" watchObservedRunningTime="2026-06-11 18:42:34.264513563 +0000 UTC m=+865.060670738" Jun 11 18:42:38.694399 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:38.694362 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:38.694902 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:38.694426 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:38.707259 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:38.707229 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:39.277093 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:39.277053 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5" Jun 11 18:42:39.775116 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:39.775082 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:54.084477 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.084434 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z"] Jun 11 18:42:54.100433 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.100410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.103493 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.103453 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 18:42:54.113673 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.113644 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z"] Jun 11 18:42:54.166326 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.166493 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.166493 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.166493 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.166624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw8s\" (UniqueName: \"kubernetes.io/projected/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kube-api-access-rrw8s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.166624 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.166511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267629 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw8s\" (UniqueName: \"kubernetes.io/projected/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kube-api-access-rrw8s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.267849 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.267752 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.268181 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.268156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.268243 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.268196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.268243 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.268209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.270057 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.270034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.270346 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.270327 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.276219 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.276192 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw8s\" (UniqueName: \"kubernetes.io/projected/bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c-kube-api-access-rrw8s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-29n4z\" (UID: \"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.432316 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.432231 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:42:54.575789 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:54.575764 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z"] Jun 11 18:42:54.578557 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:42:54.578529 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab41f4d_13fb_4d4b_b33b_cd9d7eb05b4c.slice/crio-4a5c97e85741ad95adb098e043d4952a3ab1629127567dffcdeb8bf2ec6d141f WatchSource:0}: Error finding container 4a5c97e85741ad95adb098e043d4952a3ab1629127567dffcdeb8bf2ec6d141f: Status 404 returned error can't find the container with id 4a5c97e85741ad95adb098e043d4952a3ab1629127567dffcdeb8bf2ec6d141f Jun 11 18:42:55.343705 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:55.343670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" event={"ID":"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c","Type":"ContainerStarted","Data":"5e248bf0ba9738a5287519887a53ecf345447fbdb4f40820e525ac413c955f56"} Jun 11 18:42:55.344079 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:55.343716 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" event={"ID":"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c","Type":"ContainerStarted","Data":"4a5c97e85741ad95adb098e043d4952a3ab1629127567dffcdeb8bf2ec6d141f"} Jun 11 18:42:55.371485 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:55.371441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:42:56.349642 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:56.349607 2568 generic.go:356] "Generic (PLEG): container finished" podID="bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c" containerID="5e248bf0ba9738a5287519887a53ecf345447fbdb4f40820e525ac413c955f56" exitCode=0 Jun 11 18:42:56.350112 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:56.349656 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" event={"ID":"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c","Type":"ContainerDied","Data":"5e248bf0ba9738a5287519887a53ecf345447fbdb4f40820e525ac413c955f56"} Jun 11 18:42:57.356774 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:57.356736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" event={"ID":"bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c","Type":"ContainerStarted","Data":"cd0d6a2687b855b65277a0f7fa92783dfbba4a5563469b2f0f5949587d8c58d1"} Jun 11 18:42:57.378282 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:42:57.378225 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" podStartSLOduration=1.946355039 podStartE2EDuration="3.378208505s" totalImagesPullingTime="198.381321ms" totalInitContainerRuntime="1.233472145s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:57.37656104 +0000 UTC m=+888.172718202" watchObservedRunningTime="2026-06-11 18:42:57.378208505 +0000 UTC m=+888.174365642" Jun 11 18:43:04.433197 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:43:04.433102 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:43:04.433197 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:43:04.433155 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:43:04.445873 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:43:04.445844 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:43:05.404919 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:43:05.404888 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-29n4z" Jun 11 18:44:25.578990 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:44:25.578948 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:44:35.299125 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:44:35.299035 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:44:44.871220 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:44:44.871181 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:44:54.665635 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:44:54.665600 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:45:04.074706 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:45:04.074668 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:45:14.366272 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:45:14.366235 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:45:48.973838 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:45:48.973802 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:45:53.873075 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:45:53.873039 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:46:00.471417 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:46:00.471334 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:46:15.771863 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:46:15.771832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:46:54.474674 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:46:54.474636 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:47:11.070591 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:47:11.070554 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:47:25.176693 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:47:25.176658 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:47:42.068694 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:47:42.068606 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-htrvf"] Jun 11 18:47:59.707174 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:47:59.707144 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc9d4d789-2nmlk_5be84ffb-3614-4997-852e-c93fd814dc14/nginx/0.log" Jun 11 18:47:59.924446 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:47:59.924412 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7b5km_4c5f0287-15c2-406d-99d0-4b0f454fb2f1/manager/0.log" Jun 11 18:48:00.055939 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:00.055905 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hxnnt_0dab78fa-7e44-4e90-b6b4-82a2efe82eb6/manager/0.log" Jun 11 18:48:00.390931 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:00.390845 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9674k_53bd802e-2fdf-487f-83f1-411543b86d0b/server/0.log" Jun 11 18:48:00.504483 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:00.504445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tcj4v_c842f212-48d2-49da-8fc4-4fc6dc061864/manager/0.log" Jun 11 18:48:00.736434 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:00.736353 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-85tlv_7b4ec65b-d380-4fd7-ba1d-08eca39eab1f/copy-manifests/0.log" Jun 11 18:48:00.743192 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:00.743166 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-85tlv_7b4ec65b-d380-4fd7-ba1d-08eca39eab1f/manager/0.log" Jun 11 18:48:02.801251 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:02.801225 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kqr5k_41dde401-0864-4ad6-ba24-0f3ee1a1cc24/manager/0.log" Jun 11 18:48:02.935782 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:02.935755 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-htrvf_1ce05eca-396b-498b-96ae-93cb1138758f/limitador/0.log" Jun 11 18:48:03.508491 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:03.508448 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4hmtp_26964d51-81ec-4686-86b9-4944bce2054d/discovery/0.log" Jun 11 18:48:03.617373 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:03.617343 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-rdt9s_3109dd71-4d43-4375-a0dc-4bb2ba22e760/kube-auth-proxy/0.log" Jun 11 18:48:04.632182 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:04.632154 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6qtbn_646493b5-9901-487d-9096-04db1acb53dc/storage-initializer/0.log" Jun 11 18:48:04.639007 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:04.638983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6qtbn_646493b5-9901-487d-9096-04db1acb53dc/main/0.log" Jun 11 18:48:04.870531 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:04.870498 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5_c50b0fc7-bacd-4175-910c-0ead1aaa3d39/storage-initializer/0.log" Jun 11 18:48:04.877656 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:04.877633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477csvjf5_c50b0fc7-bacd-4175-910c-0ead1aaa3d39/main/0.log" Jun 11 18:48:05.102337 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:05.102309 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-29n4z_bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c/storage-initializer/0.log" Jun 11 18:48:05.109114 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:05.109090 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-29n4z_bab41f4d-13fb-4d4b-b33b-cd9d7eb05b4c/main/0.log" Jun 11 18:48:11.585619 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:11.585579 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b2w26_34dd40f8-a2bc-46b4-9246-d18019b93c02/global-pull-secret-syncer/0.log" Jun 11 18:48:11.698163 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:11.698129 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-knjm7_de7dd93b-016f-4bc0-a0ab-a569c69135f0/konnectivity-agent/0.log" Jun 11 18:48:11.787130 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:11.787102 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-116.ec2.internal_81c97266164387c531fda220849e753b/haproxy/0.log" Jun 11 18:48:15.400741 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:15.400683 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-rg5vk_cf942c05-5375-4511-ac4c-104a9fe17f28/sail-operator/0.log" Jun 11 18:48:17.202225 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:17.202191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kqr5k_41dde401-0864-4ad6-ba24-0f3ee1a1cc24/manager/0.log" Jun 11 18:48:17.227694 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:17.227665 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-htrvf_1ce05eca-396b-498b-96ae-93cb1138758f/limitador/0.log" Jun 11 18:48:19.432614 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:19.432535 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/node-exporter/0.log" Jun 11 18:48:19.461795 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:19.461769 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/kube-rbac-proxy/0.log" Jun 11 18:48:19.488024 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:19.488001 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dd5r_fd2d4a57-3940-4733-96ec-2add59ada1b2/init-textfile/0.log" Jun 11 18:48:20.031093 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:20.031062 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/telemeter-client/0.log" Jun 11 18:48:20.057806 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:20.057778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/reload/0.log" Jun 11 18:48:20.081532 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:20.081507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc8c5bc4c-jn56t_45544c37-40be-43c3-9190-bf1348071c0b/kube-rbac-proxy/0.log" Jun 11 18:48:22.617551 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.617513 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b96795c-chtl7_a44b6ccd-cbf9-44e9-9e1c-396f7d747589/console/0.log" Jun 11 18:48:22.625511 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.625483 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j"] Jun 11 18:48:22.628930 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.628913 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.631619 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.631599 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"openshift-service-ca.crt\"" Jun 11 18:48:22.632898 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.632874 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mx5g9\"/\"default-dockercfg-xxwwp\"" Jun 11 18:48:22.633017 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.632883 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"kube-root-ca.crt\"" Jun 11 18:48:22.637936 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.637909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j"] Jun 11 18:48:22.659878 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.659850 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-kwslm_1fca2e18-81dc-44c5-99c8-fdd8a4f625d0/download-server/0.log" Jun 11 18:48:22.763520 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.763487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-lib-modules\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.763749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.763539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-podres\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.763749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.763609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-proc\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.763749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.763639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6jcn\" (UniqueName: \"kubernetes.io/projected/5385c9c3-f15a-4be8-91d5-b3d5de79f014-kube-api-access-q6jcn\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.763749 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.763690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-sys\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864121 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-podres\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864121 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-proc\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6jcn\" (UniqueName: \"kubernetes.io/projected/5385c9c3-f15a-4be8-91d5-b3d5de79f014-kube-api-access-q6jcn\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-sys\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-proc\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-podres\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-lib-modules\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-sys\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.864580 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.864425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5385c9c3-f15a-4be8-91d5-b3d5de79f014-lib-modules\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.871981 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.871922 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6jcn\" (UniqueName: \"kubernetes.io/projected/5385c9c3-f15a-4be8-91d5-b3d5de79f014-kube-api-access-q6jcn\") pod \"perf-node-gather-daemonset-54n8j\" (UID: \"5385c9c3-f15a-4be8-91d5-b3d5de79f014\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:22.940269 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:22.940233 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:23.072241 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:23.072215 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j"] Jun 11 18:48:23.074312 ip-10-0-143-116 kubenswrapper[2568]: W0611 18:48:23.074277 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5385c9c3_f15a_4be8_91d5_b3d5de79f014.slice/crio-5d1758d62b3a8beb857e61544ed2c04db8aca5107af879a36d84193a4709836a WatchSource:0}: Error finding container 5d1758d62b3a8beb857e61544ed2c04db8aca5107af879a36d84193a4709836a: Status 404 returned error can't find the container with id 5d1758d62b3a8beb857e61544ed2c04db8aca5107af879a36d84193a4709836a Jun 11 18:48:23.939397 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:23.939358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" event={"ID":"5385c9c3-f15a-4be8-91d5-b3d5de79f014","Type":"ContainerStarted","Data":"960ad4a156f2170d00f4eed03cb434444dd9f148dd39db00405d1f4608bb6969"} Jun 11 18:48:23.939823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:23.939412 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" event={"ID":"5385c9c3-f15a-4be8-91d5-b3d5de79f014","Type":"ContainerStarted","Data":"5d1758d62b3a8beb857e61544ed2c04db8aca5107af879a36d84193a4709836a"} Jun 11 18:48:23.939823 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:23.939433 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:23.956658 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:23.956608 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" podStartSLOduration=1.9565863559999999 podStartE2EDuration="1.956586356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:48:23.954876326 +0000 UTC m=+1214.751033484" watchObservedRunningTime="2026-06-11 18:48:23.956586356 +0000 UTC m=+1214.752743492" Jun 11 18:48:24.572343 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:24.572312 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xk77_e45fcb05-37e4-40ef-a025-65efa8a866f2/dns/0.log" Jun 11 18:48:24.595656 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:24.595628 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xk77_e45fcb05-37e4-40ef-a025-65efa8a866f2/kube-rbac-proxy/0.log" Jun 11 18:48:24.617551 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:24.617530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mjc2_64d37b91-8e59-46cf-a224-2b7ae49175ac/dns-node-resolver/0.log" Jun 11 18:48:25.260486 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:25.260440 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwdph_a3b11f73-8ed0-4dda-9f78-44277270153d/node-ca/0.log" Jun 11 18:48:26.216819 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:26.216789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4hmtp_26964d51-81ec-4686-86b9-4944bce2054d/discovery/0.log" Jun 11 18:48:26.235792 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:26.235766 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-rdt9s_3109dd71-4d43-4375-a0dc-4bb2ba22e760/kube-auth-proxy/0.log" Jun 11 18:48:27.016953 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:27.016925 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz966_1b13a704-4238-416e-8b90-f250ccab9209/serve-healthcheck-canary/0.log" Jun 11 18:48:27.691756 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:27.691724 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pctcb_82374c23-7c3b-4ff9-bd89-08320f49240a/kube-rbac-proxy/0.log" Jun 11 18:48:27.711894 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:27.711865 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pctcb_82374c23-7c3b-4ff9-bd89-08320f49240a/exporter/0.log" Jun 11 18:48:27.732703 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:27.732674 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pctcb_82374c23-7c3b-4ff9-bd89-08320f49240a/extractor/0.log" Jun 11 18:48:29.861919 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:29.861888 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc9d4d789-2nmlk_5be84ffb-3614-4997-852e-c93fd814dc14/nginx/0.log" Jun 11 18:48:29.911976 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:29.911949 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7b5km_4c5f0287-15c2-406d-99d0-4b0f454fb2f1/manager/0.log" Jun 11 18:48:29.955742 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:29.955714 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-54n8j" Jun 11 18:48:29.963148 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:29.963122 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hxnnt_0dab78fa-7e44-4e90-b6b4-82a2efe82eb6/manager/0.log" Jun 11 18:48:30.036622 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:30.036579 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9674k_53bd802e-2fdf-487f-83f1-411543b86d0b/server/0.log" Jun 11 18:48:30.086056 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:30.086026 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tcj4v_c842f212-48d2-49da-8fc4-4fc6dc061864/manager/0.log" Jun 11 18:48:30.158284 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:30.158198 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-85tlv_7b4ec65b-d380-4fd7-ba1d-08eca39eab1f/manager/0.log" Jun 11 18:48:30.180107 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:30.180079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-85tlv_7b4ec65b-d380-4fd7-ba1d-08eca39eab1f/copy-manifests/0.log" Jun 11 18:48:32.020629 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:32.020588 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2jjpz_3760c6c9-b72f-43b0-8c6e-e3154f010e59/openshift-lws-operator/0.log" Jun 11 18:48:36.928879 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:36.928846 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4hmtp_26964d51-81ec-4686-86b9-4944bce2054d/discovery/0.log" Jun 11 18:48:36.939257 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:36.939233 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-rdt9s_3109dd71-4d43-4375-a0dc-4bb2ba22e760/kube-auth-proxy/0.log" Jun 11 18:48:38.257211 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:38.257180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4hmtp_26964d51-81ec-4686-86b9-4944bce2054d/discovery/0.log" Jun 11 18:48:38.268740 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:38.268716 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-rdt9s_3109dd71-4d43-4375-a0dc-4bb2ba22e760/kube-auth-proxy/0.log" Jun 11 18:48:39.164696 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.164669 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/kube-multus-additional-cni-plugins/0.log" Jun 11 18:48:39.185302 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.185278 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/egress-router-binary-copy/0.log" Jun 11 18:48:39.205859 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.205833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/cni-plugins/0.log" Jun 11 18:48:39.227547 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.227521 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/bond-cni-plugin/0.log" Jun 11 18:48:39.249275 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.249252 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/routeoverride-cni/0.log" Jun 11 18:48:39.269742 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.269721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/whereabouts-cni-bincopy/0.log" Jun 11 18:48:39.290355 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.290333 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gnvx5_e05fa631-9ece-4219-bf41-844420df3e6c/whereabouts-cni/0.log" Jun 11 18:48:39.475527 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.475447 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ms4tc_a58d6039-360c-47a3-820e-00e92dc94330/kube-multus/0.log" Jun 11 18:48:39.564440 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.564407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pf29_b987acf2-53b4-47aa-aea3-373b50b4c913/network-metrics-daemon/0.log" Jun 11 18:48:39.584816 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:39.584791 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2pf29_b987acf2-53b4-47aa-aea3-373b50b4c913/kube-rbac-proxy/0.log" Jun 11 18:48:40.001152 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:40.001120 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4hmtp_26964d51-81ec-4686-86b9-4944bce2054d/discovery/0.log" Jun 11 18:48:40.013315 ip-10-0-143-116 kubenswrapper[2568]: I0611 18:48:40.013291 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-rdt9s_3109dd71-4d43-4375-a0dc-4bb2ba22e760/kube-auth-proxy/0.log"